-- Logs begin at Wed 2022-08-24 01:09:02 UTC, end at Wed 2022-08-24 03:55:39 UTC. -- Aug 24 01:40:18.260468 n-d-854121-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 01:40:18.269776 n-d-854121-3 devstack@n-api.service[112753]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 01:40:18 2022] *** Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: nodename: n-d-854121-3 Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: machine: x86_64 Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: clock source: unix Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: pcre jit disabled Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: detected number of CPU cores: 4 Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: current working directory: / Aug 24 01:40:18.271732 n-d-854121-3 devstack@n-api.service[112753]: detected binary path: /usr/bin/uwsgi-core Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: your processes number limit is 47680 Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: your memory page size is 4096 bytes Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: detected max file descriptor number: 2048 Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: lock engine: pthread robust mutexes Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: thunder lock: enabled Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 01:40:18.272429 n-d-854121-3 devstack@n-api.service[112753]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 01:40:18.310588 n-d-854121-3 devstack@n-api.service[112753]: Python main interpreter initialized at 0x55eeb9cd69c0 Aug 24 01:40:18.310588 n-d-854121-3 devstack@n-api.service[112753]: python threads support enabled Aug 24 01:40:18.310588 n-d-854121-3 devstack@n-api.service[112753]: your server socket listen backlog is limited to 100 connections Aug 24 01:40:18.310588 n-d-854121-3 devstack@n-api.service[112753]: your mercy for graceful operations on workers is 90 seconds Aug 24 01:40:18.310910 n-d-854121-3 devstack@n-api.service[112753]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 01:40:18.310992 n-d-854121-3 devstack@n-api.service[112753]: *** Operational MODE: preforking *** Aug 24 01:40:18.311238 n-d-854121-3 devstack@n-api.service[112753]: *** uWSGI is running in multiple interpreter mode *** Aug 24 01:40:18.311238 n-d-854121-3 devstack@n-api.service[112753]: spawned uWSGI master process (pid: 112753) Aug 24 01:40:18.311416 n-d-854121-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 01:40:18.312432 n-d-854121-3 devstack@n-api.service[112753]: spawned uWSGI worker 1 (pid: 112754, cores: 1) Aug 24 01:40:18.312432 n-d-854121-3 devstack@n-api.service[112753]: spawned uWSGI worker 2 (pid: 112755, cores: 1) Aug 24 01:40:18.312432 n-d-854121-3 devstack@n-api.service[112753]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 01:40:18.962725 n-d-854121-3 devstack@n-api.service[112754]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 01:40:18.966444 n-d-854121-3 devstack@n-api.service[112755]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 01:40:20.039724 n-d-854121-3 devstack@n-api.service[112755]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:40:20.039724 n-d-854121-3 devstack@n-api.service[112755]: from cryptography.utils import int_from_bytes Aug 24 01:40:20.040447 n-d-854121-3 devstack@n-api.service[112755]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:40:20.040447 n-d-854121-3 devstack@n-api.service[112755]: from cryptography.utils import int_from_bytes Aug 24 01:40:20.042302 n-d-854121-3 devstack@n-api.service[112754]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:40:20.042302 n-d-854121-3 devstack@n-api.service[112754]: from cryptography.utils import int_from_bytes Aug 24 01:40:20.042719 n-d-854121-3 devstack@n-api.service[112754]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:40:20.042719 n-d-854121-3 devstack@n-api.service[112754]: from cryptography.utils import int_from_bytes Aug 24 01:40:22.530346 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 01:40:22.530871 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 01:40:22.530972 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 01:40:22.531317 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 01:40:22.531388 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 01:40:22.531466 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 01:40:22.531540 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 01:40:22.531605 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 01:40:22.531894 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 01:40:22.531993 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.532147 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 01:40:22.532275 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.532531 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.532640 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.532879 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.532976 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533203 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533295 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533520 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533628 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533838 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.533943 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534146 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534236 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534465 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534548 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534719 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.534814 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535027 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535117 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535337 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535420 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535650 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535744 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.535950 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536056 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536256 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536359 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536598 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536683 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.536920 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537051 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537237 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537320 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537537 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537622 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.537855 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538078 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538185 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538507 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538696 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538804 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.538966 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539117 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539273 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539429 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539569 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539745 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.539894 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540033 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540201 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540345 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540508 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540647 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540849 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.540988 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541159 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541290 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541480 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541685 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541778 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.541997 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.542164 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.542304 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.542487 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.542655 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.542789 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543010 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543095 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543313 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543500 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543614 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543810 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.543958 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544118 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544231 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544435 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544520 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544777 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.544890 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545088 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545180 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545413 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545506 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545732 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.545826 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546049 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546133 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546352 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546447 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546653 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546751 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.546959 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547042 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547256 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547339 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547552 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547645 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547796 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.547880 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548095 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548181 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548390 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548476 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548697 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.548855 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549044 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549129 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549290 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549419 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549536 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549674 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549848 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.549940 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550161 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550253 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550464 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550549 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550767 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.550864 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551068 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551153 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551368 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551467 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551669 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.551760 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.552488 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.552579 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.552820 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.552916 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553124 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553211 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553429 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553512 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553734 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.553819 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554048 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554135 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554350 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554435 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554666 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554758 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.554973 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555057 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555293 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555378 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555594 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555685 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.555926 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556017 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556231 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556324 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556541 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556645 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556873 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.556959 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557191 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557496 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557593 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557798 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.557884 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558100 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558192 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558405 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558500 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558727 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.558826 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559016 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559100 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559263 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559359 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559559 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559646 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559858 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.559950 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560164 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560255 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560462 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560545 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560779 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.560882 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561080 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561167 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561374 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561460 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561674 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561766 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.561973 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562065 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562272 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562361 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562573 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562658 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562876 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.562994 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563174 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563472 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563579 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563771 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.563867 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564067 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564162 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564369 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564474 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564675 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564824 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.564997 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.565093 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.565294 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.565399 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.565593 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.565689 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566137 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566245 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566456 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566581 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.566868 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.567054 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.567139 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.567367 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.567470 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568218 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568326 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568526 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568612 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568859 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.568967 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569162 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569252 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569460 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569613 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569771 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.569870 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570065 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570151 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570365 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570451 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570664 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.570962 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571045 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571259 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571344 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571555 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571641 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571850 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.571935 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572145 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572236 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572441 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572528 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572748 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.572845 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573047 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573139 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573340 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573425 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573642 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573727 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.573941 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574032 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574240 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574338 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574541 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574627 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574839 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.574932 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.575147 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.575231 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.575451 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.575536 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.575767 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:40:22.575932 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576100 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576186 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576412 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576494 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.576914 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577082 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577166 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577392 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577474 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577699 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.577785 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578006 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578090 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578322 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578406 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578626 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578755 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.578930 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579089 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579234 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579406 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579544 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579718 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.579855 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580028 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580178 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580346 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580489 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580662 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.580821 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581019 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581133 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581338 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581431 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581655 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581739 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.581970 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582061 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582282 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582375 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582599 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582683 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.582928 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583015 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583272 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583409 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583584 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583720 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.583904 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584040 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584219 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584361 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584515 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584655 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584839 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.584971 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585148 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585284 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585464 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585593 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585788 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.585929 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586078 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586211 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586406 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586580 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586709 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.586888 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587016 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587146 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587279 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587412 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587552 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587693 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587859 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.587993 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588186 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588314 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588493 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588636 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588825 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.588966 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589101 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589229 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589411 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589553 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589715 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.589844 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590037 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590187 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590316 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590468 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590605 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590734 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.590895 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591033 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591193 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591332 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591495 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591625 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591793 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.591921 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592104 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592235 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592412 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592540 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592710 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.592862 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593052 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593183 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593352 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593442 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593655 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593748 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.593959 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594045 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594264 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594393 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594564 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594657 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594868 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.594960 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595170 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595261 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595469 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595567 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595778 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.595862 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596081 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596165 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596385 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596481 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596700 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.596803 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597028 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597147 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597328 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597445 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597635 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597734 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.597937 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598035 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598243 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598341 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598543 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598627 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598879 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.598974 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599191 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599276 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599495 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599579 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599799 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.599891 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600121 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600206 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600433 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600518 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600748 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.600847 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601067 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601154 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601384 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601470 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601691 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601784 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.601987 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602071 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602289 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602374 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602586 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602683 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602882 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.602977 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603180 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603277 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603481 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603579 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603777 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.603863 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604076 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604161 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604374 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604515 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604672 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604791 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.604990 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605076 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605329 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605416 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605630 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605714 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.605929 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606015 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606229 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606316 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606524 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606609 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606831 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.606914 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607139 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607252 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607440 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607547 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607781 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.607879 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608087 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608186 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608398 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608494 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608707 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.608842 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609036 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609133 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609341 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609436 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609644 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609750 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.609949 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610048 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610252 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610374 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610566 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610677 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610870 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.610967 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611176 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611273 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611480 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611589 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611792 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.611894 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612094 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612197 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612406 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612523 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612703 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.612830 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613030 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613118 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613348 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613451 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613654 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613751 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.613967 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.614056 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.614281 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.614369 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615148 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615243 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615459 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615549 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615766 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.615854 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616071 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616164 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616374 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616471 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616681 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.616794 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617014 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617128 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617319 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617423 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617628 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617714 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.617930 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618015 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618242 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618341 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618544 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618631 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618854 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.618946 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619148 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619241 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619456 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619542 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619775 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.619862 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620082 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620190 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620390 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620476 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620697 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.620822 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621025 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621122 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621328 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621421 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621629 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621717 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.621933 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622021 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622228 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622322 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622524 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622611 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622826 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.622915 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623127 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623213 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623425 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623511 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623727 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.623823 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624022 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624110 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624326 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624423 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624626 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624739 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.624946 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625034 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625243 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625351 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625545 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625632 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625846 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.625932 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626147 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626247 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626455 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626551 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626772 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.626868 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627068 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627243 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627372 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627465 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627664 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627750 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.627965 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628070 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628264 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628363 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628558 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628646 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628876 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.628966 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629191 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629276 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629491 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629577 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629787 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.629874 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.630157 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.630731 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.630960 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631113 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631268 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631357 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631578 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631664 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631883 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.631970 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632186 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632499 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632585 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632833 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.632940 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633136 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633222 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633440 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633526 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633742 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.633838 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634044 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634131 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634347 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634434 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634655 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634749 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.634958 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635058 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635260 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635349 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635562 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635658 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635857 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.635950 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.636159 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.636246 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.636466 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.636554 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.636793 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637065 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637163 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637458 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637567 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637709 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.637955 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638043 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638285 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638373 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638602 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638691 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.638920 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639007 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639239 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639326 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639557 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639646 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639871 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.639972 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640178 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640274 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640480 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640576 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640805 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.640913 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641113 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641201 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641413 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641507 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641712 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.641800 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642011 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642098 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642311 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642397 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642610 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642698 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642910 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.642998 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643207 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643312 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643505 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643593 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643806 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.643892 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644103 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644198 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644403 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644496 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644702 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.644838 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645038 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645138 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645343 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645430 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645666 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645752 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.645982 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646079 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646282 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646368 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646609 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646695 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646910 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.646998 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647209 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647295 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647552 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647669 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647852 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.647949 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648174 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648268 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648471 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648565 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648810 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.648931 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649110 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649197 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649424 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649521 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649703 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.649797 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650008 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650103 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650310 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650405 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650607 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650702 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650913 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.650998 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651213 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651392 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651513 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651599 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651811 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.651898 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652109 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652205 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652411 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652498 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652706 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.652830 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653027 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653129 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653328 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653413 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653623 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653709 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.653918 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654013 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654223 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654310 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654521 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654608 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654816 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.654911 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655119 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655212 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655415 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655515 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655713 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.655800 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656006 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656092 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656304 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656391 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656603 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656691 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.656929 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657028 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657229 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657323 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657526 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657734 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657825 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.657905 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658129 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658225 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658424 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658512 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658722 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.658809 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659023 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659127 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659318 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659404 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659612 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659699 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.659912 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660008 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660213 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660300 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660516 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660603 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660832 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.660922 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661138 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661224 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661479 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661570 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661778 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.661867 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662075 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662165 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662377 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662463 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662672 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662761 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.662969 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663056 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663264 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663357 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663559 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663649 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663855 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.663942 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664151 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664246 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664454 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664541 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664765 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.664865 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665067 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665162 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665361 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665448 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665665 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665755 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.665965 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666062 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666264 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666353 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666602 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666688 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.666902 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667000 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667213 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667305 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667519 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667612 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667824 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.667916 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668130 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668225 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668428 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668515 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668748 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.668840 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669053 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669140 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669357 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669445 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669651 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669745 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.669948 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670043 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670261 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670348 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670560 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670656 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670860 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.670946 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671172 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671267 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671478 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671564 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671787 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.671881 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672082 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672177 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672381 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672475 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672682 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.672784 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673006 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673116 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673306 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673401 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673606 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673693 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.673908 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674002 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674209 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674303 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674511 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674607 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674813 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.674912 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675114 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675207 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675411 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675497 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675714 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.675812 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676011 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676105 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676307 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676394 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676611 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.676699 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.677455 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.677551 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.677755 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.677852 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678058 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678149 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678357 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678444 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678662 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.678959 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679052 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679260 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679363 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679570 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679732 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679880 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.679968 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680242 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680327 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680545 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680650 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680870 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.680971 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681177 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681265 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681483 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681588 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681780 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.681882 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682104 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682189 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682416 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682516 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682721 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.682814 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683059 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683153 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683357 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683445 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683652 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683738 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.683957 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684042 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684274 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684362 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684574 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684661 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684895 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.684985 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685193 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685281 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685508 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685595 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685807 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.685904 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686109 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686196 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686431 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686532 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686738 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.686848 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687058 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687146 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687476 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687569 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687786 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.687886 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688092 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688188 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688408 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688496 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688739 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.688842 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689059 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689147 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689358 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689497 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689665 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689804 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.689964 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690204 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690338 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690471 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690613 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690747 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.690878 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.691273 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.691407 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.691550 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.691708 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.691842 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.692026 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.692173 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.692343 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.692480 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.693227 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.693378 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.693551 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.693693 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.693889 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694027 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694204 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694341 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694525 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694657 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.694866 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695003 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695186 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695332 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695477 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695612 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695774 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.695912 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696078 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696181 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696376 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696464 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696674 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.696814 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697012 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697118 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697315 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697410 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697620 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697708 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.697923 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698062 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698226 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698318 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698523 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698610 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698822 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.698917 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699126 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699214 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699424 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699572 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699728 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.699816 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700035 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700121 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700346 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700433 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700658 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700764 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.700981 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701079 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701297 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701384 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701598 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701686 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701895 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.701983 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702192 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702286 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702489 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702577 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702802 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.702888 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703105 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703201 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703406 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703495 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703730 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.703856 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704047 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704156 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704348 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704443 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704676 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.704794 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705017 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705125 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705325 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705419 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705633 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705735 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.705951 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706047 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706250 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706344 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706549 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706652 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706854 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.706949 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707158 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707253 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707458 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707552 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707759 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.707854 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708063 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708199 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708386 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708476 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708686 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.708838 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709004 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709093 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709314 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709449 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709612 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709699 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.709917 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710003 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710219 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710313 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710517 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710605 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710817 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.710904 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711114 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711210 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711432 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711530 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711736 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.711824 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712039 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712136 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712346 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712433 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712661 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.712826 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713019 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713107 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713332 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713426 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713655 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713749 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.713969 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714057 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714279 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714367 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714591 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714678 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.714905 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715005 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715211 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715307 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715521 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715616 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715830 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.715925 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716143 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716250 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716457 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716653 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716796 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.716999 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.717115 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.717313 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.717620 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.717721 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.717927 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718023 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718234 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718327 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718540 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718646 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718844 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.718932 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719151 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719240 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719456 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719668 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.719844 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720068 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720155 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720379 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720474 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720689 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.720841 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721040 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721128 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721356 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721468 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721667 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721765 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.721975 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722080 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722284 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722380 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722604 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722706 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.722918 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723022 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723216 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723316 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723525 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723620 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723857 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.723951 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724168 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724263 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724473 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724567 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724798 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.724895 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725104 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725192 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725409 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725502 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725712 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.725800 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726015 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726107 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726322 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726429 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726625 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726712 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.726930 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727014 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727241 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727336 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727554 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727640 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727861 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.727952 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.728166 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.728275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.728477 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.728573 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.728818 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729011 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729133 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729325 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729478 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729649 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.729957 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730090 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730273 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730412 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730580 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730718 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.730892 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731040 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731207 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731352 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731483 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731628 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731765 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.731903 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732061 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732210 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732356 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732444 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732653 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732785 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.732989 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733084 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733293 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733381 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733590 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733689 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733903 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.733991 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.734204 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.734299 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.734506 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.734728 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.734824 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735066 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735163 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735376 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735631 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735728 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.735978 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736066 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736299 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736417 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736600 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736695 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.736941 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737034 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737250 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737356 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737549 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737651 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737860 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.737945 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738165 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738258 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738463 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738564 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738761 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.738855 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.739067 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.739152 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.739371 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740037 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740194 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740395 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740536 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740694 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740852 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.740938 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741113 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741210 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741412 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741509 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741712 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.741801 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742008 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742096 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742313 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742412 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742612 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742700 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742910 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.742998 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743209 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743306 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743506 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743600 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743806 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.743893 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744101 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744189 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744400 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744489 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744694 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.744835 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745015 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745107 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745312 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745399 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745612 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745698 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745906 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.745993 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746208 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746294 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746502 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746593 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746804 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.746892 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747124 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747218 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747423 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747519 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747744 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.747850 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748050 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748136 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748354 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748518 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748696 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.748864 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749003 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749091 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749312 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749528 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749656 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749859 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.749970 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.750177 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.750503 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.750599 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.750829 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.750917 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751131 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751217 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751430 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751519 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751730 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.751817 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752049 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752136 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752355 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752453 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752657 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752777 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.752987 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753073 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753292 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753381 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753595 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753683 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753900 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.753997 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754207 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754293 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754508 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754596 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754811 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.754907 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.755658 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.755753 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.755966 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756054 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756271 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756367 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756576 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756683 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756900 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.756999 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757209 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757298 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757519 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757608 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757828 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.757923 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758140 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758228 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758451 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758538 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758787 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.758887 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759061 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759151 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759363 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759450 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759665 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759760 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.759965 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760054 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760361 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760584 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760680 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.760915 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761016 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761214 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761302 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761542 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761638 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761852 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.761940 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762155 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762244 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762513 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762608 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762818 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.762905 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763133 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763227 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763454 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763562 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763754 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.763860 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764068 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764156 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764372 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764460 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764681 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.764788 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765024 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765123 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765334 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765422 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765650 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765743 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.765951 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766049 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766250 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766336 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766548 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766638 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766850 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.766954 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767161 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767248 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767462 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767556 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767763 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.767858 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768059 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768145 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768359 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768444 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768653 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768758 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.768974 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769072 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769268 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769354 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769566 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769661 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769865 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.769956 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770158 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770262 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770454 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770548 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770792 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.770884 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771094 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771250 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771396 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771536 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771681 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771826 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.771962 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.772112 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.772247 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.772395 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.772532 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.772668 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774177 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774283 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774368 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774448 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774528 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774528 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774688 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.774779 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775101 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775191 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775428 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775524 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775737 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.775834 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776056 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776150 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776363 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776464 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776693 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.776832 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777021 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777111 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777332 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777427 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777637 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777726 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.777963 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778051 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778274 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778361 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778580 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778677 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778885 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.778985 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779190 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779287 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779494 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779587 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779796 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.779882 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780109 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780205 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780471 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780576 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780748 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.780844 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781059 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781205 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781367 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781453 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781684 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781773 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.781993 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782088 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782298 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782389 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782620 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782705 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.782923 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783016 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783230 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783316 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783535 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783620 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783848 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.783933 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784147 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784242 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784453 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784539 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784777 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.784868 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785086 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785172 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785393 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785487 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785700 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.785791 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786014 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786098 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786345 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786439 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786646 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786737 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.786963 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787061 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787275 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787371 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787598 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787692 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787904 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.787988 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788216 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788309 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788539 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788625 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788866 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.788953 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.789176 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.789274 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.789475 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.789570 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.789714 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112755) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 01:40:22.789844 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.790173 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.790486 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.790799 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.791106 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:40:22.791350 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112754) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 01:40:22.944007 n-d-854121-3 devstack@n-api.service[112755]: INFO dbcounter [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Registered counter for database nova_api Aug 24 01:40:22.946002 n-d-854121-3 devstack@n-api.service[112754]: INFO dbcounter [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Registered counter for database nova_api Aug 24 01:40:22.965299 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:22.967031 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_db.sqlalchemy.engines [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:22.971763 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writer thread running {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:22.973390 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writer thread running {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.027744 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.context [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=112755) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 01:40:23.029975 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.context [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=112754) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 01:40:23.031618 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:40:23.032036 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:40:23.033624 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:40:23.033816 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:40:23.034287 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:40:23.034377 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:40:23.034758 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:40:23.035846 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:40:23.037129 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:40:23.037313 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:40:23.037569 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:40:23.039213 n-d-854121-3 devstack@n-api.service[112755]: INFO dbcounter [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Registered counter for database nova_cell0 Aug 24 01:40:23.039554 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_concurrency.lockutils [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112754) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:40:23.041540 n-d-854121-3 devstack@n-api.service[112754]: INFO dbcounter [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Registered counter for database nova_cell0 Aug 24 01:40:23.044484 n-d-854121-3 devstack@n-api.service[112755]: INFO dbcounter [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Registered counter for database nova_cell1 Aug 24 01:40:23.047054 n-d-854121-3 devstack@n-api.service[112754]: INFO dbcounter [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Registered counter for database nova_cell1 Aug 24 01:40:23.053016 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.054094 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.055502 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_db.sqlalchemy.engines [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.058221 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writer thread running {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.058554 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_db.sqlalchemy.engines [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.062361 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writer thread running {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.195511 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writer thread running {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.199530 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writer thread running {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.203936 n-d-854121-3 devstack@n-api.service[112755]: INFO dbcounter [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Registered counter for database nova_cell0 Aug 24 01:40:23.208680 n-d-854121-3 devstack@n-api.service[112754]: INFO dbcounter [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Registered counter for database nova_cell0 Aug 24 01:40:23.210824 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112755) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.215286 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writer thread running {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.217535 n-d-854121-3 devstack@n-api.service[112754]: DEBUG oslo_db.sqlalchemy.engines [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112754) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:40:23.221879 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writer thread running {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:40:23.550016 n-d-854121-3 devstack@n-api.service[112755]: WARNING keystonemiddleware.auth_token [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:40:23.553348 n-d-854121-3 devstack@n-api.service[112754]: WARNING keystonemiddleware.auth_token [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:40:23.557239 n-d-854121-3 devstack@n-api.service[112755]: WARNING keystonemiddleware.auth_token [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:40:23.560516 n-d-854121-3 devstack@n-api.service[112754]: WARNING keystonemiddleware.auth_token [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:40:23.896620 n-d-854121-3 devstack@n-api.service[112755]: WARNING keystonemiddleware.auth_token [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:40:23.902473 n-d-854121-3 devstack@n-api.service[112755]: WARNING keystonemiddleware.auth_token [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:40:23.903053 n-d-854121-3 devstack@n-api.service[112754]: WARNING keystonemiddleware.auth_token [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:40:23.907679 n-d-854121-3 devstack@n-api.service[112755]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eeb9cd69c0 pid: 112755 (default app) Aug 24 01:40:23.908975 n-d-854121-3 devstack@n-api.service[112754]: WARNING keystonemiddleware.auth_token [None req-88196605-7cd1-4864-80eb-33f5887689f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:40:23.909759 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:40:23.910923 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Aug 24 01:40:23.912124 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed Aug 24 01:40:23 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:40:23.914731 n-d-854121-3 devstack@n-api.service[112754]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eeb9cd69c0 pid: 112754 (default app) Aug 24 01:41:41.202852 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:41.203852 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 24 01:41:41.204257 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:41.220864 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_api:SELECT=3 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:41.221973 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_cell0:SELECT=3 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:41.222832 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_cell1:SELECT=3 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:41.223844 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:42.088511 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-8f155c48-55b4-4118-8e53-862af4711e12 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:42.120617 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-8f155c48-55b4-4118-8e53-862af4711e12 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909308 Aug 24 01:41:42.121464 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 01:41:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:44.480902 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:44.482592 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-ac0cbafe-a948-45e5-8f95-1944a5e6ce89 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 24 01:41:44.482592 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:44.897825 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-b1561eb4-c839-4cbe-8445-ecbc3a11ed33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "vcpus": 1, "ram": 256}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:44.917231 n-d-854121-3 devstack@n-api.service[112754]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:41:44.917231 n-d-854121-3 devstack@n-api.service[112754]: warnings.warn(msg) Aug 24 01:41:44.949407 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-b1561eb4-c839-4cbe-8445-ecbc3a11ed33 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.458377 Aug 24 01:41:44.956860 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:41:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:41:45.198822 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-d8b2d3c4-7838-4a4b-9e10-da554eb12773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:45.198822 n-d-854121-3 devstack@n-api.service[112755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:41:45.198822 n-d-854121-3 devstack@n-api.service[112755]: warnings.warn(msg) Aug 24 01:41:45.217756 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_api:SELECT=3 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:45.218822 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_cell0:SELECT=3 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:45.219407 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_cell1:SELECT=3 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:45.220157 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:41:45.269555 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-d8b2d3c4-7838-4a4b-9e10-da554eb12773 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310630 Aug 24 01:41:45.270146 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 01:41:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:47.633575 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-b1561eb4-c839-4cbe-8445-ecbc3a11ed33 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:47.635295 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-b1561eb4-c839-4cbe-8445-ecbc3a11ed33 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Aug 24 01:41:47.639386 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:48.326374 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-e6547520-0e92-4693-b527-7d9a262fc660 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:48.346965 n-d-854121-3 devstack@n-api.service[112755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:41:48.346965 n-d-854121-3 devstack@n-api.service[112755]: warnings.warn(msg) Aug 24 01:41:48.366167 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-e6547520-0e92-4693-b527-7d9a262fc660 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723514 Aug 24 01:41:48.367257 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:41:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:41:48.379212 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-248427d4-2a40-418c-b584-c3b94ad7ade8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:48.382076 n-d-854121-3 devstack@n-api.service[112754]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:41:48.382076 n-d-854121-3 devstack@n-api.service[112754]: warnings.warn(msg) Aug 24 01:41:48.415271 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-248427d4-2a40-418c-b584-c3b94ad7ade8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040189 Aug 24 01:41:48.416160 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 01:41:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:51.055557 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-e6547520-0e92-4693-b527-7d9a262fc660 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:51.057302 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-e6547520-0e92-4693-b527-7d9a262fc660 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Aug 24 01:41:51.063159 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:51.497323 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-858383d8-2937-4ac9-8465-01ad64ac4753 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:51.522616 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-858383d8-2937-4ac9-8465-01ad64ac4753 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457370 Aug 24 01:41:51.524202 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:41:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:41:51.538498 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-c5fd853f-2260-47a8-bb2c-c3eb77f14145 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:51.570220 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-c5fd853f-2260-47a8-bb2c-c3eb77f14145 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036426 Aug 24 01:41:51.580869 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 01:41:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:54.110633 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-858383d8-2937-4ac9-8465-01ad64ac4753 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:54.113031 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-858383d8-2937-4ac9-8465-01ad64ac4753 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 Aug 24 01:41:54.118997 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:54.588562 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-c32d2fde-9111-4e3b-9374-e3823f387248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:54.611288 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-c32d2fde-9111-4e3b-9374-e3823f387248 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491052 Aug 24 01:41:54.612594 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:41:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:41:54.624098 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-3d99ce3f-d5fb-422a-b45a-1138ab5e3587 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:54.649810 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-3d99ce3f-d5fb-422a-b45a-1138ab5e3587 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029424 Aug 24 01:41:54.650383 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 01:41:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:57.009569 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-c32d2fde-9111-4e3b-9374-e3823f387248 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:57.011168 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-c32d2fde-9111-4e3b-9374-e3823f387248 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002171 Aug 24 01:41:57.012017 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:41:57.467234 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:57.493411 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474096 Aug 24 01:41:57.495268 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:41:57.511070 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-2c648d06-fe17-4902-935c-488e8cb8da08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:41:57.550084 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-2c648d06-fe17-4902-935c-488e8cb8da08 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045202 Aug 24 01:41:57.551310 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1336 bytes} [Wed Aug 24 01:41:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:41:59.981764 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:41:59.982776 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 01:41:59.983175 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:00.402599 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-73015e82-4625-4d60-a28d-53948e4161ef admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:00.428821 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-73015e82-4625-4d60-a28d-53948e4161ef admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438684 Aug 24 01:42:00.429380 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 01:41:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:42:02.936561 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:02.937677 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-4ab571cd-2e68-44d1-ac14-773147ef328a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Aug 24 01:42:02.938595 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:03.351622 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-05ff8abb-3188-493e-967c-94bb4aa24fa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "rxtx_factor": 1.0}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:03.375537 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-05ff8abb-3188-493e-967c-94bb4aa24fa2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.429706 Aug 24 01:42:03.376970 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:42:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:03.388810 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-42335620-d446-4c54-bf2d-fd907b5fb66d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:03.414101 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-42335620-d446-4c54-bf2d-fd907b5fb66d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028972 Aug 24 01:42:03.415121 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 01:42:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:42:06.299093 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-05ff8abb-3188-493e-967c-94bb4aa24fa2 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:06.300120 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-05ff8abb-3188-493e-967c-94bb4aa24fa2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 01:42:06.300529 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:06.717760 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-963d67af-2218-43a0-86d1-760b041cd2b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "id": "2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:06.736038 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-963d67af-2218-43a0-86d1-760b041cd2b5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.429256 Aug 24 01:42:06.736738 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:42:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:42:06.748964 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-b717bab3-40d5-4ad9-9c84-92f6df85144f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:06.774766 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-b717bab3-40d5-4ad9-9c84-92f6df85144f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029455 Aug 24 01:42:06.775237 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 01:42:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:42:09.129307 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-963d67af-2218-43a0-86d1-760b041cd2b5 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:09.130355 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-963d67af-2218-43a0-86d1-760b041cd2b5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 24 01:42:09.130762 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:09.531053 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-7e4cb97c-601f-42d6-8caf-f260175865ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "vcpus": 2}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:09.549593 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-7e4cb97c-601f-42d6-8caf-f260175865ec admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.412789 Aug 24 01:42:09.550140 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:42:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:09.562078 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-ef684727-c4e6-4149-84f9-f7e4b9b20836 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:09.587385 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-ef684727-c4e6-4149-84f9-f7e4b9b20836 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028997 Aug 24 01:42:09.587940 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 01:42:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:42:11.938740 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-7e4cb97c-601f-42d6-8caf-f260175865ec admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:11.939740 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-7e4cb97c-601f-42d6-8caf-f260175865ec admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 24 01:42:11.940304 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:12.347665 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-0cb3c68c-6fce-41f0-9a74-31a1177f8706 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "disk": 80, "swap": 0, "ram": 8192, "name": "m1.large", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:12.355476 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:42:12.370478 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-0cb3c68c-6fce-41f0-9a74-31a1177f8706 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423892 Aug 24 01:42:12.371235 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:42:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:12.399019 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-a098bc4c-af10-4640-9a12-18067577b404 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:12.483560 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-a098bc4c-af10-4640-9a12-18067577b404 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091626 Aug 24 01:42:12.484328 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 01:42:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:42:14.902319 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-0cb3c68c-6fce-41f0-9a74-31a1177f8706 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:14.903452 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-0cb3c68c-6fce-41f0-9a74-31a1177f8706 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 24 01:42:14.903955 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:15.358014 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "name": "m1.xlarge", "ram": 16384}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:15.366113 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:42:15.378713 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.468126 Aug 24 01:42:15.379595 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1283 bytes} [Wed Aug 24 01:42:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:15.392447 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-94d195e6-2962-4824-ab4b-38e579aa7f00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:15.417935 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-94d195e6-2962-4824-ab4b-38e579aa7f00 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030341 Aug 24 01:42:15.419061 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1333 bytes} [Wed Aug 24 01:42:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:42:37.666608 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:37.667618 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 01:42:37.668029 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:42:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:37.678366 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:42:38.051247 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-b9b04ee6-d8d3-4fc9-95da-16f8a2708165 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:38.069742 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-b9b04ee6-d8d3-4fc9-95da-16f8a2708165 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395871 Aug 24 01:42:38.070271 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 01:42:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:39.107188 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:39.108187 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-31bae81f-ccf7-4d77-906e-74493ca01f6a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 24 01:42:39.108603 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:39.661866 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-6d41aadb-9311-4888-802b-633d182f5e08 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:39.667479 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.wsgi [None req-6d41aadb-9311-4888-802b-633d182f5e08 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-6d41aadb-9311-4888-802b-633d182f5e08 admin admin] Request method failure captured: Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Accept: application/json Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Accept-Encoding: gzip, deflate Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Connection: keep-alive Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Content-Length: 0 Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Host: 10.222.0.49 Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: Openstack-System-Scope: None Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: User-Agent: python-novaclient Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Auth-Token: gAAAAABjBYIPQ3M4lUwDr31B0Q79Yj1I4UoLyd_eFutmD7yVw9F4ArBTQks71PcNiJKGiYSG58SM-RSfczGIA_zxaQWIVK9gCdx_VxmYjXITeW95hKSnwMBXuwezCXK8HAZJ5EOBxH_Qen_CS-GvdUfruGrpmMTBtYEJGR4BJJ_cqIggwnipiqk Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Id: None Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Name: None Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Identity-Status: Confirmed Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Is-Admin-Project: True Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Id: default Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Name: Default Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Name: admin Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Role: admin,reader,member Aug 24 01:42:39.670755 n-d-854121-3 devstack@n-api.service[112754]: X-Roles: admin,reader,member Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant: admin Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Name: admin Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-User: admin Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Id: default Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Name: Default Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: X-User-Name: admin Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: method: > Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: exception: Flavor 42 could not be found. Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: action_args: {'id': '42'} Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:39.672314 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:39.673851 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.675277 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-6d41aadb-9311-4888-802b-633d182f5e08 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:39.676578 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-6d41aadb-9311-4888-802b-633d182f5e08 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.388633 Aug 24 01:42:39.676578 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 01:42:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:39.682416 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-b5889ca0-30af-4ab9-9df5-c3b13bf65aa0 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:39.705701 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-b5889ca0-30af-4ab9-9df5-c3b13bf65aa0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026927 Aug 24 01:42:39.706250 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:39.717098 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f59a3c15-236e-4806-b07f-cd05b675f551 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:39.741587 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f59a3c15-236e-4806-b07f-cd05b675f551 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027992 Aug 24 01:42:39.742060 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:42:39.751490 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-a00709e3-f84c-48ff-a14d-7cdc2d6f42e4 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:39.757137 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.wsgi [None req-a00709e3-f84c-48ff-a14d-7cdc2d6f42e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-a00709e3-f84c-48ff-a14d-7cdc2d6f42e4 admin admin] Request method failure captured: Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Accept: application/json Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Accept-Encoding: gzip, deflate Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Connection: keep-alive Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Content-Length: 0 Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Host: 10.222.0.49 Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: Openstack-System-Scope: None Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: User-Agent: python-novaclient Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Auth-Token: gAAAAABjBYIPQ3M4lUwDr31B0Q79Yj1I4UoLyd_eFutmD7yVw9F4ArBTQks71PcNiJKGiYSG58SM-RSfczGIA_zxaQWIVK9gCdx_VxmYjXITeW95hKSnwMBXuwezCXK8HAZJ5EOBxH_Qen_CS-GvdUfruGrpmMTBtYEJGR4BJJ_cqIggwnipiqk Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Id: None Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Name: None Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Identity-Status: Confirmed Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Is-Admin-Project: True Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Id: default Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Name: Default Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Name: admin Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Role: admin,reader,member Aug 24 01:42:39.760321 n-d-854121-3 devstack@n-api.service[112755]: X-Roles: admin,reader,member Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant: admin Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Name: admin Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-User: admin Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Id: default Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Name: Default Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: X-User-Name: admin Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: method: > Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: exception: Flavor 42 could not be found. Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: action_args: {'id': '42'} Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:39.761948 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:39.767968 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:39.769357 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-a00709e3-f84c-48ff-a14d-7cdc2d6f42e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:39.770569 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-a00709e3-f84c-48ff-a14d-7cdc2d6f42e4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013996 Aug 24 01:42:39.770569 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 01:42:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:40.719434 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f59a3c15-236e-4806-b07f-cd05b675f551 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:40.720453 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f59a3c15-236e-4806-b07f-cd05b675f551 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 01:42:40.720900 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:41.242083 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-66c72b82-4f67-450f-8410-c906decf6562 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:41.247499 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.wsgi [None req-66c72b82-4f67-450f-8410-c906decf6562 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-66c72b82-4f67-450f-8410-c906decf6562 admin admin] Request method failure captured: Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Accept: application/json Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Accept-Encoding: gzip, deflate Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Connection: keep-alive Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Content-Length: 0 Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Host: 10.222.0.49 Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: Openstack-System-Scope: None Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: User-Agent: python-novaclient Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Auth-Token: gAAAAABjBYIQhZU_NdGJnppk0av8be23KT5EMUtmiQksQA3hxhXoeDRUuHsGAPnjz6X_sOni862QgUbTK43xmtx_UWi2Z5NhVwz8dQ8NqHUNzc_PkgPCpwgxnnWGy7ZM4zitUpm8g_isC3leWMMjqJdpSxdK-eChV49wq3qsvLdzln3whgv7jzU Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Id: None Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Name: None Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Identity-Status: Confirmed Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Is-Admin-Project: True Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Id: default Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Name: Default Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Name: admin Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Role: admin,reader,member Aug 24 01:42:41.249032 n-d-854121-3 devstack@n-api.service[112755]: X-Roles: admin,reader,member Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant: admin Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Name: admin Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-User: admin Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Id: default Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Name: Default Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: X-User-Name: admin Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: method: > Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: exception: Flavor 84 could not be found. Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: action_args: {'id': '84'} Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:41.250638 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:41.251561 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.252662 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-66c72b82-4f67-450f-8410-c906decf6562 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:41.253753 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-66c72b82-4f67-450f-8410-c906decf6562 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391750 Aug 24 01:42:41.253753 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 01:42:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:41.259949 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-feb7415a-921a-4ead-abe3-a2b5043e5caa admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:41.275176 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-feb7415a-921a-4ead-abe3-a2b5043e5caa admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018793 Aug 24 01:42:41.275731 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:41.285409 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-2d6d4475-2388-4141-a435-8d88736377dc admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:41.301494 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-2d6d4475-2388-4141-a435-8d88736377dc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020046 Aug 24 01:42:41.302021 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:41.311308 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-fcbbab00-9b1e-4ee0-ba59-4f32b606ba41 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:41.316997 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.wsgi [None req-fcbbab00-9b1e-4ee0-ba59-4f32b606ba41 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-fcbbab00-9b1e-4ee0-ba59-4f32b606ba41 admin admin] Request method failure captured: Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Accept: application/json Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Accept-Encoding: gzip, deflate Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Connection: keep-alive Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Content-Length: 0 Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Host: 10.222.0.49 Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: Openstack-System-Scope: None Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: User-Agent: python-novaclient Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Auth-Token: gAAAAABjBYIQhZU_NdGJnppk0av8be23KT5EMUtmiQksQA3hxhXoeDRUuHsGAPnjz6X_sOni862QgUbTK43xmtx_UWi2Z5NhVwz8dQ8NqHUNzc_PkgPCpwgxnnWGy7ZM4zitUpm8g_isC3leWMMjqJdpSxdK-eChV49wq3qsvLdzln3whgv7jzU Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Id: None Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Name: None Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Identity-Status: Confirmed Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Is-Admin-Project: True Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Id: default Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Name: Default Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Name: admin Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Role: admin,reader,member Aug 24 01:42:41.318488 n-d-854121-3 devstack@n-api.service[112754]: X-Roles: admin,reader,member Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant: admin Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Name: admin Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-User: admin Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Id: default Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Name: Default Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: X-User-Name: admin Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: method: > Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: exception: Flavor 84 could not be found. Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: action_args: {'id': '84'} Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:41.320025 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:41.321042 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:41.322450 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-fcbbab00-9b1e-4ee0-ba59-4f32b606ba41 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:41.323605 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-fcbbab00-9b1e-4ee0-ba59-4f32b606ba41 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012107 Aug 24 01:42:41.323605 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 01:42:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:42.281559 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-2d6d4475-2388-4141-a435-8d88736377dc admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:42.282568 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-2d6d4475-2388-4141-a435-8d88736377dc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 01:42:42.282964 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:42.825619 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-525c114e-3d3d-4f55-82ed-5b8749d2d853 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:42.832526 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.wsgi [None req-525c114e-3d3d-4f55-82ed-5b8749d2d853 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-525c114e-3d3d-4f55-82ed-5b8749d2d853 admin admin] Request method failure captured: Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Accept: application/json Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Accept-Encoding: gzip, deflate Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Connection: keep-alive Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Content-Length: 0 Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Host: 10.222.0.49 Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: Openstack-System-Scope: None Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: User-Agent: python-novaclient Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Auth-Token: gAAAAABjBYISuqVwIDa37xwLMVVspLjkfWHbk8-0mqt0Pt2zKzGoFUXqejkXJAEW6UnvySZCDZ9szVH8ZHzPjQgCvHsAKI1OWRsXv89i6_AM_tsTpxgU-uiBRut7iCtlLY-8-qKQzGleYz2-cCdbaMP0JNW4N-zaRHOa6IcE90HXpt7lq0-_l2E Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Id: None Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Domain-Name: None Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Identity-Status: Confirmed Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Is-Admin-Project: True Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Id: default Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Domain-Name: Default Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Project-Name: admin Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Role: admin,reader,member Aug 24 01:42:42.834892 n-d-854121-3 devstack@n-api.service[112754]: X-Roles: admin,reader,member Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant: admin Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-Tenant-Name: admin Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-User: admin Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Id: default Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-User-Domain-Name: Default Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: X-User-Name: admin Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: method: > Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: exception: Flavor 451 could not be found. Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: action_args: {'id': '451'} Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:42.836517 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:42.837531 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.839164 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-525c114e-3d3d-4f55-82ed-5b8749d2d853 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112754) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:42.840421 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-525c114e-3d3d-4f55-82ed-5b8749d2d853 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416333 Aug 24 01:42:42.840421 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:42:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:42.848116 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-9b6adb50-28b5-4b67-b35a-65c41dd32c47 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:42.865019 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-9b6adb50-28b5-4b67-b35a-65c41dd32c47 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020565 Aug 24 01:42:42.865581 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:42.876028 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:42.895589 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023710 Aug 24 01:42:42.896141 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed Aug 24 01:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:42:42.905743 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ed6198c6-b4c7-4821-954f-3cf125d75736 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:42.911165 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.wsgi [None req-ed6198c6-b4c7-4821-954f-3cf125d75736 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ed6198c6-b4c7-4821-954f-3cf125d75736 admin admin] Request method failure captured: Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Accept: application/json Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Accept-Encoding: gzip, deflate Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Connection: keep-alive Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Content-Length: 0 Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Host: 10.222.0.49 Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Openstack-Api-Version: compute 2.90 Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: Openstack-System-Scope: None Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: User-Agent: python-novaclient Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Auth-Token: gAAAAABjBYISuqVwIDa37xwLMVVspLjkfWHbk8-0mqt0Pt2zKzGoFUXqejkXJAEW6UnvySZCDZ9szVH8ZHzPjQgCvHsAKI1OWRsXv89i6_AM_tsTpxgU-uiBRut7iCtlLY-8-qKQzGleYz2-cCdbaMP0JNW4N-zaRHOa6IcE90HXpt7lq0-_l2E Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Id: None Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Domain-Name: None Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Identity-Status: Confirmed Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Is-Admin-Project: True Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Id: default Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Domain-Name: Default Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Project-Name: admin Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Role: admin,reader,member Aug 24 01:42:42.912684 n-d-854121-3 devstack@n-api.service[112755]: X-Roles: admin,reader,member Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_46bdd2b705f1473f9f4882c6c569957e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant: admin Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Id: 46bdd2b705f1473f9f4882c6c569957e Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-Tenant-Name: admin Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-User: admin Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Id: default Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-User-Domain-Name: Default Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-User-Id: f5cdbc502e0543c6832e8a261bad71c2 Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: X-User-Name: admin Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: method: > Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: exception: Flavor 451 could not be found. Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: action_args: {'id': '451'} Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:42:42.914425 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:42.915666 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: ERROR nova.api.openstack.wsgi Aug 24 01:42:42.917644 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-ed6198c6-b4c7-4821-954f-3cf125d75736 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112755) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:42:42.918946 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-ed6198c6-b4c7-4821-954f-3cf125d75736 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012014 Aug 24 01:42:42.918946 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:42:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:42:43.881429 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:43.882435 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 01:42:43.882830 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:44.415410 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-e3314aeb-a526-4a87-b7f6-54068ee4cd8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:44.434622 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-e3314aeb-a526-4a87-b7f6-54068ee4cd8e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412725 Aug 24 01:42:44.435163 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 01:42:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:45.399502 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:45.400527 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 24 01:42:45.400951 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:45.919160 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-4754570b-c309-4298-8ac9-bdb85bd4384c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:45.937607 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-4754570b-c309-4298-8ac9-bdb85bd4384c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400246 Aug 24 01:42:45.938712 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 01:42:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:46.895678 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:46.896731 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 24 01:42:46.897131 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:47.423085 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-15806452-5e64-4845-8239-98767260215d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:47.442343 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-15806452-5e64-4845-8239-98767260215d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409285 Aug 24 01:42:47.442886 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 01:42:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:42:48.399510 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:48.400520 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 01:42:48.401106 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:48.916642 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-8f3f9a88-b704-4371-a205-62a50a46b42d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:42:48.935586 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-8f3f9a88-b704-4371-a205-62a50a46b42d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398195 Aug 24 01:42:48.936164 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed Aug 24 01:42:48 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:42:49.893237 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:49.894245 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 01:42:49.894639 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:42:50.410030 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-29029244-df86-457a-8250-5eb70992c5c1 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:42:50.430718 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-29029244-df86-457a-8250-5eb70992c5c1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.399749 Aug 24 01:42:50.431269 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 24 01:42:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:43:43.664208 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:43.665285 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-f31be90a-4f11-42ff-8180-3a7f99806afe admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 24 01:43:43.665721 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 931 bytes} [Wed Aug 24 01:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:43:43.676099 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:43:44.054511 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-28709dd0-5d23-497a-a92a-cc1b62d22edf admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:44.075344 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-28709dd0-5d23-497a-a92a-cc1b62d22edf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403700 Aug 24 01:43:44.075888 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 01:43:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:43:44.096321 n-d-854121-3 devstack@n-api.service[112754]: DEBUG dbcounter [-] [112754] Writing DB stats nova_api:SELECT=14 {{(pid=112754) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:43:44.100071 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-ed08b6d6-deaf-4c32-9a0e-f35017c0daea admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:44.107614 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-ed08b6d6-deaf-4c32-9a0e-f35017c0daea admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012697 Aug 24 01:43:44.108140 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 24 01:43:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:43:44.120057 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-bc6a4063-0432-4070-8985-750a13c587c8 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:44.128153 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-bc6a4063-0432-4070-8985-750a13c587c8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Aug 24 01:43:44.128664 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 24 01:43:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:43:44.139703 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:44.147222 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011043 Aug 24 01:43:44.147738 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1286 bytes} [Wed Aug 24 01:43:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:43:44.158626 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-2a095bd9-410c-474f-a99a-18cca6a06e13 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:43:44.165926 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-2a095bd9-410c-474f-a99a-18cca6a06e13 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010737 Aug 24 01:43:44.166431 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1283 bytes} [Wed Aug 24 01:43:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:49:10.248333 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:49:10.249375 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 24 01:49:10.249767 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:49:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:49:10.388701 n-d-854121-3 devstack@n-api.service[112755]: DEBUG dbcounter [-] [112755] Writing DB stats nova_api:SELECT=6 {{(pid=112755) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:49:10.527207 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:49:10.529588 n-d-854121-3 devstack@n-api.service[112755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:49:10.529588 n-d-854121-3 devstack@n-api.service[112755]: warnings.warn(msg) Aug 24 01:49:10.530706 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:49:10.531175 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:49:10.531594 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:49:10.532329 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:49:10.532793 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:49:10.533203 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:49:10.573990 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-9b63be6d-0f63-4b94-80c4-b4aca0ebe855 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.186671 Aug 24 01:49:10.574564 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:49:10 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:49:11.391241 n-d-854121-3 devstack@n-api.service[112754]: DEBUG nova.api.openstack.wsgi [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] Calling method '>' {{(pid=112754) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:49:11.392246 n-d-854121-3 devstack@n-api.service[112754]: INFO nova.api.openstack.requestlog [None req-3e2b0caf-6500-4fe1-814d-a1ba6b252ef6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 24 01:49:11.392648 n-d-854121-3 devstack@n-api.service[112754]: [pid: 112754|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed Aug 24 01:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:49:11.583639 n-d-854121-3 devstack@n-api.service[112755]: DEBUG nova.api.openstack.wsgi [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Calling method '>' {{(pid=112755) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:49:11.586069 n-d-854121-3 devstack@n-api.service[112755]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:49:11.586069 n-d-854121-3 devstack@n-api.service[112755]: warnings.warn(msg) Aug 24 01:49:11.587305 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:49:11.587780 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:49:11.588198 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:49:11.589450 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:49:11.589901 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:49:11.590315 n-d-854121-3 devstack@n-api.service[112755]: DEBUG oslo_concurrency.lockutils [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112755) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:49:11.612883 n-d-854121-3 devstack@n-api.service[112755]: INFO nova.api.openstack.requestlog [None req-f34a11a2-e6a9-4ffe-a882-35b090e6d1cb admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.081004 Aug 24 01:49:11.613428 n-d-854121-3 devstack@n-api.service[112755]: [pid: 112755|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:49:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:49:56.149657 n-d-854121-3 devstack@n-api.service[112753]: Wed Aug 24 01:49:56 2022 - graceful shutdown triggered... Aug 24 01:49:56.149774 n-d-854121-3 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 01:49:56.150759 n-d-854121-3 devstack@n-api.service[112754]: Gracefully killing worker 1 (pid: 112754)... Aug 24 01:49:56.151205 n-d-854121-3 devstack@n-api.service[112755]: Gracefully killing worker 2 (pid: 112755)... Aug 24 01:49:57.151567 n-d-854121-3 devstack@n-api.service[112753]: worker 1 buried after 1 seconds Aug 24 01:49:57.151997 n-d-854121-3 devstack@n-api.service[112753]: worker 2 buried after 1 seconds Aug 24 01:49:57.151997 n-d-854121-3 devstack@n-api.service[112753]: goodbye to uWSGI. Aug 24 01:49:57.153449 n-d-854121-3 systemd[1]: devstack@n-api.service: Succeeded. Aug 24 01:49:57.154051 n-d-854121-3 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 01:49:57.157299 n-d-854121-3 systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 01:49:57.170718 n-d-854121-3 devstack@n-api.service[128560]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 01:49:57.193644 n-d-854121-3 devstack@n-api.service[128560]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 01:49:57 2022] *** Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: nodename: n-d-854121-3 Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: machine: x86_64 Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: clock source: unix Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: pcre jit disabled Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: detected number of CPU cores: 4 Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: current working directory: / Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: detected binary path: /usr/bin/uwsgi-core Aug 24 01:49:57.194291 n-d-854121-3 devstack@n-api.service[128560]: your processes number limit is 47680 Aug 24 01:49:57.195130 n-d-854121-3 devstack@n-api.service[128560]: your memory page size is 4096 bytes Aug 24 01:49:57.195130 n-d-854121-3 devstack@n-api.service[128560]: detected max file descriptor number: 2048 Aug 24 01:49:57.195130 n-d-854121-3 devstack@n-api.service[128560]: lock engine: pthread robust mutexes Aug 24 01:49:57.195130 n-d-854121-3 devstack@n-api.service[128560]: thunder lock: enabled Aug 24 01:49:57.195130 n-d-854121-3 devstack@n-api.service[128560]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 01:49:57.195777 n-d-854121-3 devstack@n-api.service[128560]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 01:49:57.236012 n-d-854121-3 devstack@n-api.service[128560]: Python main interpreter initialized at 0x5561987689c0 Aug 24 01:49:57.236012 n-d-854121-3 devstack@n-api.service[128560]: python threads support enabled Aug 24 01:49:57.236012 n-d-854121-3 devstack@n-api.service[128560]: your server socket listen backlog is limited to 100 connections Aug 24 01:49:57.236012 n-d-854121-3 devstack@n-api.service[128560]: your mercy for graceful operations on workers is 90 seconds Aug 24 01:49:57.236466 n-d-854121-3 devstack@n-api.service[128560]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 01:49:57.236466 n-d-854121-3 devstack@n-api.service[128560]: *** Operational MODE: preforking *** Aug 24 01:49:57.236805 n-d-854121-3 devstack@n-api.service[128560]: *** uWSGI is running in multiple interpreter mode *** Aug 24 01:49:57.236805 n-d-854121-3 devstack@n-api.service[128560]: spawned uWSGI master process (pid: 128560) Aug 24 01:49:57.236982 n-d-854121-3 systemd[1]: Started Devstack devstack@n-api.service. Aug 24 01:49:57.237882 n-d-854121-3 devstack@n-api.service[128560]: spawned uWSGI worker 1 (pid: 128566, cores: 1) Aug 24 01:49:57.237882 n-d-854121-3 devstack@n-api.service[128560]: spawned uWSGI worker 2 (pid: 128567, cores: 1) Aug 24 01:49:57.238072 n-d-854121-3 devstack@n-api.service[128560]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 01:49:57.902901 n-d-854121-3 devstack@n-api.service[128567]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 01:49:57.909486 n-d-854121-3 devstack@n-api.service[128566]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 01:49:59.061365 n-d-854121-3 devstack@n-api.service[128567]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:49:59.061365 n-d-854121-3 devstack@n-api.service[128567]: from cryptography.utils import int_from_bytes Aug 24 01:49:59.062001 n-d-854121-3 devstack@n-api.service[128567]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:49:59.062001 n-d-854121-3 devstack@n-api.service[128567]: from cryptography.utils import int_from_bytes Aug 24 01:49:59.077081 n-d-854121-3 devstack@n-api.service[128566]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:49:59.077081 n-d-854121-3 devstack@n-api.service[128566]: from cryptography.utils import int_from_bytes Aug 24 01:49:59.077602 n-d-854121-3 devstack@n-api.service[128566]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 01:49:59.077602 n-d-854121-3 devstack@n-api.service[128566]: from cryptography.utils import int_from_bytes Aug 24 01:50:01.464258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 01:50:01.464258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 01:50:01.464258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 01:50:01.464978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 01:50:01.464978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 01:50:01.465303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.465586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.465910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.466234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.466726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.467040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.467368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.467969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.468081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.468266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.468589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.468943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.469267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.469578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.469891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.470212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.470529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.470842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.471148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.471654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.472328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.472677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.473195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.473459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.473747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.474068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.474406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.474701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.475029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.475342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.475753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.476087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.476393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.476800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.477148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.477474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.477788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.478115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.478398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.478707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.479030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.479348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.479666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.479985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.480287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.480622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.480931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.481252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.481560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.481865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.482117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.482425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.482746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.483068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.483386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.483639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.483890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.484213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.484532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.484869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.485178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.485485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.485793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.486100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.486410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.486717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.487027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.487357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.487660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.487982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.488322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.488643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.489079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.489331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.489640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.489986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.490304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.490613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.490933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.491254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.491561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.491870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.492180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.492573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.492875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.493183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.493436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.493741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.494056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.494380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.494689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.494997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.495305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.495605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.495911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.496216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.496523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.496853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.497163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.497467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.497774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.498078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.498382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.498703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.499025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.499335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.499645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.499953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.500260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.500580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.500915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.501226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.501548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.501856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.502161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.502479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.502789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.503097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.503415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.504256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.504570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.504913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.505224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.505529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.505830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.506136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.506440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.506744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.507046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.507351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.507649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.507966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.508286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.508597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.508929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.509234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.509552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.509890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.510220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.510563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.510876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.511209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.511541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.511859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.512173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.512487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.512835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.513149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.513459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.513769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.514089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.514415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.514743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.515059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.515375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.515694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.516005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.516324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.516651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.517010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.517320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.517659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.518000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.518312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.518637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.518965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.519278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.520258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.520572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.520921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.521261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.521528 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 01:50:01.522021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.522177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 01:50:01.522323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.522323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.522609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 01:50:01.522753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.522896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 01:50:01.523040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.523184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 01:50:01.523341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.523497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.523652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.523805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.523956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.524114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.524266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.524417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.524562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.524746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.524899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.525055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.525200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.525344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.525494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.525649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.525807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.525966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.526118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.526268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.526413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.526564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.526720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.526864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.527009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.527161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.527317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.527478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.527718 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.527870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.528016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.528166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.528319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.528472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.528631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.528821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.528979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.529132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.529277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.529434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.529434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.529729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.529892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.530048 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.530192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.530349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.530502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.530655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.530807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.530959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.531113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.531282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.531427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.531571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.531714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.531858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.532010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.532168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.532313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.532456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.532606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.532779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.532939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.533089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.533251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.533407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.533559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.533716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.533871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.534021 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.534165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.534316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.534467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.534630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.534781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.534955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.535124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.535275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.535434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.535585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.535730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.535880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.536026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.536169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.536326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.536472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.536615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.536785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.536935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.537090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.537317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.537471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.537616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.537853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.538012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.538156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.538309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.538456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.538600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.538752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.538897 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.539055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.539222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.539374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.539527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.539672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.539816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.539973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.540118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.540262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.540413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.540558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.540701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.540910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.541080 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.541234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.541386 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.541538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.541697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.541849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.542001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.542153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.542297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.542440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.542593 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.542738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.542898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.543057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.543215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.543367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.543516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.543673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.543826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.543826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.544114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.544264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.544415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.544569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.544732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.544894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.545049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.545049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.545344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.545488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.545638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.545791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.545935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.546079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.546231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.546375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.546525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.546678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.546841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.546986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.547143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.547311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.547481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.547626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.547771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.547999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.548169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.548315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.548459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.548609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.548807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.548970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.549125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.549276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.549421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.549564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.549707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.550411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.550590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.550750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.550898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.551053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.551205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.551380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.551535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.551680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.551833 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.551978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.552123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.552286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.552432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.552576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.552745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.552896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.553052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.553207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.553363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.553512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.553657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.553807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.553962 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.554113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.554266 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.554411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.554555 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.554705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.554858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.555003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.555153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.555316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.555468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.555468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.555764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.555910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.556063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.556063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.556347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.556491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.556648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.556847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.556992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.557135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.557299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.557445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.557598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.557750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.557902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.557902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.558286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.558434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.558585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.558730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.558883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.559036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.559192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.559344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.559489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.559640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.559793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.559946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.560090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.560233 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.560383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.560529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.560689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.560858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.561001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.561173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.561318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.562055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.562227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.562374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.562526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.562672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.562826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.563028 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.563177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.563321 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.563477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.563624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.563791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.564017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.564172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.564325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.564484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.564637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.564815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.564980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.565125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.565276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.565421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.565565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.565717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.565887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.566032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.566698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.566851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.567003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.567147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.567301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.567457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.567602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 01:50:01.567773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.567925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.568963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.569866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.570025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.570185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.570595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.570763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.570910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.571975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.572945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573823 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.573968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574733 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.574883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.575908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.576058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.576058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.576382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.576542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.576701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.577848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.578888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.579850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580310 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.580989 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.581149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.581300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.581460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.581631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.581814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.582496 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.582650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.582807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.582966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.583902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.584916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585546 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.585868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.586794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.587873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588766 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.588927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.589851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.590964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.591889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.592866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.593957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.594984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.595937 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596570 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.596916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.597892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.598940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.599873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600190 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.600885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.601986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.602926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.603868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.604857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.605972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606757 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.606907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.607852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.608819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609695 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.609855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610784 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.610956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.611887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.612599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.612780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.612953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.613639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.613805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.613978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.614932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.615863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.616842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.617963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618438 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.618907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.619294 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.619294 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.619610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.619772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.619923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620080 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.620946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.621906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.622857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.623945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.624942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.625878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626190 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.626990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.627975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.628139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.628297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.628456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.628647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.629452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.629620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.629781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.629933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.630865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.631969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.632920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.633870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.634975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.635127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.635296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.635296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.635618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.635901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.636968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.637957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.640312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.641298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.641460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.641624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.641778 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.641931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642091 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.642904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.643056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.643217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.643380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.643541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.643694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.644426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.644605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.644789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.644949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.645895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.646995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.647943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.648971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.649907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.650976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.651959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.652945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.653253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.653405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.653556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.653708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.653869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654820 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.654991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.655785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.656932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.657885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.658838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.659990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.660977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.661915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.662883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.663889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.664890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.665938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666091 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.666980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.667920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.668972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.669916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670238 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.670880 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.671938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.672923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673402 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.673879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674991 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.674991 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.675300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.675501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.676174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.676329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.676489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.676651 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.676861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.677969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.678888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.679859 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.680975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681160 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.681864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682328 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.682958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.683180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.683408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.683568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.683727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.683879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.684866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685028 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685659 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.685967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.686762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687719 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.687885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.688855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.689969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.690925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.691085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.691302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.692960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.693928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.694907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.695128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.695284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.695698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.695854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.696886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.697942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.698952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699834 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.699921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.700958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.701940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.702987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.703988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.704933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705238 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.705883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706774 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.706951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.707956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.708992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.709908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.710978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.711937 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712293 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.712669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713880 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.713966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.714934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.715980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.716136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.716222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.716314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.716990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.717966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.718941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.719923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.720077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.720232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.744970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128567) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.745907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.746857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.747594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.748584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.749888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.750085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.750427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.751884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.754529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.754732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.755445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.755445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.757849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.757849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.757849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.757849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.758686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.762427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.762427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.762427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.765071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.765071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.765071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.765818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.765818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.766146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.767036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.767394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.767732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.768195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.768598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.769108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.769474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.769809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.770134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.770468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.770815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.771143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.771465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.771908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.772236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.772565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.772928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.773251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.773586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.773920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.774243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.774574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.774943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.775281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.775632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.775969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.776303 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.776665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.777006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.777317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.777634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.777961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.778279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.778595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.778908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.779225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.779538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.779849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.780162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.780472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.780902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.781221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.781532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.781839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.782148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.782455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.782764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.783078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.783387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.783696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.784005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.784315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.784623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.785048 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.785497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.785754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.786085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.786581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.786891 n-d-854121-3 devstack@n-api.service[128567]: INFO dbcounter [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Registered counter for database nova_api Aug 24 01:50:01.786998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.787064 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.787398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.787723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.788046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.788364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.788853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.789062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.789387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.789709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.790028 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.790346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.791103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.792831 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.793363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.793717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.794085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.794445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.794799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.795363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.795781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.796209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.796622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.797055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.797463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.798001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.798414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.798825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.799232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.799634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.800046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.800450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.801446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.801866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.802265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.802680 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.803096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.803554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.803957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 01:50:01.807036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128566) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 01:50:01.811987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_db.sqlalchemy.engines [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.819988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writer thread running {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:01.870768 n-d-854121-3 devstack@n-api.service[128566]: INFO dbcounter [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Registered counter for database nova_api Aug 24 01:50:01.876848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.context [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128567) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 01:50:01.881670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:01.882245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:01.883904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:01.884695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:01.885177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:01.887230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:01.889250 n-d-854121-3 devstack@n-api.service[128567]: INFO dbcounter [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Registered counter for database nova_cell0 Aug 24 01:50:01.893125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.893518 n-d-854121-3 devstack@n-api.service[128567]: INFO dbcounter [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Registered counter for database nova_cell1 Aug 24 01:50:01.901412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_db.sqlalchemy.engines [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.903690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_db.sqlalchemy.engines [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.906599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writer thread running {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:01.911264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writer thread running {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:01.964936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.context [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128566) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 01:50:01.969041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:01.969460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:01.971074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:01.971922 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:01.972361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:01.975035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:01.977074 n-d-854121-3 devstack@n-api.service[128566]: INFO dbcounter [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Registered counter for database nova_cell0 Aug 24 01:50:01.981193 n-d-854121-3 devstack@n-api.service[128566]: INFO dbcounter [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Registered counter for database nova_cell1 Aug 24 01:50:01.988680 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.991222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:01.998079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writer thread running {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:02.000120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writer thread running {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:02.052365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writer thread running {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:02.062726 n-d-854121-3 devstack@n-api.service[128567]: INFO dbcounter [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Registered counter for database nova_cell0 Aug 24 01:50:02.069828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_db.sqlalchemy.engines [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128567) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:02.074588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writer thread running {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:02.146035 n-d-854121-3 devstack@n-api.service[128566]: INFO dbcounter [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Registered counter for database nova_cell0 Aug 24 01:50:02.156669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_db.sqlalchemy.engines [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128566) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 01:50:02.161292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writer thread running {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 01:50:02.394787 n-d-854121-3 devstack@n-api.service[128567]: WARNING keystonemiddleware.auth_token [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:50:02.402028 n-d-854121-3 devstack@n-api.service[128567]: WARNING keystonemiddleware.auth_token [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:50:02.476432 n-d-854121-3 devstack@n-api.service[128566]: WARNING keystonemiddleware.auth_token [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:50:02.483601 n-d-854121-3 devstack@n-api.service[128566]: WARNING keystonemiddleware.auth_token [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:50:02.740485 n-d-854121-3 devstack@n-api.service[128567]: WARNING keystonemiddleware.auth_token [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:50:02.746903 n-d-854121-3 devstack@n-api.service[128567]: WARNING keystonemiddleware.auth_token [None req-6c98a8e1-42fe-41d1-8e34-f4b1836f6243 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:50:02.752315 n-d-854121-3 devstack@n-api.service[128567]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561987689c0 pid: 128567 (default app) Aug 24 01:50:02.819575 n-d-854121-3 devstack@n-api.service[128566]: WARNING keystonemiddleware.auth_token [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 01:50:02.825812 n-d-854121-3 devstack@n-api.service[128566]: WARNING keystonemiddleware.auth_token [None req-2ebb4597-fc62-4e57-a198-623d0fa1ce4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 01:50:02.831139 n-d-854121-3 devstack@n-api.service[128566]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561987689c0 pid: 128566 (default app) Aug 24 01:50:41.316958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.321449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.321449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.321449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.891921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.893802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.893977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:41.894717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:42.486275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Calling method '.version_select at 0x7f6b98ccb790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:42.498477 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:42.498477 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:42.504745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128567) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 01:50:42.505525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:42.505961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:42.506389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:42.536002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:42.536508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:42.536970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:42.551581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:42.552057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:42.552482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:42.558677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28f6dbc8-55ef-4ee2-aafb-c71b61774b5c tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.252758 Aug 24 01:50:42.559258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1208 bytes} [Wed Aug 24 01:50:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:50:42.885680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:42.887407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:42.888016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:42.888590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:42.889506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:42.890150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:42.890721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:42.937148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5162b0f-02b1-4ea7-8f37-b92c845d707d tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.376518 Aug 24 01:50:42.938126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2/2] 10.222.0.49 () {58 vars in 1164 bytes} [Wed Aug 24 01:50:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:42.945086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fe461e0-2de7-49e8-9a3c-1bcfde380cc4 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1266597724"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:42.975397 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:42.975397 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:42.976693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-3fe461e0-2de7-49e8-9a3c-1bcfde380cc4 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Generated uuid 22da97d1-2233-4c58-89eb-ac9590eea5eb for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:43.058811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fe461e0-2de7-49e8-9a3c-1bcfde380cc4 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.119241 Aug 24 01:50:43.059897 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3/3] 10.222.0.49 () {62 vars in 1205 bytes} [Wed Aug 24 01:50:42 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:50:43.064526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:43.065495 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.065495 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:43.068536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:43.069157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:43.069694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:43.070932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:43.071479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:43.072140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:43.097679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de8dac78-5ef3-4e22-bdb8-09bcebd8f49a tempest-AZAdminV2TestJSON-991298368 tempest-AZAdminV2TestJSON-991298368-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.036534 Aug 24 01:50:43.098971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:50:43 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:43.103634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6387007e-0ff6-4999-9925-57a0e96d1489 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-251262431"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.107500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64218fbd-da51-4af6-9aa8-ed56c3ca6cee tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-688282657", "id": 1869407787, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.127349 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.127349 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:43.172178 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64218fbd-da51-4af6-9aa8-ed56c3ca6cee tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 1.289141 Aug 24 01:50:43.182357 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 1/5] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:50:41 2022] POST /compute/v2.1/flavors => generated 470 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:50:43.182545 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.182545 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:43.188276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-062160eb-bc92-4515-96e9-845eb4fd9d6b tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.191998 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.191998 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:43.230732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6387007e-0ff6-4999-9925-57a0e96d1489 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.130525 Aug 24 01:50:43.232364 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5/6] 10.222.0.49 () {62 vars in 1210 bytes} [Wed Aug 24 01:50:43 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:50:43.246694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a47db421-4037-4f15-acd9-53f601e61022 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:43.248072 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.248072 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:43.256658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a47db421-4037-4f15-acd9-53f601e61022 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.015629 Aug 24 01:50:43.257244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6/7] 10.222.0.49 () {60 vars in 1190 bytes} [Wed Aug 24 01:50:43 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:50:43.270103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3975958f-1008-42d1-bff7-e78274aadac1 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.273864 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.273864 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:43.284361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3975958f-1008-42d1-bff7-e78274aadac1 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:43.284957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3975958f-1008-42d1-bff7-e78274aadac1 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:43.285389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3975958f-1008-42d1-bff7-e78274aadac1 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:43.403329 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-062160eb-bc92-4515-96e9-845eb4fd9d6b tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1869407787/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.219280 Aug 24 01:50:43.404347 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 2/8] 10.222.0.49 () {62 vars in 1265 bytes} [Wed Aug 24 01:50:43 2022] POST /compute/v2.1/flavors/1869407787/os-extra_specs => generated 62 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:43.720746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9bc6a8db-8838-4675-885a-7d855e988d98 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-262437644", "id": 1775219753, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.740479 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9bc6a8db-8838-4675-885a-7d855e988d98 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.334556 Aug 24 01:50:43.741488 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 3/9] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:43 2022] POST /compute/v2.1/flavors => generated 429 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:43.906885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-05611b09-411d-4207-bff2-dfb934d8ea4b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-648985330", "id": 1282285972, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:43.926613 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-05611b09-411d-4207-bff2-dfb934d8ea4b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.183872 Aug 24 01:50:43.927197 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 4/10] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:43 2022] POST /compute/v2.1/flavors => generated 430 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:43.932081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e9c3b219-9452-422e-ac72-d7d7fd00fe81 tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:43.932994 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:43.932994 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:43.963222 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e9c3b219-9452-422e-ac72-d7d7fd00fe81 tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1869407787" status: 202 len: 0 microversion: 2.86 time: 0.034484 Aug 24 01:50:43.964118 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 5/11] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 24 01:50:43 2022] DELETE /compute/v2.1/flavors/1869407787 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:50:44.031566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3975958f-1008-42d1-bff7-e78274aadac1 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.765420 Aug 24 01:50:44.032485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 7/12] 10.222.0.49 () {62 vars in 1232 bytes} [Wed Aug 24 01:50:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:50:44.085398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '.version_select at 0x7f6b98a979d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:44.086240 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:44.086240 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:44.092654 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128566) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 24 01:50:44.093428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.093906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.094334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.095522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:44.098843 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:44.098843 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:44.100055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.100543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.101366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.102102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.102551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.103026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.122322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.123464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.124052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.127705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8e7f27b-6e6e-4445-bbe9-f217125746d7 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093901 Aug 24 01:50:44.128294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:50:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:44.146976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.147623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.148197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.154951 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64ec504d-5862-435f-b01a-dae88f539be4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.189576 Aug 24 01:50:44.155677 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 6/14] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:50:43 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:44.161908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-613da1ec-5d00-4a6e-94c8-56c931c87a7b tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:44.162661 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:44.162661 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:44.182578 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-613da1ec-5d00-4a6e-94c8-56c931c87a7b tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1775219753" status: 202 len: 0 microversion: 2.1 time: 0.024819 Aug 24 01:50:44.184046 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:50:44 2022] DELETE /compute/v2.1/flavors/1775219753 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:44.191047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d2dc192c-6b76-4f7d-aa3b-a1a75b143d6b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b59169d32d0641c1b4b0f185ad888c48"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:44.193670 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:44.193670 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:44.201068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-259779538", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:44.277356 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d2dc192c-6b76-4f7d-aa3b-a1a75b143d6b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1282285972/action" status: 200 len: 97 microversion: 2.1 time: 0.091491 Aug 24 01:50:44.278192 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 8/16] 10.222.0.49 () {60 vars in 1200 bytes} [Wed Aug 24 01:50:44 2022] POST /compute/v2.1/flavors/1282285972/action => generated 97 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:44.282584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bacd6dcc-9c73-4528-9952-e47b2fb23d36 tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:44.314070 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bacd6dcc-9c73-4528-9952-e47b2fb23d36 tempest-FlavorMetadataValidation-1235698339 tempest-FlavorMetadataValidation-1235698339-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.034297 Aug 24 01:50:44.314627 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 9/17] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:50:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:50:44.319185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6e0f754e-2393-4794-938f-b69257cf7359 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:44.322403 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:44.322403 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:44.365278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e0f754e-2393-4794-938f-b69257cf7359 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:44.366093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e0f754e-2393-4794-938f-b69257cf7359 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:44.366802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e0f754e-2393-4794-938f-b69257cf7359 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:44.607513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:50:45.016217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:50:45.016638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:50:45.017133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:50:45.017536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:50:45.017971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:50:45.037898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:45.038533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:45.038795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:45.039694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:45.040149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:45.040575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:45.071060 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6e0f754e-2393-4794-938f-b69257cf7359 tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.754909 Aug 24 01:50:45.072468 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 10/18] 10.222.0.49 () {62 vars in 1232 bytes} [Wed Aug 24 01:50:44 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:50:45.074236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Getting quotas for project 917b0d2fd2ae4f40a9d9300765789560. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:50:45.077525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1db53608-dc23-44c8-83a4-3a53b44e6b0d tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.087274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Getting quotas for user 53c8133445dc4eff9daf264eb5c20591 and project 917b0d2fd2ae4f40a9d9300765789560. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:50:45.098187 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1db53608-dc23-44c8-83a4-3a53b44e6b0d tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024335 Aug 24 01:50:45.099031 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:45.115503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:50:45.118802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:50:45.180126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d22c2a5-de75-486c-95b0-75884a62045a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050512 Aug 24 01:50:45.181287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 9/20] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:50:45.186486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c8d8ade-8f91-47e3-ac7b-0f6fa477852b tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.187662 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.187662 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.242421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c8d8ade-8f91-47e3-ac7b-0f6fa477852b tempest-AggregatesAdminTestV241-945644140 tempest-AggregatesAdminTestV241-945644140-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.058725 Aug 24 01:50:45.243612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 10/21] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:50:45 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:45.251396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ab50060-a5cc-48b8-a079-bbf3f41f1bff tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-133234032", "id": 718964708, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.255643 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.255643 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.293252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ab50060-a5cc-48b8-a079-bbf3f41f1bff tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.048469 Aug 24 01:50:45.294417 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 11/22] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/flavors => generated 413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:45.299496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84a02e7e-8e35-4455-866d-1451d9a3879b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.300255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84a02e7e-8e35-4455-866d-1451d9a3879b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:45.387003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a263d779-2a9c-4736-b2ff-7ceed9390d15 tempest-FlavorsAccessTestJSON-484265270 tempest-FlavorsAccessTestJSON-484265270-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.421805 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a263d779-2a9c-4736-b2ff-7ceed9390d15 tempest-FlavorsAccessTestJSON-484265270 tempest-FlavorsAccessTestJSON-484265270-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.321701 Aug 24 01:50:45.422659 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 12/23] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:45 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:45.427381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1176c39e-7816-479c-ae6b-0f6232bba90e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496452370"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.430271 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.430271 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:45.431175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-1176c39e-7816-479c-ae6b-0f6232bba90e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid e58eaba2-92b8-4a1b-822a-e51bf5b53ecf for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:45.440265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84a02e7e-8e35-4455-866d-1451d9a3879b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:45.464845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84a02e7e-8e35-4455-866d-1451d9a3879b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1219 microversion: 2.1 time: 0.167199 Aug 24 01:50:45.465765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:45 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:45.471675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-247f8d51-6524-4099-8cca-5473bb107ee3 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.490074 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1176c39e-7816-479c-ae6b-0f6232bba90e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065968 Aug 24 01:50:45.491957 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 13/25] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:45.505474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea787dbf-6ef6-422f-ad37-780efd6d53b1 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b59169d32d0641c1b4b0f185ad888c48"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.508683 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.508683 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:45.533221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-247f8d51-6524-4099-8cca-5473bb107ee3 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.066114 Aug 24 01:50:45.537156 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 13/26] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:45 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:45.542361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af04fbb9-e3b4-4e03-9eaf-287626526d62 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.544796 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.544796 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.562988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af04fbb9-e3b4-4e03-9eaf-287626526d62 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:45.564335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af04fbb9-e3b4-4e03-9eaf-287626526d62 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:45.565804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af04fbb9-e3b4-4e03-9eaf-287626526d62 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:45.729036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af04fbb9-e3b4-4e03-9eaf-287626526d62 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.190172 Aug 24 01:50:45.729653 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 14/27] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:45.741665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0accecfa-4ad6-41fb-bb86-ebff0d3d69f8 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.742476 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.742476 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.774740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0accecfa-4ad6-41fb-bb86-ebff0d3d69f8 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/718964708" status: 202 len: 0 microversion: 2.1 time: 0.038968 Aug 24 01:50:45.775357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:45 2022] DELETE /compute/v2.1/flavors/718964708 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:45.781119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.785330 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.785330 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.794544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:45.795080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:45.796023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:45.829331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h1-854121-3. Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 39 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:50:45.849593 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: {"add_host": {"host": "n-h1-854121-3"}} Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:45.851020 n-d-854121-3 devstack@n-api.service[128567]: exception: Aggregate 2 already has host n-h1-854121-3. Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-854121-3'}}} Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:50:45.851771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854121-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 01:50:45.852834 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 01:50:45.853991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:50:45.855022 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854121-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 1, 50, 45, 815412), 'updated_at': None, 'host': 'n-h1-854121-3', 'aggregate_id': 2}] Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:45.856009 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h1-854121-3. Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.857739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h1-854121-3. Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:45.858838 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:45.859960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h1-854121-3. Aug 24 01:50:45.859960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:45.863006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 409 to user: Aggregate 2 already has host n-h1-854121-3. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:45.863006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1eb7687-d4d1-4826-afca-a2b403828ae9 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.085128 Aug 24 01:50:45.863516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 16/29] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 24 01:50:45.870503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf97d9a8-c259-4b1a-99a2-a0131bb6d4e2 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:45.895275 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf97d9a8-c259-4b1a-99a2-a0131bb6d4e2 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030503 Aug 24 01:50:45.895856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 17/30] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:45.908879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c445b0e1-bd2f-4abe-a622-1a52a8c01b60 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:45.911296 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:45.911296 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:45.923101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c445b0e1-bd2f-4abe-a622-1a52a8c01b60 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:45.923649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c445b0e1-bd2f-4abe-a622-1a52a8c01b60 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:45.924616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c445b0e1-bd2f-4abe-a622-1a52a8c01b60 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:46.056381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c445b0e1-bd2f-4abe-a622-1a52a8c01b60 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.159423 Aug 24 01:50:46.057224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 18/31] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.062332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6235bc6-582b-4f54-bf30-91e7148109a4 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-818777819", "id": 228766343, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.066104 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.066104 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.072797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:46.088300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6235bc6-582b-4f54-bf30-91e7148109a4 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.029919 Aug 24 01:50:46.089502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 19/32] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/flavors => generated 425 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.094142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a29ad191-abe1-48be-a333-79a6c04c8d03 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.095703 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.095703 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.118843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a29ad191-abe1-48be-a333-79a6c04c8d03 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.028079 Aug 24 01:50:46.119481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 20/33] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:46 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:46.126047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46a43c71-e32b-4f19-a59e-dd3d62661b18 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.127819 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.127819 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.151905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46a43c71-e32b-4f19-a59e-dd3d62661b18 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/228766343" status: 202 len: 0 microversion: 2.1 time: 0.030272 Aug 24 01:50:46.156625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 21/34] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:46 2022] DELETE /compute/v2.1/flavors/228766343 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:46.162921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75121388-6d58-4bca-b54f-3501ccb4cce6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-621792343"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.165309 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.165309 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.167408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-75121388-6d58-4bca-b54f-3501ccb4cce6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid 92fc248d-cb1d-4f30-ab34-634f21fec6d1 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:46.198686 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ea787dbf-6ef6-422f-ad37-780efd6d53b1 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1282285972/action" status: 200 len: 21 microversion: 2.1 time: 0.704838 Aug 24 01:50:46.199905 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 14/35] 10.222.0.49 () {60 vars in 1200 bytes} [Wed Aug 24 01:50:45 2022] POST /compute/v2.1/flavors/1282285972/action => generated 21 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:46.201309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75121388-6d58-4bca-b54f-3501ccb4cce6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.040558 Aug 24 01:50:46.206446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7521777e-9ab7-4697-b6c1-a9534a4be7c5 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.209772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 22/36] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.217179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26f31e5b-5291-418a-81fc-f6f40f3336a2 tempest-FlavorsAccessTestJSON-484265270 tempest-FlavorsAccessTestJSON-484265270-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.249079 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7521777e-9ab7-4697-b6c1-a9534a4be7c5 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047635 Aug 24 01:50:46.250185 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 15/37] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:46.271386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26f31e5b-5291-418a-81fc-f6f40f3336a2 tempest-FlavorsAccessTestJSON-484265270 tempest-FlavorsAccessTestJSON-484265270-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059841 Aug 24 01:50:46.272558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 23/38] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:46.277487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78b93070-2425-4386-aa8c-20627d2a0d4a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1130393628", "name": "tempest-test_aggregate-929708013"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.298136 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.298136 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.300097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-78b93070-2425-4386-aa8c-20627d2a0d4a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 9ecfd1d8-c007-435d-8adf-02e8d9277138 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:46.341654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78b93070-2425-4386-aa8c-20627d2a0d4a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.067094 Aug 24 01:50:46.349161 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 24/39] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.356813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9142c7a-50b6-477f-bcf1-42c82a5e2b72 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1260518823", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.360329 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.360329 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.395369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9142c7a-50b6-477f-bcf1-42c82a5e2b72 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.047291 Aug 24 01:50:46.396193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 25/40] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.401946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fd5b42f-a5a8-46d6-99d9-3732a62f9c7a tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.403248 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.403248 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.426960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fd5b42f-a5a8-46d6-99d9-3732a62f9c7a tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1282285972" status: 202 len: 0 microversion: 2.1 time: 0.029392 Aug 24 01:50:46.427907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 26/41] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:50:46 2022] DELETE /compute/v2.1/flavors/1282285972 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:46.436758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1171c71-1252-4411-8bf2-6580bf211457 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.438618 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.438618 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.475893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1171c71-1252-4411-8bf2-6580bf211457 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.046912 Aug 24 01:50:46.476481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 27/42] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.494618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bca58974-8941-476d-a92f-aaf1365cdd48 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.495492 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.495492 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.528501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bca58974-8941-476d-a92f-aaf1365cdd48 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/13f2a031-8852-448a-9e46-838226617e6c" status: 202 len: 0 microversion: 2.1 time: 0.046005 Aug 24 01:50:46.534080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 28/43] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:50:46 2022] DELETE /compute/v2.1/flavors/13f2a031-8852-448a-9e46-838226617e6c => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:46.540895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e0c4a51-8748-4058-8f2a-43a180853238 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.577032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e0c4a51-8748-4058-8f2a-43a180853238 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041605 Aug 24 01:50:46.587198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 29/44] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:46.608617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.610630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:46.617706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:46.618483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:46.619162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:46.620186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:46.620979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:46.621665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:46.800008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bca5d3c7-01dc-426f-ad4b-761b2d37a212 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.803083 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.803083 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:46.803986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bca5d3c7-01dc-426f-ad4b-761b2d37a212 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bca5d3c7-01dc-426f-ad4b-761b2d37a212 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 39 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:50:46.817229 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: {"add_host": {"host": "n-h1-854121-3"}} Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:46.818359 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h1-854121-3'}}} Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:46.819025 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 24 01:50:46.820011 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:46.822479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bca5d3c7-01dc-426f-ad4b-761b2d37a212 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:46.822479 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bca5d3c7-01dc-426f-ad4b-761b2d37a212 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.567422 Aug 24 01:50:46.822479 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 16/45] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 568 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:46.838805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-777345a4-aa90-4554-b639-f509a83e9186 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.844529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:46.860313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-601fa00b-7b97-4bb8-97cb-3efda126cd75 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1223 microversion: 2.1 time: 0.258187 Aug 24 01:50:46.862997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 30/46] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1223 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:46.870003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65ff8e0d-ff83-41aa-8373-3e5cb66e1719 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.878360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-777345a4-aa90-4554-b639-f509a83e9186 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:46.878864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-777345a4-aa90-4554-b639-f509a83e9186 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:46.879306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-777345a4-aa90-4554-b639-f509a83e9186 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:46.899627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65ff8e0d-ff83-41aa-8373-3e5cb66e1719 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032990 Aug 24 01:50:46.913976 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 31/47] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:46.920231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d79c1707-30ac-4c7e-9665-1029013ffbe6 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1536238325", "id": 1693871387, "os-flavor-access:is_public": "False"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:46.923251 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.923251 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:46.944346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d79c1707-30ac-4c7e-9665-1029013ffbe6 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.030099 Aug 24 01:50:46.945997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 32/48] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/flavors => generated 431 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:46.952047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10969f6b-8525-41cb-88f5-7fe9368e89e6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:46.956554 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:46.956554 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.008999 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10969f6b-8525-41cb-88f5-7fe9368e89e6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.060258 Aug 24 01:50:47.010268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 33/49] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:46 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:47.019030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9cec76e-17f3-4727-9d5c-eb2800fa120a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1313594202", "id": "36aec10b-34c8-4217-b114-bb08bef1f112", "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.023215 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.023215 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.055013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9cec76e-17f3-4727-9d5c-eb2800fa120a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043158 Aug 24 01:50:47.062885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 34/50] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/flavors => generated 507 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:47.068139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52a4304e-655c-4f69-b06f-aa9cb7be9b9b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.069136 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.069136 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.100232 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52a4304e-655c-4f69-b06f-aa9cb7be9b9b tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1693871387/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.036170 Aug 24 01:50:47.101627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 35/51] 10.222.0.49 () {58 vars in 1209 bytes} [Wed Aug 24 01:50:47 2022] GET /compute/v2.1/flavors/1693871387/os-flavor-access => generated 21 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:47.107420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-226e1698-86cb-4570-b86d-c89d1e6ac387 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1466342540"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.111350 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.111350 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.112571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-226e1698-86cb-4570-b86d-c89d1e6ac387 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid 909f40d3-f5f1-42b3-b55f-fc3323055752 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:47.143841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-226e1698-86cb-4570-b86d-c89d1e6ac387 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040953 Aug 24 01:50:47.145960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 36/52] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:47.151240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44a55d39-dd7a-471e-9faf-9272db0d7938 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.152510 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.152510 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.178798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44a55d39-dd7a-471e-9faf-9272db0d7938 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/36aec10b-34c8-4217-b114-bb08bef1f112" status: 202 len: 0 microversion: 2.1 time: 0.031384 Aug 24 01:50:47.179921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 37/53] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:50:47 2022] DELETE /compute/v2.1/flavors/36aec10b-34c8-4217-b114-bb08bef1f112 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:47.182182 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-777345a4-aa90-4554-b639-f509a83e9186 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 314 microversion: 2.1 time: 0.361791 Aug 24 01:50:47.182780 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 17/54] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:47.185755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7275196-4723-4616-bed8-6d104a81df6d tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.200923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1002876287"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.203869 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.203869 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:47.207139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7275196-4723-4616-bed8-6d104a81df6d tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1693871387" status: 202 len: 0 microversion: 2.1 time: 0.025342 Aug 24 01:50:47.207992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 38/55] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:50:47 2022] DELETE /compute/v2.1/flavors/1693871387 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:47.213174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73a7bf17-80b0-4105-89c3-efcc3e927994 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.214425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:47.215323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:47.216052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:47.234341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:47.242696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:47.243370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:47.248314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73a7bf17-80b0-4105-89c3-efcc3e927994 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038262 Aug 24 01:50:47.251761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 39/56] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:47.256502 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1002876287 could not be found. Aug 24 01:50:47.257852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e7b0377-8f57-46ec-85a8-593f339f1a51 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 58 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:50:47.262405 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: {"add_host": {"host": "tempest-nonexist_host-1002876287"}} Aug 24 01:50:47.263512 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: exception: Compute host tempest-nonexist_host-1002876287 could not be found. Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1002876287'}}} Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1002876287' is not mapped to any cell Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.264109 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 24 01:50:47.265261 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1002876287 could not be found. Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1002876287 could not be found. Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.266248 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1002876287 could not be found. Aug 24 01:50:47.267238 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.270239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1002876287 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:47.271462 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bbe80951-2ac5-4fc5-a7a6-be4487054b4e tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.074462 Aug 24 01:50:47.272284 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 18/57] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:47.280151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5099578e-92ad-46ed-98d4-88d22933f98a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-636366183", "id": 431461462, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.298195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e7b0377-8f57-46ec-85a8-593f339f1a51 tempest-FlavorsAccessTestJSON-1589806511 tempest-FlavorsAccessTestJSON-1589806511-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044558 Aug 24 01:50:47.298826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 40/58] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:47.302530 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.302530 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:47.315779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ba2f9f1-7671-47ef-979f-e8797b0827b6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.316536 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.316536 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.327851 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5099578e-92ad-46ed-98d4-88d22933f98a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.053628 Aug 24 01:50:47.329132 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 19/59] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/flavors => generated 410 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:47.329602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=72,nova_api:DELETE=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:47.345504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ba2f9f1-7671-47ef-979f-e8797b0827b6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.039412 Aug 24 01:50:47.346548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dc87a70e-6c34-4d40-9afd-81c66fac3352 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.346981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 41/60] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:47 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:47.357270 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dc87a70e-6c34-4d40-9afd-81c66fac3352 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/431461462" status: 200 len: 410 microversion: 2.1 time: 0.018977 Aug 24 01:50:47.366176 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 20/61] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:50:47 2022] GET /compute/v2.1/flavors/431461462 => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:50:47.366665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0097343f-4cff-47e0-83df-fff8ec583e02 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0097343f-4cff-47e0-83df-fff8ec583e02 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 283 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:50:47.378536 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.379618 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:50:47.380124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:47.380764 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.381641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.382376 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:50:47.382376 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:50:47.382376 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:50:47.382376 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.382376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0097343f-4cff-47e0-83df-fff8ec583e02 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:47.383213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0097343f-4cff-47e0-83df-fff8ec583e02 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031216 Aug 24 01:50:47.390967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 42/62] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:50:47.405059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b2588ee-1e35-4373-b399-f208345b4e43 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b2588ee-1e35-4373-b399-f208345b4e43 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 27 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:50:47.410221 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: {"aggregate": {"name": ""}} Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:47.411294 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '' Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:47.412093 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:50:47.413278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.418000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b2588ee-1e35-4373-b399-f208345b4e43 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:47.418000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b2588ee-1e35-4373-b399-f208345b4e43 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019692 Aug 24 01:50:47.418000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 43/63] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:50:47.426489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a00e3ad1-0c7b-4e0e-a284-6e5d2bd418e1 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-415080269"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.429069 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.429069 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.429943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a00e3ad1-0c7b-4e0e-a284-6e5d2bd418e1 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a00e3ad1-0c7b-4e0e-a284-6e5d2bd418e1 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 59 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:47.432482 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: {"aggregate": {"name": "tempest-test_aggregate-415080269"}} Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:47.434032 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-415080269'}}} Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:47.434765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:47.435731 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 24 01:50:47.436692 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.436692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a00e3ad1-0c7b-4e0e-a284-6e5d2bd418e1 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:47.436692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a00e3ad1-0c7b-4e0e-a284-6e5d2bd418e1 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012067 Aug 24 01:50:47.436692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 44/64] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:47.444076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-deb092b6-7780-4a94-8f5e-e6f09e4164e2 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1500782313"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.448379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-deb092b6-7780-4a94-8f5e-e6f09e4164e2 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid 0e8a6150-1f63-47e9-95df-1a0da065893b for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:47.476592 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-deb092b6-7780-4a94-8f5e-e6f09e4164e2 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036062 Aug 24 01:50:47.485683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 45/65] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:50:47.491089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1500782313"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:47.494738 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:47.494738 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:47.495656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid f50cc5be-78e8-4573-8a16-58f32a08c04c for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:47.508803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1500782313 already exists. Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 60 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:50:47.511001 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: {"aggregate": {"name": "tempest-test_aggregate-1500782313"}} Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:47.512090 n-d-854121-3 devstack@n-api.service[128567]: exception: Aggregate tempest-test_aggregate-1500782313 already exists. Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1500782313'}}} Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 24 01:50:47.512774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1500782313 already exists. Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:47.513702 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1500782313 already exists. Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1500782313 already exists. Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1500782313 already exists. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:47.514701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-731adb5f-cfde-4015-b2d0-3e1498cf2daf tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.025677 Aug 24 01:50:47.515552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 46/66] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 27 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:50:47.931562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a4e40da7-1cad-4d23-816f-3c9baef9a589 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:47.990787 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a4e40da7-1cad-4d23-816f-3c9baef9a589 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.622704 Aug 24 01:50:47.991723 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 21/67] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:47 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:48.012212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64627403-20a0-44b1-87ae-63fcf9d62361 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:48.013247 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:48.013247 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:48.025950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:48.056417 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64627403-20a0-44b1-87ae-63fcf9d62361 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048222 Aug 24 01:50:48.057199 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 22/68] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:48 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:48.070820 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:48.072815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:48.099746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.100657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.113298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.114242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.114776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.123282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.204951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-2067905295", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "availability_zone": "tempest-test_az-1130393628"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:48.218458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.219156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.219737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.220944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.221649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.222422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.303090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:50:48.852955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:50:48.853502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:50:48.854040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:50:48.855655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:50:48.856145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:50:48.868918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.869629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.870201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.870932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:48.871385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:48.871811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:48.895891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Getting quotas for project 6a7c2a7a33674f3eae10ccaf1e7ca3ce. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:50:48.901281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Getting quotas for user c21040e4e0814111bea2074b9ab6104a and project 6a7c2a7a33674f3eae10ccaf1e7ca3ce. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:50:48.921543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:50:48.923744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:50:48.976747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ffd00ce-40c0-4ed6-909d-3f8a172aa625 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454913 Aug 24 01:50:48.983165 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 47/69] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 01:50:48.983165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5a3fdc1-db9a-4dd5-b6ce-be662e4577a5 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:48.983165 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:48.983165 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.002005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5a3fdc1-db9a-4dd5-b6ce-be662e4577a5 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/431461462" status: 202 len: 0 microversion: 2.1 time: 0.023179 Aug 24 01:50:49.005638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 48/70] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:48 2022] DELETE /compute/v2.1/flavors/431461462 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:49.012025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcbecede-2b75-47d7-901b-ad12e5cb0ea4 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1539561330"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.015023 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.015023 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.015927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-bcbecede-2b75-47d7-901b-ad12e5cb0ea4 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid d421db39-54c8-4f5d-9245-fd3b7c193ecb for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:49.060655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcbecede-2b75-47d7-901b-ad12e5cb0ea4 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051308 Aug 24 01:50:49.060655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 49/71] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.061961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-564e3129-0ab4-49e7-b7c9-dfc0ea841365 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.062583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-564e3129-0ab4-49e7-b7c9-dfc0ea841365 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:49.165293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-564e3129-0ab4-49e7-b7c9-dfc0ea841365 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:49.173527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-564e3129-0ab4-49e7-b7c9-dfc0ea841365 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1243 microversion: 2.1 time: 0.115221 Aug 24 01:50:49.175855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 50/72] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1243 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:49.192244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9eac6f1-e111-4918-bc22-56276e0d2ba1 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.213454 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9eac6f1-e111-4918-bc22-56276e0d2ba1 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036187 Aug 24 01:50:49.214097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 51/73] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:49.233365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d8a208c-3a5f-4d2d-b19e-53f8f5642c48 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.234121 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.234121 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.238859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d8a208c-3a5f-4d2d-b19e-53f8f5642c48 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d8a208c-3a5f-4d2d-b19e-53f8f5642c48 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:49.245855 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 01:50:49.247060 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7'} Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:49.247743 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 24 01:50:49.248914 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.250581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d8a208c-3a5f-4d2d-b19e-53f8f5642c48 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.253773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d8a208c-3a5f-4d2d-b19e-53f8f5642c48 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.038711 Aug 24 01:50:49.254339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 52/74] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:49.268863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44652c0c-365c-4011-a74e-2c75b58fe6e6 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-869953579", "id": 2014927286, "os-flavor-access:is_public": "False"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.270502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:49.273956 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.273956 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.297020 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dafc09e5-dcbe-461e-a61a-b3636c8d994e tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1277 microversion: 2.1 time: 1.237355 Aug 24 01:50:49.299034 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 23/75] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:48 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1277 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:49.304661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44652c0c-365c-4011-a74e-2c75b58fe6e6 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.049253 Aug 24 01:50:49.311960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 53/76] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/flavors => generated 429 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.312098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-443f0681-84c4-4840-817b-f7597a61d821 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.312098 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.312098 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:49.327459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5095cc-27ce-4b35-b32a-785f41fc10d7 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "2014927286"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.355980 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-443f0681-84c4-4840-817b-f7597a61d821 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.052471 Aug 24 01:50:49.357824 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 24/77] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:49.361553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7f5095cc-27ce-4b35-b32a-785f41fc10d7 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] HTTP exception thrown: Flavor 2014927286 could not be found. Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5095cc-27ce-4b35-b32a-785f41fc10d7 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Request method failure captured: Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 107 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwRJBJD_AF9DhxAiFNtbUmKSgH-nealZV10h0vUdxq0ENe283KnBu5tZiCPEbx0_uSBvKhCsw06WIJR8gl7HR-B9DHJyLT7-5SkNhGa_fVVmr3-T7oP4KVq48omBF9hbXUTzgVOB2jon8wLE90evabaCiwIzIYUOg2FdR2GIwcktY Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8cc3f2b9ab04446bb14b30ca797e98e4 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsAdminTestJSON-692198230 Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:49.364918 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8cc3f2b9ab04446bb14b30ca797e98e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8cc3f2b9ab04446bb14b30ca797e98e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8cc3f2b9ab04446bb14b30ca797e98e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8cc3f2b9ab04446bb14b30ca797e98e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsAdminTestJSON-692198230 Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8cc3f2b9ab04446bb14b30ca797e98e4 Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-692198230 Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsAdminTestJSON-692198230-project Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b82024793a52484bb58ad90422772336 Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsAdminTestJSON-692198230-project Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "test", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "2014927286"}} Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:49.366526 n-d-854121-3 devstack@n-api.service[128567]: exception: Flavor 2014927286 could not be found. Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '2014927286'}}} Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2014927286 could not be found. Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.367349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2014927286 could not be found. Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.368455 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.370966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.370966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:49.370966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:49.370966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2014927286 could not be found. Aug 24 01:50:49.370966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.375883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5095cc-27ce-4b35-b32a-785f41fc10d7 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Returning 400 to user: Flavor 2014927286 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.377882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f5095cc-27ce-4b35-b32a-785f41fc10d7 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.056601 Aug 24 01:50:49.378486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 54/78] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/servers => generated 81 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:50:49.379277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d8b3b69a-ff9e-4c77-87e1-89e88bb0c697 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.380061 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.380061 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:49.390670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0658ac3-488d-466e-89a4-ff663e320b8c tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.391438 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.391438 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.413189 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-d8b3b69a-ff9e-4c77-87e1-89e88bb0c697 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d8b3b69a-ff9e-4c77-87e1-89e88bb0c697 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:50:49.418201 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: exception: Aggregate -1 could not be found. Aug 24 01:50:49.419619 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '-1'} Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:50:49.420391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.421721 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 01:50:49.423577 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.427193 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d8b3b69a-ff9e-4c77-87e1-89e88bb0c697 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.428428 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d8b3b69a-ff9e-4c77-87e1-89e88bb0c697 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.063824 Aug 24 01:50:49.430523 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 25/79] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:50:49 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:50:49.433717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0658ac3-488d-466e-89a4-ff663e320b8c tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2014927286" status: 202 len: 0 microversion: 2.1 time: 0.044029 Aug 24 01:50:49.435359 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 55/80] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:50:49 2022] DELETE /compute/v2.1/flavors/2014927286 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:49.449980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-203ef027-b21d-475a-b94d-1d6b3d6cae6a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-602080972"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.457245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9567dbe2-418b-4a31-b730-570a2b426027 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.459383 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.459383 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:49.463815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-203ef027-b21d-475a-b94d-1d6b3d6cae6a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid 42ef8a36-2012-4de9-83c7-f0fed34f9d11 for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:50:49.503977 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-203ef027-b21d-475a-b94d-1d6b3d6cae6a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068066 Aug 24 01:50:49.504524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9567dbe2-418b-4a31-b730-570a2b426027 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061437 Aug 24 01:50:49.506207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 56/81] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:49.513906 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 26/82] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.522139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc739821-ea8f-4b29-bde2-f2c58b2a6f46 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.523546 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.523546 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.524448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc739821-ea8f-4b29-bde2-f2c58b2a6f46 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc739821-ea8f-4b29-bde2-f2c58b2a6f46 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:49.526723 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 01:50:49.528039 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8'} Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:49.528849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.530216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc739821-ea8f-4b29-bde2-f2c58b2a6f46 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.531602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-190f719f-e223-4d0d-95c3-7a0522adcf89 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-164694059", "id": 975682186, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.532081 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc739821-ea8f-4b29-bde2-f2c58b2a6f46 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.014513 Aug 24 01:50:49.532081 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 57/83] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:49.539989 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.539989 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:49.542284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6500e4f6-ee5f-4012-97ef-0f81c60a321d tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.581600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6500e4f6-ee5f-4012-97ef-0f81c60a321d tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.046005 Aug 24 01:50:49.582460 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-190f719f-e223-4d0d-95c3-7a0522adcf89 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.059798 Aug 24 01:50:49.589217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 58/84] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:49 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:50:49.589709 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 27/85] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/flavors => generated 411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.605267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c51ab72-2f9b-42c3-84c0-088f51a3b73c tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.606092 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.606092 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.608547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4b58979d-87f4-4bc3-b49a-8400859cd789 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1806993934", "id": 1010306381, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:49.629927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7c51ab72-2f9b-42c3-84c0-088f51a3b73c tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c51ab72-2f9b-42c3-84c0-088f51a3b73c tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:50:49.631574 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: exception: Aggregate -1 could not be found. Aug 24 01:50:49.632800 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '-1'} Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.633418 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 24 01:50:49.634472 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.635372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c51ab72-2f9b-42c3-84c0-088f51a3b73c tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.641540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c51ab72-2f9b-42c3-84c0-088f51a3b73c tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049685 Aug 24 01:50:49.642833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 59/86] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:50:49.664959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d68d9fc-73af-4ef0-a720-4ec59d4ccbd3 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.667689 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:49.667689 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:49.671916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d68d9fc-73af-4ef0-a720-4ec59d4ccbd3 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:49.674431 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4b58979d-87f4-4bc3-b49a-8400859cd789 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.076403 Aug 24 01:50:49.675291 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 28/87] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d68d9fc-73af-4ef0-a720-4ec59d4ccbd3 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:49.678107 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 01:50:49.679213 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:49.679884 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 24 01:50:49.680825 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:49.684969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d68d9fc-73af-4ef0-a720-4ec59d4ccbd3 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:49.686141 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d68d9fc-73af-4ef0-a720-4ec59d4ccbd3 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.035424 Aug 24 01:50:49.690951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 60/88] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:49.692613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c60301cb-485e-4eb5-a624-9e4c5d6cfc0a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.718859 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c60301cb-485e-4eb5-a624-9e4c5d6cfc0a tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.034493 Aug 24 01:50:49.720082 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 29/89] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.733157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-38287b9d-b794-4ca1-8507-db8431bb118f tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.752987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-38287b9d-b794-4ca1-8507-db8431bb118f tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.023174 Aug 24 01:50:49.753565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 61/90] 10.222.0.49 () {58 vars in 1177 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.765959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec14f1fc-d04a-4ae3-8bf5-42b083d15050 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.775764 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec14f1fc-d04a-4ae3-8bf5-42b083d15050 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.013387 Aug 24 01:50:49.776646 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 30/91] 10.222.0.49 () {58 vars in 1171 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.788889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bf5c155-943a-4d4e-ab29-eaca9bba9311 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.801842 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bf5c155-943a-4d4e-ab29-eaca9bba9311 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.016669 Aug 24 01:50:49.811305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 62/92] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:49.815992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-43e66ae5-63a1-47fe-90e7-e3ffccf5c232 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.855501 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-43e66ae5-63a1-47fe-90e7-e3ffccf5c232 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.043611 Aug 24 01:50:49.863910 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 31/93] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:50:49.878404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f63db292-b4e7-48a9-8b66-95a2ef8b27a2 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.924637 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f63db292-b4e7-48a9-8b66-95a2ef8b27a2 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.049412 Aug 24 01:50:49.925271 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 32/94] 10.222.0.49 () {58 vars in 1175 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:50:49.943374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-114e5036-b885-4b0f-bb0f-7cf3079b4872 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:49.965315 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-114e5036-b885-4b0f-bb0f-7cf3079b4872 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.026059 Aug 24 01:50:49.980415 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 33/95] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:49.985483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6a6352fb-9be5-48e0-af7b-970891e0dadf tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.011907 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6a6352fb-9be5-48e0-af7b-970891e0dadf tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.029906 Aug 24 01:50:50.025102 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 34/96] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:50.035061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2526bfbb-2264-425e-80c5-67d96dbd3922 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.036093 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:50.036093 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:50.062921 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2526bfbb-2264-425e-80c5-67d96dbd3922 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1010306381" status: 202 len: 0 microversion: 2.1 time: 0.032432 Aug 24 01:50:50.067705 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 35/97] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:50:50 2022] DELETE /compute/v2.1/flavors/1010306381 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:50:50.075768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4ae0a4b4-a8d7-4bfc-b44d-f7407a054371 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.107112 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4ae0a4b4-a8d7-4bfc-b44d-f7407a054371 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037210 Aug 24 01:50:50.108244 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 36/98] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:50.127619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d1b477c9-05a8-4162-97c0-0a43ef23856e tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.149931 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d1b477c9-05a8-4162-97c0-0a43ef23856e tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/975682186" status: 202 len: 0 microversion: 2.1 time: 0.025863 Aug 24 01:50:50.154827 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 37/99] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:50 2022] DELETE /compute/v2.1/flavors/975682186 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:50:50.162327 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-249560aa-b89f-4e1e-a420-0952d31d0567 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.194559 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-249560aa-b89f-4e1e-a420-0952d31d0567 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037679 Aug 24 01:50:50.208011 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 38/100] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:50.219740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2599519a-8d95-4ee5-a9f8-2a6c21146b2c tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.221358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2599519a-8d95-4ee5-a9f8-2a6c21146b2c tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:50.296746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2599519a-8d95-4ee5-a9f8-2a6c21146b2c tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:50.328482 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2599519a-8d95-4ee5-a9f8-2a6c21146b2c tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1243 microversion: 2.1 time: 0.114251 Aug 24 01:50:50.332504 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 39/101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:50 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1243 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:50.352447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a3be5f11-125b-4164-95a1-c0a01387e0df tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1949380685", "id": 58126653, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:50.365539 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:50.365539 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:50.407574 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a3be5f11-125b-4164-95a1-c0a01387e0df tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.069727 Aug 24 01:50:50.416299 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 40/102] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:50.428823 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.431162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:50.446531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:50.448403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:50.450304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:50.452994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:50.454799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:50.455996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:50.971387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Calling method '.version_select at 0x7f6b92e03e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:50.972161 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:50.972161 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:50.974986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:50.980963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:50.981734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.024778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.035803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.036503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.065194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.066524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.067284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.080554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1e5b080-80c6-419e-8bcf-38e61a3a7e73 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.251343 Aug 24 01:50:51.087398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 63/103] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:50:51.092389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ded8efd-bafb-442d-a400-b99667911779 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.119601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:51.130153 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bd59122b-eb04-44b9-88a4-18d32d176429 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.712099 Aug 24 01:50:51.135979 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 41/104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:50 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:51.147822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Calling method '.version_select at 0x7f6b92f5f280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.151158 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.151158 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:51.156129 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.157488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.158191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.171186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ded8efd-bafb-442d-a400-b99667911779 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082285 Aug 24 01:50:51.172163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 64/105] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:51.185151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.185974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.186662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.203281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55bffe7d-1385-46a6-90cb-f486b50d69e9 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.278959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55bffe7d-1385-46a6-90cb-f486b50d69e9 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075846 Aug 24 01:50:51.280498 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 65/106] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:50:51.289804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.289804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.289804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.292632 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc9427b8-bb81-4229-b348-a4675cb26102 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h1-854121-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.153177 Aug 24 01:50:51.293717 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 42/107] 10.222.0.49 () {58 vars in 1212 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-3/servers => generated 104 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:51.309882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Calling method '.version_select at 0x7f6b92e3c3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.310671 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.310671 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:51.311525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f8e34a3e-92f7-45f7-b6f1-0e8c2a78537d tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.313047 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.313047 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:51.330987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.332703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.333514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.340956 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f8e34a3e-92f7-45f7-b6f1-0e8c2a78537d tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/58126653" status: 202 len: 0 microversion: 2.1 time: 0.032196 Aug 24 01:50:51.342401 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 43/108] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:50:51 2022] DELETE /compute/v2.1/flavors/58126653 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:51.351448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-38020cbe-9375-46c5-957d-781061f234cf tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.367719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.376088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.377365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.393105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.396622 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-38020cbe-9375-46c5-957d-781061f234cf tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049641 Aug 24 01:50:51.397416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.411551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.411748 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 44/109] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:51.411828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0133863d-da19-4300-aa85-14965e98d650 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.102573 Aug 24 01:50:51.420168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.421182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:51.424147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 66/110] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:51.434377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.435194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.435434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Calling method '.version_select at 0x7f6b92e3cd30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.437339 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.437339 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:51.437632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.439316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.440501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.441559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.442209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.442898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.444896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.485868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:51.492129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:51.492590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:51.528670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3d5ed35-b6b3-4014-aedf-f0b9411ed791 tempest-HypervisorAdminUnderV252Test-1060898904 tempest-HypervisorAdminUnderV252Test-1060898904-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h1-854121-3/search" status: 200 len: 104 microversion: 2.1 time: 0.101137 Aug 24 01:50:51.529190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 67/111] 10.222.0.49 () {58 vars in 1209 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-3/search => generated 104 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:51.544445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52da85bb-eb36-4d59-acf1-854713001bda tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1356111478", "id": 867340146, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:51.560968 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.560968 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:51.570645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:51.585128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52da85bb-eb36-4d59-acf1-854713001bda tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047908 Aug 24 01:50:51.587674 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-98ebe4db-4661-4e3c-ab01-95420330158a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1291 microversion: 2.1 time: 0.185837 Aug 24 01:50:51.588377 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 45/112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1291 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:51.589311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 68/113] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:51 2022] POST /compute/v2.1/flavors => generated 411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:51.608866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a033dbf6-2bff-492d-8e1d-43db91d50833 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.664122 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a033dbf6-2bff-492d-8e1d-43db91d50833 tempest-FlavorsAdminTestJSON-692198230 tempest-FlavorsAdminTestJSON-692198230-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.053282 Aug 24 01:50:51.664797 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 46/114] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:51.682408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-001f202e-2151-4208-98e5-51d85269bc06 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.685819 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:51.685819 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:51.720044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-001f202e-2151-4208-98e5-51d85269bc06 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/867340146" status: 202 len: 0 microversion: 2.1 time: 0.041306 Aug 24 01:50:51.723817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 69/115] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:51 2022] DELETE /compute/v2.1/flavors/867340146 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:51.732220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6bbdd3ab-bf10-44b7-8d88-2aa9a80d4071 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:51.763147 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6bbdd3ab-bf10-44b7-8d88-2aa9a80d4071 tempest-FlavorsAdminTestJSON-795429051 tempest-FlavorsAdminTestJSON-795429051-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036048 Aug 24 01:50:51.763946 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 47/116] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:52.153397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:52.154110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:52.167568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:52.168387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:52.169007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:52.169966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:52.171946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:52.172336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:52.457810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:52.482909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf4511a2-8957-4c5e-a96d-92e801e0f53d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.333460 Aug 24 01:50:52.491045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 70/117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:52 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:50:52.615844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:52.617394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:52.635048 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:52.635764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:52.636701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:52.638108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:52.638791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:52.641183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:52.927479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:52.941491 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-96a7f468-9618-4ab3-92a3-ddf061844838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1309 microversion: 2.1 time: 0.328940 Aug 24 01:50:52.944838 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 48/118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:52 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:53.514480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:53.515105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:53.529268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:53.531676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:53.532307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:53.533265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:53.534705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:53.535492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:53.640174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb15ab79-72be-4513-9673-3a82307de7bf tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-831361690", "ram": 512, "vcpus": 1, "disk": 10, "id": 126810082, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:53.645576 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:53.645576 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:53.655428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:DELETE=12,nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:53.677680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb15ab79-72be-4513-9673-3a82307de7bf tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.491251 Aug 24 01:50:53.684042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 71/119] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:50:53 2022] POST /compute/v2.1/flavors => generated 412 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:53.968836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:53.979166 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fd954d08-8261-4bab-b52e-a4c90af75e1a tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.468459 Aug 24 01:50:53.999514 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 49/120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:53 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:54.013532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:54.015857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:54.034469 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:54.035474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:54.037470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:54.039743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:54.041235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:54.041835 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:54.447675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-518b89e2-1139-4f14-9ccb-0616b52c9d13 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:54.471113 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-518b89e2-1139-4f14-9ccb-0616b52c9d13 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] HTTP exception thrown: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-518b89e2-1139-4f14-9ccb-0616b52c9d13 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Request method failure captured: Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYP55azIbEk_E1-LtvRqgO9NGVYxwmWLb6L_tO9FYx5WyyIs0wMfC0EprzvIusmuqPVeZ2fkcuwqcFU-arEFOdkRw5b3WAGQdyUqGCokBVWw_05873KBqJB5_UpDTE2C4d9VLxEeOE9mgYsRNgpRnpE4TFV0zuQjBWBnWa2kcCyqBEU Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:54.474749 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f6b23fbdcf6e4807af7f78952b7e0538 Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:54.476143 n-d-854121-3 devstack@n-api.service[128567]: exception: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'flavor_id': '126810082', 'id': 'hw:cpu_thread_policy'} Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:54.476920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:54.478326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.484198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-518b89e2-1139-4f14-9ccb-0616b52c9d13 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Returning 404 to user: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:54.485436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-518b89e2-1139-4f14-9ccb-0616b52c9d13 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] 10.222.0.49 "GET /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.791496 Aug 24 01:50:54.491341 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 72/121] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:50:53 2022] GET /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 798 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:54.578579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:54.590965 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5ba0eee3-c06e-4151-be04-39c0eb8387bf tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1297 microversion: 2.1 time: 0.589778 Aug 24 01:50:54.604381 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 50/122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:53 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1297 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:54.604381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c97374a1-a417-496d-b603-fd1020730c11 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:54.610424 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:54.610424 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:54.611748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c97374a1-a417-496d-b603-fd1020730c11 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'f6b23fbdcf6e4807af7f78952b7e0538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3c8a0719734a4c98cb43e5f2d52d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c97374a1-a417-496d-b603-fd1020730c11 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Request method failure captured: Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/flavors/126810082/os-extra_specs HTTP/1.1 Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 66 Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYP55azIbEk_E1-LtvRqgO9NGVYxwmWLb6L_tO9FYx5WyyIs0wMfC0EprzvIusmuqPVeZ2fkcuwqcFU-arEFOdkRw5b3WAGQdyUqGCokBVWw_05873KBqJB5_UpDTE2C4d9VLxEeOE9mgYsRNgpRnpE4TFV0zuQjBWBnWa2kcCyqBEU Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:50:54.620870 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: f6b23fbdcf6e4807af7f78952b7e0538 Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 24 01:50:54.622074 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'flavor_id': '126810082', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:54.622780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 24 01:50:54.623753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:54.626053 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c97374a1-a417-496d-b603-fd1020730c11 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:54.626053 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c97374a1-a417-496d-b603-fd1020730c11 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] 10.222.0.49 "POST /compute/v2.1/flavors/126810082/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.029081 Aug 24 01:50:54.628848 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 51/123] 10.222.0.49 () {60 vars in 1221 bytes} [Wed Aug 24 01:50:54 2022] POST /compute/v2.1/flavors/126810082/os-extra_specs => generated 124 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:54.638372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-aa381fae-6492-4a4c-a276-692f4ae179ab tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:54.693181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=77,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:54.699658 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-aa381fae-6492-4a4c-a276-692f4ae179ab tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/126810082/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069614 Aug 24 01:50:54.701347 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 52/124] 10.222.0.49 () {60 vars in 1221 bytes} [Wed Aug 24 01:50:54 2022] POST /compute/v2.1/flavors/126810082/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:54.922788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada1ef2c-8c41-4c86-b83d-9e73ee648461", "tag": "04666f5b-1038-440f-882a-bd38e1621401"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:54.964578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:54.965065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:54.965414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.024516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Creating event network-changed:04666f5b-1038-440f-882a-bd38e1621401 for instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 on n-h2-854121-3 Aug 24 01:50:55.043931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:50:55.045364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cee86319-0506-4b28-a008-0f87ad66a5a8 req-370ec52c-ad4a-41e9-8963-49ea2a9b2f13 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:50:55.047344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.049881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.051137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.052686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.054109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.055950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.087751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.rpcapi [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 01:50:55.088742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] Releasing lock "compute-rpcapi-router" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:50:55.151329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec7c1b38-db49-4c4e-b991-415aa09922b9 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.656492 Aug 24 01:50:55.152168 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 73/125] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:55.165875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0570a8e-2ef0-4969-9dbe-f7532b715493 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:55.176555 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:55.176555 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:55.178448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0570a8e-2ef0-4969-9dbe-f7532b715493 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'f6b23fbdcf6e4807af7f78952b7e0538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3c8a0719734a4c98cb43e5f2d52d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0570a8e-2ef0-4969-9dbe-f7532b715493 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Request method failure captured: Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYP55azIbEk_E1-LtvRqgO9NGVYxwmWLb6L_tO9FYx5WyyIs0wMfC0EprzvIusmuqPVeZ2fkcuwqcFU-arEFOdkRw5b3WAGQdyUqGCokBVWw_05873KBqJB5_UpDTE2C4d9VLxEeOE9mgYsRNgpRnpE4TFV0zuQjBWBnWa2kcCyqBEU Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:55.180426 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f6b23fbdcf6e4807af7f78952b7e0538 Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:55.181735 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'flavor_id': '126810082', 'id': 'hw:numa_nodes'} Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:55.182454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 24 01:50:55.183579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:55.185887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0570a8e-2ef0-4969-9dbe-f7532b715493 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:55.189890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0570a8e-2ef0-4969-9dbe-f7532b715493 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] 10.222.0.49 "DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035771 Aug 24 01:50:55.190936 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 74/126] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 01:50:55 2022] DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:55.200306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:55.206429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:55.224157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.228416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.229263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.230202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.233329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.233930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.488623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92f38040>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:55.489444 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:55.489444 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:55.490758 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.491360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.491906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.542182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.542715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.543158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.607000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.607603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.608080 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.632828 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ed136a57-17b7-4c8e-9d31-1adadeee8325 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.923880 Aug 24 01:50:55.634005 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 53/127] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:55.649619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b44c2014-2313-4468-9019-0b58e6615333 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:55.661163 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:55.661163 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:55.749729 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b44c2014-2313-4468-9019-0b58e6615333 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/126810082/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.112820 Aug 24 01:50:55.752676 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 54/128] 10.222.0.49 () {60 vars in 1221 bytes} [Wed Aug 24 01:50:55 2022] POST /compute/v2.1/flavors/126810082/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:50:55.797787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:55.800331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:55.810671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.811627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.812467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:55.815725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:55.817079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:55.818176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.136015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:56.151036 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-290c0c9c-f780-43cf-bf3c-ae71bad150d9 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.393751 Aug 24 01:50:56.153033 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 55/129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:55 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:56.167383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92e485e0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.168369 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.168369 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.173149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.177236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.177984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.233226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.233226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.233226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.236755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:56.258879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5241e34-4c81-482b-b701-564cbc7535d6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 1.066171 Aug 24 01:50:56.264458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 75/130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:55 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:56.271216 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.271538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453ac97b-6835-4c68-9f6e-2ec13618f592 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:56.271700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.272085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.275293 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.275293 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:56.276664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-453ac97b-6835-4c68-9f6e-2ec13618f592 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'f6b23fbdcf6e4807af7f78952b7e0538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3c8a0719734a4c98cb43e5f2d52d1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453ac97b-6835-4c68-9f6e-2ec13618f592 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Request method failure captured: Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 22 Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYP55azIbEk_E1-LtvRqgO9NGVYxwmWLb6L_tO9FYx5WyyIs0wMfC0EprzvIusmuqPVeZ2fkcuwqcFU-arEFOdkRw5b3WAGQdyUqGCokBVWw_05873KBqJB5_UpDTE2C4d9VLxEeOE9mgYsRNgpRnpE4TFV0zuQjBWBnWa2kcCyqBEU Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:50:56.284247 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3c8a0719734a4c98cb43e5f2d52d1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3c8a0719734a4c98cb43e5f2d52d1e Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f6b23fbdcf6e4807af7f78952b7e0538 Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: {"hw:numa_nodes": "1"} Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:50:56.285632 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'flavor_id': '126810082', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:50:56.286442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 24 01:50:56.287668 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.289003 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ce380730-c383-41be-8a85-fbd6109c31d5 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.131758 Aug 24 01:50:56.295169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453ac97b-6835-4c68-9f6e-2ec13618f592 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:56.296298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-453ac97b-6835-4c68-9f6e-2ec13618f592 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291 tempest-FlavorsExtraSpecsNegativeTestJSON-1687375291-project] 10.222.0.49 "PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.030393 Aug 24 01:50:56.297176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 76/131] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:50:56 2022] PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:56.315530 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 56/132] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:56.322253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92e03e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.327700 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.327700 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:56.333370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.334780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.335270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-25ddd0fc-e45d-48d6-b905-ee1172012c42 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.335894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.336814 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.336814 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.362188 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-25ddd0fc-e45d-48d6-b905-ee1172012c42 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] HTTP exception thrown: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-25ddd0fc-e45d-48d6-b905-ee1172012c42 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Request method failure captured: Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYP9hQl94kGEyMRS-hgaETU7pWBuGYnkbs3m-vv9aDv-HQBegEwg_DWJAOCB0sbIJTOYDLe08InEsuMazpP_YGlVhXMOSQMXDSTQc4_aUVSw9_jMuwD4tUWnW7jEqnslsI1E2BTIpaQ5xFVr0dtZLzjbw-Ot7AwU-J2DferZFtaU07A Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:50:56.369081 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: cbd1b457122c4fcd81275cbe8fdf1b46 Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:56.370497 n-d-854121-3 devstack@n-api.service[128566]: exception: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'flavor_id': '126810082', 'id': 'hw:cpu_thread_policy'} Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.371324 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.372610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-25ddd0fc-e45d-48d6-b905-ee1172012c42 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Returning 404 to user: Flavor 126810082 has no extra specs with key hw:cpu_thread_policy. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:56.375451 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-25ddd0fc-e45d-48d6-b905-ee1172012c42 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.054355 Aug 24 01:50:56.376262 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 57/133] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 01:50:56 2022] DELETE /compute/v2.1/flavors/126810082/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:50:56.384302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.385048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.385697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.395985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8b32455-25da-4b9e-ae6d-f90c2e916950 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:56.414806 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.414806 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.420455 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-a8b32455-25da-4b9e-ae6d-f90c2e916950 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8b32455-25da-4b9e-ae6d-f90c2e916950 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Request method failure captured: Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 27 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYP9hQl94kGEyMRS-hgaETU7pWBuGYnkbs3m-vv9aDv-HQBegEwg_DWJAOCB0sbIJTOYDLe08InEsuMazpP_YGlVhXMOSQMXDSTQc4_aUVSw9_jMuwD4tUWnW7jEqnslsI1E2BTIpaQ5xFVr0dtZLzjbw-Ot7AwU-J2DferZFtaU07A Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:50:56.424975 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: cbd1b457122c4fcd81275cbe8fdf1b46 Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: {"hw:cpu_policy": "shared"} Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:56.426334 n-d-854121-3 devstack@n-api.service[128566]: exception: Request body and URI mismatch Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'flavor_id': '126810082', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.431236 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8b32455-25da-4b9e-ae6d-f90c2e916950 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a8b32455-25da-4b9e-ae6d-f90c2e916950 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.045471 Aug 24 01:50:56.433892 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 58/134] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:50:56 2022] PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes => generated 73 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:50:56.444199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.447630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.449382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0c4533e3-b0b7-4414-b764-58dc25b997d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:56.449816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0c4533e3-b0b7-4414-b764-58dc25b997d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Request method failure captured: Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 49 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYP9hQl94kGEyMRS-hgaETU7pWBuGYnkbs3m-vv9aDv-HQBegEwg_DWJAOCB0sbIJTOYDLe08InEsuMazpP_YGlVhXMOSQMXDSTQc4_aUVSw9_jMuwD4tUWnW7jEqnslsI1E2BTIpaQ5xFVr0dtZLzjbw-Ot7AwU-J2DferZFtaU07A Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:50:56.462932 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_f2119efd607c45fe9122ea06f390e8d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: f2119efd607c45fe9122ea06f390e8d9 Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: cbd1b457122c4fcd81275cbe8fdf1b46 Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 24 01:50:56.464277 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'flavor_id': '126810082', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance: Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 24 01:50:56.465112 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.466447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:50:56.467710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0c4533e3-b0b7-4414-b764-58dc25b997d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:50:56.468765 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0c4533e3-b0b7-4414-b764-58dc25b997d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.030247 Aug 24 01:50:56.475993 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa414bea-fbf4-4667-853c-c056b5feef97 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.173726 Aug 24 01:50:56.477663 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 59/135] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:50:56 2022] PUT /compute/v2.1/flavors/126810082/os-extra_specs/hw:numa_nodes => generated 117 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:50:56.478232 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 77/136] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:50:56.515571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e7221f13-aa8d-4ec1-b4ab-2f56e16fd446 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.516359 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.516359 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.516555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92d26f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.518359 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.518359 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:56.520338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.521223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.530570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.567749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.568082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.568663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.586217 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d05b52e6-4420-42d8-b41d-d977ffabeeca tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.091419 Aug 24 01:50:56.587512 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e7221f13-aa8d-4ec1-b4ab-2f56e16fd446 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/126810082" status: 202 len: 0 microversion: 2.1 time: 0.104658 Aug 24 01:50:56.588472 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 60/138] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:50:56 2022] DELETE /compute/v2.1/flavors/126810082 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:50:56.588588 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 78/138] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:56.605983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd6bb7f9-1c9c-4ef0-8838-6361c7d3c4c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.612788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6633d2e0-9a4e-43e7-9d28-b4f3f1edb88e tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92ef2280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.613707 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.613707 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.621392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6633d2e0-9a4e-43e7-9d28-b4f3f1edb88e tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.624580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6633d2e0-9a4e-43e7-9d28-b4f3f1edb88e tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.625076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6633d2e0-9a4e-43e7-9d28-b4f3f1edb88e tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.660269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd6bb7f9-1c9c-4ef0-8838-6361c7d3c4c8 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667 tempest-FlavorsExtraSpecsNegativeTestJSON-1523045667-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062578 Aug 24 01:50:56.664634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 79/139] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:56.676729 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6633d2e0-9a4e-43e7-9d28-b4f3f1edb88e tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.073424 Aug 24 01:50:56.678175 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 61/140] 10.222.0.49 () {58 vars in 1179 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:56.692460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92c82310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.693593 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.693593 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:56.696907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.706313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.706768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.753060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.753491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.755162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.780054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.791924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.794245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.811227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80af6d04-1abb-4465-ae58-55044ed9ee30 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.122297 Aug 24 01:50:56.812185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 80/141] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:56.824395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92ef23a0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.825712 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.825712 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:56.827195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.828836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.831382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.929760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.930558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.931471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:56.941939 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-73ced18b-be87-4672-bcb4-cfd1f88cc15d tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.122681 Aug 24 01:50:56.943158 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 62/142] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:56.960057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92d26d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:56.961579 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:56.961579 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:56.963028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:56.963750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:56.964932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.049233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.053279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.054776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.069359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22719c4c-a67e-48f9-8b31-b442d141ccd2 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.115936 Aug 24 01:50:57.072952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 81/143] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:50:56 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:57.087876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Calling method '.version_select at 0x7f6b92ef2f70>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:57.088679 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:57.088679 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:50:57.090000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.090489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.090934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.166681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.167175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.176456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:57.178358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:57.193995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.199220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.201085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.202511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.204047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.204993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.207768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.252483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:57.281753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.282191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.287259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.307901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:50:57.308993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91800eed-cd80-4ecb-9e86-37fd824d7754 tempest-HypervisorAdminTestJSON-633910490 tempest-HypervisorAdminTestJSON-633910490-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:50:57.311042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.311673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.312735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.322620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.323647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.324857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.347141 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.compute.rpcapi [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 01:50:57.352099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24b181b9-5301-4768-9665-b659039a4499 None None] Releasing lock "compute-rpcapi-router" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:50:57.407823 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-24b181b9-5301-4768-9665-b659039a4499 None None] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.323966 Aug 24 01:50:57.409151 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 63/144] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Aug 24 01:50:57 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:50:57.415799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:57.416809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:57.435895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.440318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.443372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.444634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:57.448563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:57.449764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:57.927259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:57.937174 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b465476d-1055-4261-bf7c-7fc0da2efd0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.765997 Aug 24 01:50:57.953453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 82/145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:57 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:50:58.371065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:50:58.390857 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4efa618d-2960-4167-bf42-f6cf7d1fccdf tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.978598 Aug 24 01:50:58.419635 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 64/146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:57 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:50:58.967792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:58.968828 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:58.986356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:58.992560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:58.994120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:58.995460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:58.996211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:58.996902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:59.038282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:59.173865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:50:59.657193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd831d20-7f8a-4bfb-b557-6767263c7859 tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-608646388", "id": 1727112250, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:50:59.662341 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:50:59.662341 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:50:59.718431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd831d20-7f8a-4bfb-b557-6767263c7859 tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 1.013861 Aug 24 01:50:59.722447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 83/147] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:50:58 2022] POST /compute/v2.1/flavors => generated 448 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:50:59.740008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:50:59.745957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:50:59.759937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:59.760659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:59.761581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:59.762696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:50:59.763300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:50:59.764018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:50:59.800748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:00.029043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:00.041309 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-55ea9f57-91e4-4eac-9d47-72183a4eed52 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 1.079934 Aug 24 01:51:00.042485 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 65/148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:58 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:00.198717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:00.208843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-555bac5e-d51d-495e-9f73-5af09efc4cc4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.483717 Aug 24 01:51:00.240888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 84/149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:50:59 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:00.307603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:00.437663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b18df3-c86a-4d5a-8d28-953f8387f7ee", "tag": "247757db-32b8-4c79-bf0b-653cfda163d9"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:00.477397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:00.478657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:00.483695 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:00.550366 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] Creating event network-changed:247757db-32b8-4c79-bf0b-653cfda163d9 for instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee on n-h1-854121-3 Aug 24 01:51:00.565970 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-dc4df97b-9820-42ae-880e-3c579c118010 req-453b3140-aded-4c3b-b783-96a61b2f0979 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.520651 Aug 24 01:51:00.566725 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 66/150] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:01.066953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:01.069342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:01.082726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:01.083963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:01.084841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:01.087850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:01.089960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:01.091491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:01.150164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ecc2a1d8-fab3-462a-ab83-8d5f385d0fba tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:01.163144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ecc2a1d8-fab3-462a-ab83-8d5f385d0fba tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] 10.222.0.49 "GET /compute/v2.1/flavors/1727112250" status: 200 len: 448 microversion: 2.55 time: 0.923701 Aug 24 01:51:01.163799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 85/151] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Aug 24 01:51:00 2022] GET /compute/v2.1/flavors/1727112250 => generated 448 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:01.186064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50d7675a-7628-409f-8624-c6395fb7bb2d tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] Action: 'update', calling method: .version_select at 0x7f6b99087d30>, body: {"flavor": {"description": "new"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:01.262352 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:01.262352 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:01.325625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50d7675a-7628-409f-8624-c6395fb7bb2d tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1727112250" status: 200 len: 449 microversion: 2.55 time: 0.143121 Aug 24 01:51:01.328529 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 86/152] 10.222.0.49 () {62 vars in 1219 bytes} [Wed Aug 24 01:51:01 2022] PUT /compute/v2.1/flavors/1727112250 => generated 449 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:01.342733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:01.343621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:01.370112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:01.370760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:01.371642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:01.373605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:01.377021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:01.377742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:01.785370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:01.799010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a88b9be0-40d2-4dae-ac5b-abbc943b76ac tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.465721 Aug 24 01:51:01.809172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 87/153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:01 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:01.831819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c8497f0-3065-4c7e-b22b-0a225b34f834 tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:01.912554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c8497f0-3065-4c7e-b22b-0a225b34f834 tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.101946 Aug 24 01:51:01.920148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:01.942539 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-36113e0a-7f0a-41de-8d87-36a1c95681e7 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.872980 Aug 24 01:51:01.942757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 88/154] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:01 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:01.960897 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 67/155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:01 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:01.971153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4d8d14b-c470-4a19-b8e9-4964605cdf6e tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:02.011521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4d8d14b-c470-4a19-b8e9-4964605cdf6e tempest-FlavorsV255TestJSON-1414463033 tempest-FlavorsV255TestJSON-1414463033-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.045075 Aug 24 01:51:02.017684 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 89/156] 10.222.0.49 () {60 vars in 1166 bytes} [Wed Aug 24 01:51:01 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:02.037801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-88e6f67c-1489-44c2-9a72-047b5d38864e tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:02.038968 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:02.038968 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:02.119257 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-88e6f67c-1489-44c2-9a72-047b5d38864e tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1727112250" status: 202 len: 0 microversion: 2.55 time: 0.086153 Aug 24 01:51:02.133263 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 68/157] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 24 01:51:02 2022] DELETE /compute/v2.1/flavors/1727112250 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:51:02.142900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4958f93f-ba94-4753-81f8-d413ef60b6b5 tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:02.196661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4958f93f-ba94-4753-81f8-d413ef60b6b5 tempest-FlavorsV255TestJSON-1501235341 tempest-FlavorsV255TestJSON-1501235341-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.058515 Aug 24 01:51:02.212422 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 90/158] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:02 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:02.834226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:02.834888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:02.855102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:02.856228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:02.857482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:02.860870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:02.863136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:02.865140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:02.978329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:02.979049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:03.000002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:03.007902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:03.010500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:03.014463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:03.022020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:03.023180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:03.347087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:03.355349 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3265d9be-0544-4ef6-9e65-573f1450e2f5 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.528076 Aug 24 01:51:03.355941 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 69/159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:02 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:03.372236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:03.389154 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdc1f96e-afe1-4af1-9b31-2becaacb9904 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.414555 Aug 24 01:51:03.400748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 91/160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:02 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:03.896357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1667475584", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:04.034155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:04.319012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:04.319433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:04.319901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:04.320773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:04.321183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:04.336262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.337226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.337918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.338958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.339665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.340246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.372693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:04.379898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:04.381051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:04.394344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.394989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.395503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.396470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.398434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.398971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.400527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:04.428576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:04.434488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:04.495798 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d6d227d2-058b-497b-888f-84d1f308b740 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125616 Aug 24 01:51:04.497102 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 70/161] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:04.502458 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:04.503383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:04.510774 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.511616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.512407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.513446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:04.514143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:04.514818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:04.689618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:04.700015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a438690-12bf-46e0-8a20-0bba00aa60a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.323958 Aug 24 01:51:04.715822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 92/162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:04 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:04.721736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cd77a39-2258-4c69-b9eb-bfdab930437e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:04.722577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cd77a39-2258-4c69-b9eb-bfdab930437e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:04.731983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:04.760052 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5803b34d-c2a1-4063-b721-7bee1f890be8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.261492 Aug 24 01:51:04.760752 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 71/163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:04 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:04.804040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cd77a39-2258-4c69-b9eb-bfdab930437e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:04.821635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cd77a39-2258-4c69-b9eb-bfdab930437e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1213 microversion: 2.1 time: 0.094359 Aug 24 01:51:04.824827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 93/164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:04 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:05.242768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-35c6fea2-f536-4270-b758-1ae61d5aedac tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Action: 'create', calling method: .version_select at 0x7f6b92e83d30>, body: {"keypair": {"name": "tempest-keypair-1798777059", "type": "ssh", "user_id": "f8d27dfc79c84bcca87f5dac5c6fcdb5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeHtPEym6tTqgK/gtqLKXU88819KB1l7PKT4jHi4ha81dTKqtB0srk5aA3kk2o58lbVvMK2yUeZuXiLN1a66bbfnCqo3tDRGCVN8Lsvdxd1NGQ5emjRLyG2bn7I9nbWaA=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:05.294218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-35c6fea2-f536-4270-b758-1ae61d5aedac tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:05.313151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-35c6fea2-f536-4270-b758-1ae61d5aedac tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for user b718493f72194158a02b5ad2e23f837a and project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:05.372913 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-35c6fea2-f536-4270-b758-1ae61d5aedac tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.610832 Aug 24 01:51:05.373818 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 72/165] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 01:51:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 612 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 01:51:05.389525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50737556-2066-436b-9837-d472d715b78b tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Action: 'create', calling method: .version_select at 0x7f6b92d63d30>, body: {"keypair": {"name": "tempest-keypair-238465630", "type": "ssh", "user_id": "f8d27dfc79c84bcca87f5dac5c6fcdb5", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJafDebrd/ftABXjWo9ZY/RxRfMnFusDBDlOFaD0/RHlrbfkBFT30FHFZsvHl1dg18qtrBdRdSpxO3gnAYwyiFi6pHF5JU1++qXJWd8QKQ+lcwbrkmppupgZDSUCIKsjrg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:05.395111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:05.421910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50737556-2066-436b-9837-d472d715b78b tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:05.430428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50737556-2066-436b-9837-d472d715b78b tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for user b718493f72194158a02b5ad2e23f837a and project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:05.464962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50737556-2066-436b-9837-d472d715b78b tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.077147 Aug 24 01:51:05.465992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 94/166] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 01:51:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 01:51:05.477710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8c9b5a8a-cb05-4593-b8a4-e5e67d537d02 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Calling method '.version_select at 0x7f6b92f38280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.489835 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8c9b5a8a-cb05-4593-b8a4-e5e67d537d02 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1798777059?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5" status: 200 len: 512 microversion: 2.10 time: 0.015960 Aug 24 01:51:05.490516 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 73/167] 10.222.0.49 () {60 vars in 1340 bytes} [Wed Aug 24 01:51:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1798777059?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:05.508417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b5fc99e-f6d2-4949-950f-4d873d0b44ea tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Action: 'create', calling method: .version_select at 0x7f6b92c26b80>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1808976684", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkZLmXvtcNkKmHnye8otmYCrTW9t/GS9aWFvyQLdgT7aETgaS89Ns6lfGlV9Ti/2lHe+d/B0ka3qNCk2FDP9ccpkOkGXyytLjWGsW/pfnFcuMVOV33f3bjuKOlnqdQGdA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:05.530563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5b5fc99e-f6d2-4949-950f-4d873d0b44ea tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:05.534540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5b5fc99e-f6d2-4949-950f-4d873d0b44ea tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Getting quotas for user b718493f72194158a02b5ad2e23f837a and project 1f79018b73e34218a7146edae2776c46. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:05.571673 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b5fc99e-f6d2-4949-950f-4d873d0b44ea tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.070735 Aug 24 01:51:05.572682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 95/168] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 01:51:05 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 01:51:05.582885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f2486916-5b4e-4324-9ba3-b8a44e4a67b8 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Calling method '.version_select at 0x7f6b92e21820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.587848 n-d-854121-3 devstack@n-api.service[128566]: WARNING oslo_db.sqlalchemy.utils [None req-f2486916-5b4e-4324-9ba3-b8a44e4a67b8 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 01:51:05.605755 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f2486916-5b4e-4324-9ba3-b8a44e4a67b8 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "GET /compute/v2.1/os-keypairs?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5" status: 200 len: 725 microversion: 2.10 time: 0.026401 Aug 24 01:51:05.606843 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 74/169] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 01:51:05 2022] GET /compute/v2.1/os-keypairs?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5 => generated 725 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:51:05.620963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a460abb5-bc92-42d1-b0d5-a237cd6e91c3 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Calling method '.version_select at 0x7f6b92c82310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.644901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a460abb5-bc92-42d1-b0d5-a237cd6e91c3 tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1808976684" status: 204 len: 0 microversion: 2.10 time: 0.027925 Aug 24 01:51:05.645683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 96/170] 10.222.0.49 () {60 vars in 1325 bytes} [Wed Aug 24 01:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1808976684 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:51:05.655155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-59f68c1a-00fa-48b6-a9a7-2f1104d76d3e tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Calling method '.version_select at 0x7f6b92d77b80>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.693671 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-59f68c1a-00fa-48b6-a9a7-2f1104d76d3e tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238465630?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5" status: 204 len: 0 microversion: 2.10 time: 0.042513 Aug 24 01:51:05.699236 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 75/171] 10.222.0.49 () {60 vars in 1340 bytes} [Wed Aug 24 01:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238465630?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 01:51:05.703366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7f512ba-b2ef-46b8-abc2-57475efeaeee tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] Calling method '.version_select at 0x7f6b92ba4d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.723177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.724111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:05.728526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7f512ba-b2ef-46b8-abc2-57475efeaeee tempest-KeyPairsV210TestJSON-1457202094 tempest-KeyPairsV210TestJSON-1457202094-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798777059?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5" status: 204 len: 0 microversion: 2.10 time: 0.027580 Aug 24 01:51:05.730565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 97/172] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798777059?user_id=f8d27dfc79c84bcca87f5dac5c6fcdb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:51:05.732472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.733723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.734915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:05.736444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.737272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.738007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:05.780670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.781807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:05.803469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.804484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.805162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:05.806381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.807031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.807734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:05.922918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:05.966452 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-15aa92d4-6156-4962-8b7d-01a78a0674e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.241600 Aug 24 01:51:05.967568 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 76/173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:05 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:05.973592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:05.974459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:05.983574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.988335 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.990454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:05.991476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:05.995529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:05.996628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:06.048762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:06.062258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf0f5994-6f3f-410a-b0b2-4d2f9db37838 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.285733 Aug 24 01:51:06.078604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 98/174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:05 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:06.102770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:06.121096 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-645b373e-e03d-47b1-a6f5-52da8530c7bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1217 microversion: 2.1 time: 0.152145 Aug 24 01:51:06.126450 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 77/175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:05 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:06.990108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:07.002064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:07.009837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.010969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.011597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.013068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.013679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.014498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.165708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Calling method '.version_select at 0x7f6b92d1a5e0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:07.168121 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:07.168121 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:07.169341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.169840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.170274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.171006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.171453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.175690 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.257866 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2703ef9c-56b3-4d8f-8dc1-3149109fed59 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.262361 Aug 24 01:51:07.259925 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 78/176] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:51:06 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:07.268560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:07.270830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:07.276779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=85,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:07.289205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.291941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.293752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.296196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.301408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.302067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.374127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:07.382237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f17356ea-7e83-432d-9015-807231b67faa tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.397503 Aug 24 01:51:07.396421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 99/177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:06 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:07.403192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:07.404251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:07.411924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.412635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.413370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.414073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:07.414691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:07.415251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:07.562426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:07.572453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a87bab8f-e583-409b-a547-e0d9c7091d56 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1217 microversion: 2.1 time: 0.172941 Aug 24 01:51:07.588292 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 100/178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:07 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:07.785724 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:07.796534 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9d87338d-e728-45ef-868e-65993e4e3c0d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.535352 Aug 24 01:51:07.799712 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 79/179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:07 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:08.068018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43567b03-8aab-4947-b62d-402728080f60 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Calling method '.version_select at 0x7f6b92ba40d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.070773 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.070773 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:08.072624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43567b03-8aab-4947-b62d-402728080f60 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43567b03-8aab-4947-b62d-402728080f60 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:08.074489 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:51:08.075978 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.076872 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 24 01:51:08.078363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.080019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43567b03-8aab-4947-b62d-402728080f60 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.080019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43567b03-8aab-4947-b62d-402728080f60 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.485604 Aug 24 01:51:08.085010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 101/180] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:51:07 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:08.087302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6ac2158-6918-4dfb-8d97-e70485cae6a8 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Calling method '.version_select at 0x7f6b92d9dc10>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.088081 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.088081 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:08.089179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f6ac2158-6918-4dfb-8d97-e70485cae6a8 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6ac2158-6918-4dfb-8d97-e70485cae6a8 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hosts/n-d-854121-3/reboot HTTP/1.1 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:08.092514 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3'} Aug 24 01:51:08.093803 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.094483 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 24 01:51:08.095542 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.098331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6ac2158-6918-4dfb-8d97-e70485cae6a8 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.099663 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f6ac2158-6918-4dfb-8d97-e70485cae6a8 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-854121-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016324 Aug 24 01:51:08.100865 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 80/181] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/n-d-854121-3/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:51:08.110288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e33996f0-0f68-4241-901d-3d2a7529c83e tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Calling method '.version_select at 0x7f6b92c36e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.112209 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.112209 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:08.125473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e33996f0-0f68-4241-901d-3d2a7529c83e tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e33996f0-0f68-4241-901d-3d2a7529c83e tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:08.128750 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'nonexistent_hostname'} Aug 24 01:51:08.129901 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:08.131091 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 01:51:08.132923 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.133944 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.135636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e33996f0-0f68-4241-901d-3d2a7529c83e tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.137940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e33996f0-0f68-4241-901d-3d2a7529c83e tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.031700 Aug 24 01:51:08.139176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 102/182] 10.222.0.49 () {58 vars in 1212 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:08.150671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1107da68-32a7-49f2-9d60-dd6c599b85bd tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Calling method '.version_select at 0x7f6b92d1ae50>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.151737 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.151737 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:08.153882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1107da68-32a7-49f2-9d60-dd6c599b85bd tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1107da68-32a7-49f2-9d60-dd6c599b85bd tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hosts/n-d-854121-3 HTTP/1.1 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:08.156104 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3'} Aug 24 01:51:08.157693 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.158558 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 24 01:51:08.159765 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.161496 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1107da68-32a7-49f2-9d60-dd6c599b85bd tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.162549 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1107da68-32a7-49f2-9d60-dd6c599b85bd tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-854121-3" status: 403 len: 109 microversion: 2.1 time: 0.016117 Aug 24 01:51:08.164421 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 81/183] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/n-d-854121-3 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:08.174366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6d7e43c-5ebc-40e7-a68e-cf0bef01b97b tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Calling method '.version_select at 0x7f6b92d26e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.175577 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.175577 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:08.183506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f6d7e43c-5ebc-40e7-a68e-cf0bef01b97b tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6d7e43c-5ebc-40e7-a68e-cf0bef01b97b tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:08.185747 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'nonexistent_hostname'} Aug 24 01:51:08.187000 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.187815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.189532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.191570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6d7e43c-5ebc-40e7-a68e-cf0bef01b97b tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.192494 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6d7e43c-5ebc-40e7-a68e-cf0bef01b97b tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023203 Aug 24 01:51:08.196129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 103/184] 10.222.0.49 () {58 vars in 1191 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:08.206391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1b7e78f2-8e6e-4d2d-ab93-6f6f985e0f19 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Calling method '.version_select at 0x7f6b92d86c10>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.207849 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.207849 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:08.209493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1b7e78f2-8e6e-4d2d-ab93-6f6f985e0f19 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1b7e78f2-8e6e-4d2d-ab93-6f6f985e0f19 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hosts/n-d-854121-3/shutdown HTTP/1.1 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:08.211505 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3'} Aug 24 01:51:08.212831 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.213665 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 24 01:51:08.214819 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.216779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1b7e78f2-8e6e-4d2d-ab93-6f6f985e0f19 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.217758 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1b7e78f2-8e6e-4d2d-ab93-6f6f985e0f19 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-854121-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.017661 Aug 24 01:51:08.225071 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 82/185] 10.222.0.49 () {58 vars in 1194 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/n-d-854121-3/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:08.252237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cef920f-9795-4864-b573-aee2252130cc tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Calling method '.version_select at 0x7f6b92ba48b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.253917 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.253917 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:08.284078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:08.287853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1cef920f-9795-4864-b573-aee2252130cc tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cef920f-9795-4864-b573-aee2252130cc tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:08.289648 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'nonexistent_hostname'} Aug 24 01:51:08.291200 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:08.292013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 01:51:08.293895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cef920f-9795-4864-b573-aee2252130cc tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cef920f-9795-4864-b573-aee2252130cc tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.067093 Aug 24 01:51:08.297088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 104/186] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:08.301184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-49407848-bb2e-4b67-b447-5c0865dd5bda tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Calling method '.version_select at 0x7f6b92d9d430>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.301987 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.301987 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:08.303078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-49407848-bb2e-4b67-b447-5c0865dd5bda tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-49407848-bb2e-4b67-b447-5c0865dd5bda tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hosts/n-d-854121-3/startup HTTP/1.1 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:08.304620 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3'} Aug 24 01:51:08.305783 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.307033 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 24 01:51:08.308057 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.309815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-49407848-bb2e-4b67-b447-5c0865dd5bda tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.309815 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-49407848-bb2e-4b67-b447-5c0865dd5bda tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-d-854121-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.008634 Aug 24 01:51:08.309815 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 83/187] 10.222.0.49 () {58 vars in 1191 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/n-d-854121-3/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:51:08.323372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c38430c-2bb7-4997-a13b-da3773e21913 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Calling method '.version_select at 0x7f6b92ba49d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.324158 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.324158 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:08.342602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1c38430c-2bb7-4997-a13b-da3773e21913 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c38430c-2bb7-4997-a13b-da3773e21913 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:08.344346 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'nonexistent_hostname'} Aug 24 01:51:08.345817 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:08.346575 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 24 01:51:08.347641 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.348750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.350028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c38430c-2bb7-4997-a13b-da3773e21913 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.351025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c38430c-2bb7-4997-a13b-da3773e21913 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.031548 Aug 24 01:51:08.351795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 105/188] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:08.362613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b64ec11c-1484-468d-825d-8a80765742a2 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92e481f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b64ec11c-1484-468d-825d-8a80765742a2 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-hosts/n-d-854121-3 HTTP/1.1 Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 51 Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:08.367139 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: {"status": "enable", "maintenance_mode": "invalid"} Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.368531 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance: Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.369360 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.370786 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b64ec11c-1484-468d-825d-8a80765742a2 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.371798 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b64ec11c-1484-468d-825d-8a80765742a2 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-854121-3" status: 400 len: 199 microversion: 2.1 time: 0.011056 Aug 24 01:51:08.378696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c1f6765-34cd-4518-9660-2b3027dfe898 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92d7a4c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:08.382227 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 84/189] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:08 2022] PUT /compute/v2.1/os-hosts/n-d-854121-3 => generated 199 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c1f6765-34cd-4518-9660-2b3027dfe898 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/os-hosts/n-d-854121-3 HTTP/1.1 Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 51 Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:08.383551 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: {"status": "invalid", "maintenance_mode": "enable"} Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:08.384940 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'n-d-854121-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance: Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.385752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.387188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.388350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.388350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:51:08.388350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:51:08.388350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 24 01:51:08.388350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.389390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c1f6765-34cd-4518-9660-2b3027dfe898 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.390395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c1f6765-34cd-4518-9660-2b3027dfe898 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-854121-3" status: 400 len: 189 microversion: 2.1 time: 0.016187 Aug 24 01:51:08.391417 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 106/190] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:08 2022] PUT /compute/v2.1/os-hosts/n-d-854121-3 => generated 189 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 01:51:08.402357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bfa1a05b-1c44-427a-b0d1-6dfc6ad1bb15 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Action: 'update', calling method: .version_select at 0x7f6b92e48790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:08.406243 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:08.406243 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:08.407503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bfa1a05b-1c44-427a-b0d1-6dfc6ad1bb15 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7fd33dc1a7554d7eab1c39d22a1d7b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea878ed9c8c42788ca51a1de4bad389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bfa1a05b-1c44-427a-b0d1-6dfc6ad1bb15 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Request method failure captured: Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-hosts/n-d-854121-3 HTTP/1.1 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 50 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQJZusjoWyIUG743-L5fzpvpFnddCBBZsbmcvaBSVyx8FlnW1040VLwtnHhmwKoqs7FNqZq4YYg3jIWn9oA0yAouSYWFLEMn1njPXHXd3Tl_MZGuwVWLjuM5ruju9QEmHvCWHOzo53pBATON6rTJtPs8O2K7KD_R6X1ZjocbYib3bM Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:08.412451 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1ea878ed9c8c42788ca51a1de4bad389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1ea878ed9c8c42788ca51a1de4bad389 Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-678612146 Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7fd33dc1a7554d7eab1c39d22a1d7b6d Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-678612146-project Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 01:51:08.413817 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.414723 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 24 01:51:08.415829 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.416924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bfa1a05b-1c44-427a-b0d1-6dfc6ad1bb15 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.416924 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bfa1a05b-1c44-427a-b0d1-6dfc6ad1bb15 tempest-HostsAdminNegativeTestJSON-678612146 tempest-HostsAdminNegativeTestJSON-678612146-project] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-854121-3" status: 403 len: 111 microversion: 2.1 time: 0.017068 Aug 24 01:51:08.416924 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 85/191] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:08 2022] PUT /compute/v2.1/os-hosts/n-d-854121-3 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:51:08.419082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.419985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:08.425026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01979008-3705-40f5-99fd-d690297049c4 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92d3aca0>, body: {"status": null, "maintenance_mode": null} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01979008-3705-40f5-99fd-d690297049c4 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-hosts/n-d-854121-3 HTTP/1.1 Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 42 Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:08.431486 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: {"status": null, "maintenance_mode": null} Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 01:51:08.433032 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'n-d-854121-3', 'body': {'status': None, 'maintenance_mode': None}} Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'disable', Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'Enable', Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'Disable', Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance: Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi None Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.433774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.435219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01979008-3705-40f5-99fd-d690297049c4 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.436337 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-01979008-3705-40f5-99fd-d690297049c4 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/n-d-854121-3" status: 400 len: 127 microversion: 2.1 time: 0.012114 Aug 24 01:51:08.437679 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 86/192] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:51:08 2022] PUT /compute/v2.1/os-hosts/n-d-854121-3 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:51:08.447404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92d77700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:08.448340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.450687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.450896 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.hosts [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Enabling host nonexistent_hostname. Aug 24 01:51:08.451611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:08.459225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.459631 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.459764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.460146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Request method failure captured: Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 50 Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKPpddgYY1I_3hD7JcgFAJlSIgC1wRBBXF1SydH1C37Vn6m9iys5zMQJz-TbPpHcInQjyzWDwBohDrlpcm4SSZ4sMXxAm8SQ7KQxuOYXebsO1ErxnJUjaQuVhwcejBWqGhXB5vlngn-IIvtx5A93eScEnbl10OApp_olm913wKMDU Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:08.461961 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f2aea99008e475fa952a1f94128fc1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 0f2aea99008e475fa952a1f94128fc1a Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-338900121 Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 7741f26ce7754539bbe3e47d3e9844dd Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HostsAdminNegativeTestJSON-338900121-project-admin Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: {"status": "enable", "maintenance_mode": "enable"} Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.463281 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:08.464147 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:08.465122 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 24 01:51:08.466162 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:08.471090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:08.472168 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-26c5c637-b576-4b54-b6b9-6ef6f37893f0 tempest-HostsAdminNegativeTestJSON-338900121 tempest-HostsAdminNegativeTestJSON-338900121-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028860 Aug 24 01:51:08.472997 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 87/193] 10.222.0.49 () {60 vars in 1211 bytes} [Wed Aug 24 01:51:08 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:08.596394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.596394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:08.618898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.622823 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.625150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:08.626901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.629787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.630503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:08.770494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.792688 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-132da459-f8d1-4bef-9183-295c6b26050e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1273 microversion: 2.1 time: 0.201242 Aug 24 01:51:08.801656 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 88/194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:08.841678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:08.850570 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-faad40ed-11b4-49e4-9ed9-ff9ee77e8d93 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.449693 Aug 24 01:51:08.853151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 107/195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:08.857734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:08.858336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:08.874180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.874902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.875887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:08.877510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:08.878458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:08.880112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.143447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.153584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09ae9f71-f99c-481d-a984-fd59eeaa78e8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.299400 Aug 24 01:51:09.158280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 108/196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:09.318263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd82e073-a24c-4f5a-beee-55cafa350841 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Calling method '.version_select at 0x7f6b92e368b0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.319356 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.319356 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:09.320750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bd82e073-a24c-4f5a-beee-55cafa350841 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd7d9a88131fa4d539c7c80d6c5018fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b087add60aa4373a043282bb21956a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd82e073-a24c-4f5a-beee-55cafa350841 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Request method failure captured: Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKE17gW98INsEoVi0Oczy6zaQA3YqU_vvrNpqx679S11HxWGYPH7psJ6hCXliVDmXGHIzyUKdncc-0R8ESaEDZghiX_IcLCwoy24P4j6Qo61OOnkrtdQG6-qbOt0QV8_aACAnrM2Omfz9Aza0Ew1ELG9lMWSUgrB4JmmsOrhmFRHQ Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:09.322634 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b087add60aa4373a043282bb21956a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b087add60aa4373a043282bb21956a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d7d9a88131fa4d539c7c80d6c5018fa5 Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: action_args: {} Aug 24 01:51:09.323766 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:09.324476 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 24 01:51:09.325580 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.326557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd82e073-a24c-4f5a-beee-55cafa350841 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.326557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bd82e073-a24c-4f5a-beee-55cafa350841 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.520898 Aug 24 01:51:09.326557 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 89/197] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:51:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 522 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:09.339036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af457a8e-4a7d-4977-9909-2ce85c7beea9 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Calling method '.version_select at 0x7f6b92ba69d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.339982 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.339982 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:09.341224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af457a8e-4a7d-4977-9909-2ce85c7beea9 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd7d9a88131fa4d539c7c80d6c5018fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b087add60aa4373a043282bb21956a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af457a8e-4a7d-4977-9909-2ce85c7beea9 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Request method failure captured: Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQKE17gW98INsEoVi0Oczy6zaQA3YqU_vvrNpqx679S11HxWGYPH7psJ6hCXliVDmXGHIzyUKdncc-0R8ESaEDZghiX_IcLCwoy24P4j6Qo61OOnkrtdQG6-qbOt0QV8_aACAnrM2Omfz9Aza0Ew1ELG9lMWSUgrB4JmmsOrhmFRHQ Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:09.345748 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b087add60aa4373a043282bb21956a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b087add60aa4373a043282bb21956a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d7d9a88131fa4d539c7c80d6c5018fa5 Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:51:09.346992 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:09.347658 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 24 01:51:09.348609 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.349615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af457a8e-4a7d-4977-9909-2ce85c7beea9 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.351803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af457a8e-4a7d-4977-9909-2ce85c7beea9 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.019869 Aug 24 01:51:09.352706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 109/198] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:09.371964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d5d7039-6fd0-4c6d-8331-e874814f76e5 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Calling method '.version_select at 0x7f6b92cdcb80>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.374026 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.374026 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:09.375156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3d5d7039-6fd0-4c6d-8331-e874814f76e5 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd7d9a88131fa4d539c7c80d6c5018fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b087add60aa4373a043282bb21956a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d5d7039-6fd0-4c6d-8331-e874814f76e5 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Request method failure captured: Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKE17gW98INsEoVi0Oczy6zaQA3YqU_vvrNpqx679S11HxWGYPH7psJ6hCXliVDmXGHIzyUKdncc-0R8ESaEDZghiX_IcLCwoy24P4j6Qo61OOnkrtdQG6-qbOt0QV8_aACAnrM2Omfz9Aza0Ew1ELG9lMWSUgrB4JmmsOrhmFRHQ Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:09.376756 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b087add60aa4373a043282bb21956a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b087add60aa4373a043282bb21956a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d7d9a88131fa4d539c7c80d6c5018fa5 Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: action_args: {} Aug 24 01:51:09.377886 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:09.378649 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 24 01:51:09.379629 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.380507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d5d7039-6fd0-4c6d-8331-e874814f76e5 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.380507 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3d5d7039-6fd0-4c6d-8331-e874814f76e5 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020004 Aug 24 01:51:09.384264 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 90/199] 10.222.0.49 () {58 vars in 1179 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:51:09.587526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Calling method '.version_select at 0x7f6b92c82b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.591023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.591798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.593279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.631309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.633157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.633939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.648584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.649207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.649831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.656804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a952ca85-d76b-44f5-ac48-1689948e6689 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.272724 Aug 24 01:51:09.658132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 110/200] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:09.671434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a2e8d9bb-95c7-4ced-ab32-2de72f60bcff tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Calling method '.version_select at 0x7f6b92f5ff70>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.673215 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.673215 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:09.675043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a2e8d9bb-95c7-4ced-ab32-2de72f60bcff tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd7d9a88131fa4d539c7c80d6c5018fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b087add60aa4373a043282bb21956a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a2e8d9bb-95c7-4ced-ab32-2de72f60bcff tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Request method failure captured: Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKE17gW98INsEoVi0Oczy6zaQA3YqU_vvrNpqx679S11HxWGYPH7psJ6hCXliVDmXGHIzyUKdncc-0R8ESaEDZghiX_IcLCwoy24P4j6Qo61OOnkrtdQG6-qbOt0QV8_aACAnrM2Omfz9Aza0Ew1ELG9lMWSUgrB4JmmsOrhmFRHQ Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:09.678463 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b087add60aa4373a043282bb21956a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b087add60aa4373a043282bb21956a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d7d9a88131fa4d539c7c80d6c5018fa5 Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '1'} Aug 24 01:51:09.679985 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:09.680949 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 24 01:51:09.682143 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.686303 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a2e8d9bb-95c7-4ced-ab32-2de72f60bcff tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.689871 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a2e8d9bb-95c7-4ced-ab32-2de72f60bcff tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014762 Aug 24 01:51:09.705364 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 91/201] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:09.717495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5315d62e-f5c9-41a4-9ae8-89495d36b5a5 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Calling method '.version_select at 0x7f6b92ba6d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.718764 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.718764 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:09.720623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5315d62e-f5c9-41a4-9ae8-89495d36b5a5 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] HTTP exception thrown: Hypervisor with ID '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' could not be found. Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5315d62e-f5c9-41a4-9ae8-89495d36b5a5 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Request method failure captured: Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/09fd00c6-1fbf-4096-a069-5144c9ff3ae5/uptime HTTP/1.1 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQM-_mrJsas0B_0Cw5-Sk4U0BrxhIePPErshEKE7C3vqtluXLgJsKBSZNm-3nfYAfMgNhBjCXSeuk7LzvwftcHR6ElESrh_FvKZ1w8DWITrWEH0uirYmHCK2fBsx2-bmyWeciG_pYtv43jPvx5gRk43ODgO8A0mL55I3e30KMbSxCg Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e0b2c33d91dd47cdb886d45d0c09a037 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:09.733812 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e0b2c33d91dd47cdb886d45d0c09a037 Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 592c6dbc160541028af7018c501fbece Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: exception: Hypervisor with ID '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' could not be found. Aug 24 01:51:09.735078 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '09fd00c6-1fbf-4096-a069-5144c9ff3ae5'} Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 01:51:09.735802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' could not be found. Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.738127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' could not be found. Aug 24 01:51:09.741381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.744911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5315d62e-f5c9-41a4-9ae8-89495d36b5a5 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Returning 404 to user: Hypervisor with ID '09fd00c6-1fbf-4096-a069-5144c9ff3ae5' could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.747518 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5315d62e-f5c9-41a4-9ae8-89495d36b5a5 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/09fd00c6-1fbf-4096-a069-5144c9ff3ae5/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036314 Aug 24 01:51:09.756374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 111/202] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors/09fd00c6-1fbf-4096-a069-5144c9ff3ae5/uptime => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:09.758940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Calling method '.version_select at 0x7f6b92d86ca0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.759732 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.759732 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:09.761260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.761732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.762311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.789958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.790468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.793176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.820887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.821550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.824318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.824984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.825833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:09.836982 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8efe2758-e9fc-461a-897b-abca98a301ff tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.081256 Aug 24 01:51:09.837926 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 92/203] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:51:09.845000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.848933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b1a1feda-ad5f-4b75-9cd3-a24ae1b97776 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Calling method '.version_select at 0x7f6b92e83280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.849948 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:09.849948 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:09.851289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.851710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b1a1feda-ad5f-4b75-9cd3-a24ae1b97776 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd7d9a88131fa4d539c7c80d6c5018fa5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b087add60aa4373a043282bb21956a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.852578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b1a1feda-ad5f-4b75-9cd3-a24ae1b97776 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Request method failure captured: Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQKE17gW98INsEoVi0Oczy6zaQA3YqU_vvrNpqx679S11HxWGYPH7psJ6hCXliVDmXGHIzyUKdncc-0R8ESaEDZghiX_IcLCwoy24P4j6Qo61OOnkrtdQG6-qbOt0QV8_aACAnrM2Omfz9Aza0Ew1ELG9lMWSUgrB4JmmsOrhmFRHQ Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:09.853930 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b087add60aa4373a043282bb21956a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b087add60aa4373a043282bb21956a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b087add60aa4373a043282bb21956a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9b087add60aa4373a043282bb21956a6 Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739 Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d7d9a88131fa4d539c7c80d6c5018fa5 Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1447675739-project Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '1'} Aug 24 01:51:09.855226 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:09.856051 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 24 01:51:09.857242 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:09.859814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b1a1feda-ad5f-4b75-9cd3-a24ae1b97776 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:09.861817 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b1a1feda-ad5f-4b75-9cd3-a24ae1b97776 tempest-HypervisorAdminNegativeTestJSON-1447675739 tempest-HypervisorAdminNegativeTestJSON-1447675739-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017182 Aug 24 01:51:09.862447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.863291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.863948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.876687 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 93/204] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:09.890432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:09.892569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:09.906334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.911786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.913067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.913960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:09.914560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:09.916844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:09.985961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:09.996424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8df44144-ed4a-4af2-8f9d-d41b620d4e8b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1271 microversion: 2.1 time: 0.180372 Aug 24 01:51:09.997977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 112/205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:10.022908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a038e456-f163-455e-ad28-7bf9504cb900 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Calling method '.version_select at 0x7f6b92ba6700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:10.023806 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:10.023806 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:10.024690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a038e456-f163-455e-ad28-7bf9504cb900 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] HTTP exception thrown: Hypervisor with ID 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' could not be found. Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a038e456-f163-455e-ad28-7bf9504cb900 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Request method failure captured: Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/aca6207a-54bb-44fe-94aa-ebf3610cbfe7 HTTP/1.1 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQM-_mrJsas0B_0Cw5-Sk4U0BrxhIePPErshEKE7C3vqtluXLgJsKBSZNm-3nfYAfMgNhBjCXSeuk7LzvwftcHR6ElESrh_FvKZ1w8DWITrWEH0uirYmHCK2fBsx2-bmyWeciG_pYtv43jPvx5gRk43ODgO8A0mL55I3e30KMbSxCg Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e0b2c33d91dd47cdb886d45d0c09a037 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:10.026390 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e0b2c33d91dd47cdb886d45d0c09a037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e0b2c33d91dd47cdb886d45d0c09a037 Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-534930542 Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 592c6dbc160541028af7018c501fbece Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: exception: Hypervisor with ID 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' could not be found. Aug 24 01:51:10.027518 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7'} Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 24 01:51:10.028147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:51:10.029286 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' could not be found. Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' could not be found. Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:10.030330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a038e456-f163-455e-ad28-7bf9504cb900 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] Returning 404 to user: Hypervisor with ID 'aca6207a-54bb-44fe-94aa-ebf3610cbfe7' could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:10.033640 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a038e456-f163-455e-ad28-7bf9504cb900 tempest-HypervisorAdminNegativeTestJSON-534930542 tempest-HypervisorAdminNegativeTestJSON-534930542-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/aca6207a-54bb-44fe-94aa-ebf3610cbfe7" status: 404 len: 123 microversion: 2.1 time: 0.034347 Aug 24 01:51:10.034199 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 113/206] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/os-hypervisors/aca6207a-54bb-44fe-94aa-ebf3610cbfe7 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:10.181692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:10.182319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:10.196372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:10.199078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:10.199550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:10.200584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:10.200754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:10.203358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:10.400947 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:10.410617 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-47e615bd-b4ce-419c-86a6-29573ddaa64f tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.531345 Aug 24 01:51:10.416128 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 94/207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:09 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:10.745466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:10.754089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-586b8b61-cb38-4f7e-b981-62995dd51327 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.577966 Aug 24 01:51:10.762282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 114/208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:10 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:11.023892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:11.025465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:11.038100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.038965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.040016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:11.042803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.043537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.044184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:11.340908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:11.353112 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec4c9aa0-9724-4371-bbde-f8dd28f747ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.337368 Aug 24 01:51:11.354955 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 95/209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:11 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:11.438327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:11.440356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:11.451169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.453280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.455335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:11.456734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.457418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.458173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:11.783551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:11.784164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:11.797004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.801879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.802405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:11.803142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:11.803617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:11.806148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.020738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:12.034667 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-313baa06-87cb-4673-b614-90c4f0882c92 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.252156 Aug 24 01:51:12.051382 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 96/210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:11 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:12.297144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:12.301067 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:12.301067 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:12.302755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.304052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.304645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.305611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.306214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.306780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.331295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:12.342068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41ad6d20-c74f-4998-9d55-53e3eae7ba66 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.909036 Aug 24 01:51:12.344058 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f822fb02-7a4f-4402-b0fd-014d76992c18 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.291419 Aug 24 01:51:12.345166 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 97/211] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:51:12 2022] GET /compute/v2.1/os-services => generated 966 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:12.350260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:12.364754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 115/212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:11 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:12.369996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:12.374295 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:12.374295 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:12.377538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.378019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.378153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.378765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.379349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.379785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.384457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.385197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.385640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.392576 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] Creating event network-changed:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h2-854121-3 Aug 24 01:51:12.398646 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-56ec4fc7-7641-4494-8bcc-1d271d42b8d3 req-81e71318-d864-4094-adb9-96f33fca706e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051820 Aug 24 01:51:12.399545 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 98/213] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:12.405698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:12.406606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:12.421168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.422254 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.424436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.425452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.426547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.427830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.430803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-665e6c7a-e47d-4980-a2e7-a4b8e6adbcbd tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-854121-3" status: 200 len: 578 microversion: 2.1 time: 0.072029 Aug 24 01:51:12.432528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 116/214] 10.222.0.49 () {58 vars in 1172 bytes} [Wed Aug 24 01:51:12 2022] GET /compute/v2.1/os-services?host=n-d-854121-3 => generated 578 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:12.446479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:12.450983 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:12.450983 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:12.452966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.453630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.454326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.456072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.457574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.458278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.580567 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fa75fda-42b6-44a4-b685-831e0a0b7d53 tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.134825 Aug 24 01:51:12.581753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 117/215] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:51:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:12.593984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:12.597086 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:12.597086 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:12.598503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.599140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.599724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.600984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:12.602160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:12.602740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:12.640033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48d48e3b-b60b-42cf-a318-25491615f92d tempest-ServicesAdminTestJSON-660362059 tempest-ServicesAdminTestJSON-660362059-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.049819 Aug 24 01:51:12.648260 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 118/216] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:51:12 2022] GET /compute/v2.1/os-services => generated 966 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:12.777767 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:12.788398 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-be0839f4-60ed-4e48-8950-58dd0abc2217 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.387316 Aug 24 01:51:12.794120 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 99/217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:12 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:13.061016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:13.061624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:13.070195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.077825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.078560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.079973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.080574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.081197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.382601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:13.384024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:13.402248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.404125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.405261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.408634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.409366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.410865 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.485934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:13.495234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efb9bb3d-d308-42e0-bde2-130d284e7214 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.439503 Aug 24 01:51:13.496530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 119/218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:13 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:13.823702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:13.824706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:13.836465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.838232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.844482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.845657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:13.846280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:13.847610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:13.965058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:13.979218 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1598babe-cb2b-48aa-be56-1db22765ce0c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.602154 Aug 24 01:51:13.979812 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 100/219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:13 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:14.079126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:14.088992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4358b5ab-0076-4e91-887c-6d175c4e799a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.269897 Aug 24 01:51:14.121713 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 120/220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:13 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:14.234140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada1ef2c-8c41-4c86-b83d-9e73ee648461", "name": "network-vif-plugged", "status": "completed", "tag": "04666f5b-1038-440f-882a-bd38e1621401"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:14.262796 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:14.263276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:14.263704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:14.277064 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] Creating event network-vif-plugged:04666f5b-1038-440f-882a-bd38e1621401 for instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 on n-h2-854121-3 Aug 24 01:51:14.287261 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-60f1bef4-53ab-4c43-afb6-27b3d942b002 req-921f0644-faef-4752-a124-291c817ac5a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297794 Aug 24 01:51:14.288333 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 101/221] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:14.519452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:14.521637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:14.529842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:14.530842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:14.531492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:14.533195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:14.533883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:14.534952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:14.731599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:14.741080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-306600d1-c298-4897-94fb-da6ff55822a1 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.228364 Aug 24 01:51:14.741685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 121/222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:14 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:15.004874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:15.005851 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:15.021725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.022430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.022916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.023682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.024142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.024568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.115182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:15.116031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:15.122725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.123539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.124252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.125642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.126900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.127672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.171248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:15.335450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=10 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:15.431780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:15.443557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0412bf57-a36f-43eb-bd48-f8bb871b3235 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.446242 Aug 24 01:51:15.448299 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 102/223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:14 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:15.461122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:15.471016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80ea2556-77ea-4bab-906f-fdba20d23c1e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.359556 Aug 24 01:51:15.472213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 122/224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:15 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:15.763975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:15.764985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:15.776911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.781336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.782061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.784596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:15.786869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:15.788788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:15.982778 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:16.199649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:16.216087 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-142d0e83-8ab9-42b7-bece-4f993f0a4d58 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.457023 Aug 24 01:51:16.220062 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 103/225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:15 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:16.340091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:16.472536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:16.473191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:16.488248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:16.490145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:16.490977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:16.493006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:16.499073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfd6ae4d-bcd3-426d-8c71-181e0dccb835 tempest-InstanceUsageAuditLogTestJSON-805736665 tempest-InstanceUsageAuditLogTestJSON-805736665-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:16.500127 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:16.500127 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:16.506450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:16.507488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:16.568120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfd6ae4d-bcd3-426d-8c71-181e0dccb835 tempest-InstanceUsageAuditLogTestJSON-805736665 tempest-InstanceUsageAuditLogTestJSON-805736665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 01:51:16" status: 200 len: 318 microversion: 2.1 time: 0.232942 Aug 24 01:51:16.572031 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 123/226] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 01:51:16 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2001%3A51%3A16 => generated 318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:16.576945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:16.581896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:16.598987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:16.599708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:16.600293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:16.601216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:16.601888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:16.603146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:16.772494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:16.787996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-548fe6d2-4a2b-456c-9765-aa35c63257fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.214603 Aug 24 01:51:16.806537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 124/227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:16 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:16.811860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cb7a8f2-6386-4551-bb8b-153c76751eff tempest-InstanceUsageAuditLogTestJSON-805736665 tempest-InstanceUsageAuditLogTestJSON-805736665-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:16.813023 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:16.813023 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:16.839369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cb7a8f2-6386-4551-bb8b-153c76751eff tempest-InstanceUsageAuditLogTestJSON-805736665 tempest-InstanceUsageAuditLogTestJSON-805736665-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030164 Aug 24 01:51:16.840850 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 125/228] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:51:16 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:16.859759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:16.873552 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ea890105-3ca3-496a-8ec8-fba8c48d7b2c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1319 microversion: 2.1 time: 0.405374 Aug 24 01:51:16.875919 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 104/229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:16 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1319 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:17.246905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:17.247591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:17.257266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:17.257754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:17.258181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:17.258872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:17.259313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:17.259732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:17.445843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b18df3-c86a-4d5a-8d28-953f8387f7ee", "name": "network-vif-plugged", "status": "completed", "tag": "247757db-32b8-4c79-bf0b-653cfda163d9"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:17.465317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:17.467970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:17.468594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:17.494676 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] Creating event network-vif-plugged:247757db-32b8-4c79-bf0b-653cfda163d9 for instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee on n-h1-854121-3 Aug 24 01:51:17.511251 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-4e1a5ff4-f31d-4d08-87df-7ff814c8bcd7 req-ab362410-ddff-4f3a-b192-51307b9a4d87 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071099 Aug 24 01:51:17.512575 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 105/230] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:18.349646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e0aa3fe6-e334-4f5e-b781-138c25cd4c4a tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:18.371788 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e0aa3fe6-e334-4f5e-b781-138c25cd4c4a tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.740608 Aug 24 01:51:18.381933 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 106/231] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:51:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:18.419187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:18.420255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:18.448239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:18.453252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:18.454412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:18.455439 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:18.457580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:18.460580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:18.537119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:18.550580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23261907-1025-4a13-a563-97fba0241fed tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 1.314347 Aug 24 01:51:18.563785 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 126/232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:17 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:18.563785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:18.563785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:18.569592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:18.570089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:18.570787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:18.571489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:18.571940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:18.572629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:18.799999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:18.809263 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-919d851c-14ba-49d1-a273-160f98663c6b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.418359 Aug 24 01:51:18.809838 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 107/233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:18 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:18.931239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1922650987", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:19.024157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:19.207510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:19.223690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f02fd66-aba1-47cb-ba21-835e2424f9e6 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1468 microversion: 2.1 time: 0.671095 Aug 24 01:51:19.246694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 127/234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:18 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1468 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:19.342319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:19.343429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:19.344155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:19.346677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:19.347742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:19.366450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.369956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.371409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:19.376789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.377514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.378008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:19.422332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Getting quotas for project c417d3076cb7493eb2faebbad91ac38d. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:19.433416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Getting quotas for user e0e6c635ba444a0c8cc501127d819774 and project c417d3076cb7493eb2faebbad91ac38d. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:19.453728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:19.457219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:19.529057 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-48bb8335-0dd2-4a18-bd62-0d864e61a35f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712680 Aug 24 01:51:19.530890 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 108/235] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:19.543580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-86470b1b-3f06-4e1a-bd57-16f0714e72e1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:19.544776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-86470b1b-3f06-4e1a-bd57-16f0714e72e1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:19.675721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-86470b1b-3f06-4e1a-bd57-16f0714e72e1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:19.676332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:19.677189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:19.690845 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-86470b1b-3f06-4e1a-bd57-16f0714e72e1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1219 microversion: 2.1 time: 0.153454 Aug 24 01:51:19.691465 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 109/236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:19 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:19.693307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.693856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.694288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:19.695026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.697816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.698263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:19.731481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:19.738208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:19.804626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.806873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.807334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:19.808077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:19.815417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:19.815605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.024220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:51:20.331750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a79e1647-fa7b-4059-9429-d3ef81adc3b8 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 204 len: 0 microversion: 2.1 time: 1.081405 Aug 24 01:51:20.332798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 128/237] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:51:19 2022] DELETE /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:51:20.340933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:20.341648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:20.349084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.349669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.350362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.351408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.352123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.352752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.409507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:20.417264 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8d4b2a43-9ba1-46e3-8e07-9bd6c5414202 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1339 microversion: 2.1 time: 0.708303 Aug 24 01:51:20.418740 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 110/238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:19 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1339 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:20.435900 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-166374303", "imageRef": "51fc1f6c-fe1f-4f3a-a828-3a2129ad6f68", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:20.537446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:20.694338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:20.710924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40032612-39f9-4914-80e0-6547546ce279 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.375500 Aug 24 01:51:20.714821 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 129/239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:20 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:20.723987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:20.726766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:20.746269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.747052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.747661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.748369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.748851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.749264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.866706 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] Request method failure captured: Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 142 Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQVaVY7fO2jdsvrUbvSWhRxxDxhGoI7hBDwgFtXwFJPywX13aJkU71FyEOJ64wtm-Z7mX7Niu5YVobLriUr6BOU17f10PfYJ7u9DRRq-Ap1koWUVjc1qpeUTG_S5sYcTkyUF7dRSdIgnwVNgxDVoaOFG0F-2Bl-rQPkW7X6s4vTvjA Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 8b2f0a40b485497188fb881e39024dbb Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsV2NegativeTest-1472921459 Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:20.869300 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b2f0a40b485497188fb881e39024dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2f0a40b485497188fb881e39024dbb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b2f0a40b485497188fb881e39024dbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b2f0a40b485497188fb881e39024dbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsV2NegativeTest-1472921459 Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 8b2f0a40b485497188fb881e39024dbb Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1472921459 Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsV2NegativeTest-1472921459-project Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d21a21d51eed4a2091a148b5544811a2 Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsV2NegativeTest-1472921459-project Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-166374303", "imageRef": "51fc1f6c-fe1f-4f3a-a828-3a2129ad6f68", "flavorRef": "452"}} Aug 24 01:51:20.870652 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: exception: Flavor's memory is too small for requested image. Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-166374303', 'imageRef': '51fc1f6c-fe1f-4f3a-a828-3a2129ad6f68', 'flavorRef': '452'}}} Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:20.871401 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:20.872811 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:20.876405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:20.877462 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7a10ff3c-bf5b-4703-9fbc-02765ef95e56 tempest-FlavorsV2NegativeTest-1472921459 tempest-FlavorsV2NegativeTest-1472921459-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.456014 Aug 24 01:51:20.880930 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 111/240] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:20 2022] POST /compute/v2.1/servers => generated 93 bytes in 460 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:51:20.891363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:20.894911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:20.902533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.903822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.904264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.905599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:20.906067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:20.906498 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:20.991170 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:21.014058 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2b990a0f-9fab-409a-9225-083f89993e0b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1293 microversion: 2.1 time: 0.131705 Aug 24 01:51:21.015899 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 112/241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:20 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:21.056863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:21.075164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed99d4bb-a9ce-4fc4-a388-bc1816395dca tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1474 microversion: 2.1 time: 0.358972 Aug 24 01:51:21.075753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 130/242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:20 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1474 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:21.440376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:21.441045 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:21.453296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:21.454868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:21.455337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:21.456071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:21.463470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:21.467069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:21.739414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:21.740279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:21.763066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:21.764658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:21.769680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:21.770738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:21.771733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:21.774260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.175722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:22.183524 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4329a7aa-183c-4c26-80bf-7bdc9f9e7573 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1489 microversion: 2.1 time: 0.748688 Aug 24 01:51:22.184093 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 113/243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:21 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1489 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:22.201355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:22.201980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:22.231858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.232360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.232822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.239194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.239942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.240535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.396449 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:22.404348 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b7bb4583-4c5d-44b0-8a7b-31c3c249645f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1299 microversion: 2.1 time: 0.209137 Aug 24 01:51:22.409226 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 114/244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:22 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:22.414096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "name": "network-vif-plugged", "status": "completed", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:22.440881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.444285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.445114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.472282 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] Creating event network-vif-plugged:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h2-854121-3 Aug 24 01:51:22.490035 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-a49055f8-697e-41d0-882a-1b3de4057726 req-d309d45f-ff34-40b6-a9b1-7141d0f9bbcf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079445 Aug 24 01:51:22.490764 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 115/245] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:22.503653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:22.504386 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:22.519264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.519775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.520215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.523742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.524413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.525036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.614967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:22.689507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:22.700218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6eb0749-967d-4758-886f-2acc809892cc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.967362 Aug 24 01:51:22.700870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 131/246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:21 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:22.712462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:22.714633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:22.730515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.731445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.733742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.735821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:22.736487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:22.738304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:22.980658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:22.989918 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-706c8533-fbd4-4151-81c4-0bd5bd94b4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1474 microversion: 2.1 time: 0.497181 Aug 24 01:51:22.990504 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 116/247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:22 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1474 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:23.430355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:23.431608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:23.441330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:23.441838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:23.442288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:23.442996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:23.443454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:23.443882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:23.763778 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:23.775849 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-febda749-15f7-4163-8557-cc20397a1864 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1341 microversion: 2.1 time: 0.349089 Aug 24 01:51:23.776614 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 117/248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:23 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1341 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:23.995264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-420c54a3-e662-46ad-8d79-c715f6386268 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1640 microversion: 2.1 time: 1.292011 Aug 24 01:51:24.008899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 132/249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:22 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1640 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:24.029755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:24.030372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:24.036431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92d3a0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:24.051598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.052089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.052783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.053657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.054444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.055177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.150116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.150606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.159016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.159846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.162188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.162633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.288638 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a6474a78-484e-4348-b278-efe8fbffecb7 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e" status: 200 len: 148 microversion: 2.57 time: 0.509422 Aug 24 01:51:24.290276 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 118/250] 10.222.0.49 () {62 vars in 1303 bytes} [Wed Aug 24 01:51:23 2022] PUT /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e => generated 148 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:24.298784 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:24.299593 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:24.315043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.315930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.316606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.317593 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.318176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.318755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.618679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:24.638201 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-281de5f5-1d66-4366-a915-594a8aee8c5c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1432 microversion: 2.1 time: 0.342104 Aug 24 01:51:24.639496 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 119/251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:24 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1432 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:24.648624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:24.652791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:24.674216 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.674939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.675862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.678235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:24.679829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:24.681894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:24.740564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:51:24.848536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:24.858681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-141a9087-2040-45b4-b7c5-15b4fd3690f1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1313 microversion: 2.1 time: 0.840464 Aug 24 01:51:24.869258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 133/252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:24 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1313 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:24.873546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Calling method '.version_select at 0x7f6b92ac2dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:25.035231 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c753aaca-cce4-48b8-8185-e26e65d61edb tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 204 len: 0 microversion: 2.1 time: 0.393540 Aug 24 01:51:25.036399 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 120/253] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:51:24 2022] DELETE /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:51:25.043393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada1ef2c-8c41-4c86-b83d-9e73ee648461", "name": "network-vif-deleted", "tag": "04666f5b-1038-440f-882a-bd38e1621401"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:25.064703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:25.078493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.079672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.080109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.103938 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] Creating event network-vif-deleted:04666f5b-1038-440f-882a-bd38e1621401 for instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 on n-h2-854121-3 Aug 24 01:51:25.111911 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-8ed03c1f-530a-4f01-9da7-254a81c3724a req-316ee57f-13c1-465c-89ff-84b4e4ac54a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071883 Aug 24 01:51:25.112790 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 121/254] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:25.118791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:25.119367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:25.143143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.145184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.148239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.150320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.150811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.151252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.277768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.278280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.278798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.279584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.280284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.280945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.313194 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de186c7f-dd6c-4f14-9278-49f54e0ff49e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e/detail" status: 200 len: 463 microversion: 2.57 time: 0.452793 Aug 24 01:51:25.314200 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 134/255] 10.222.0.49 () {60 vars in 1304 bytes} [Wed Aug 24 01:51:24 2022] GET /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e/detail => generated 463 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:25.325933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e5d3bd-0700-4039-82f9-aabfba7bf280", "tag": "54c813f2-14b4-4fdd-a5d4-e7577be462d2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:25.339893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.340703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.341419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.354951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] Creating event network-changed:54c813f2-14b4-4fdd-a5d4-e7577be462d2 for instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 on n-h1-854121-3 Aug 24 01:51:25.361355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ae188995-6c47-4d69-a17b-8440d06861ba req-c9ab805a-894f-4b69-b69f-448ab4c4044d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045707 Aug 24 01:51:25.362297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 135/256] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:25.368544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:25.369834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:25.385569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.386530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.387202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.388169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.388889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.389518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.674691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:25.684053 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5f33ce4b-f45d-4f5a-a9e0-940026453335 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1341 microversion: 2.1 time: 0.569875 Aug 24 01:51:25.693083 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 122/257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:25 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1341 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:25.708040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:25.708658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:25.734191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.737791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.740076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.743308 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.743308 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.743632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.799942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.800932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.801534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.802205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lazy-loading 'fault' on Instance uuid ada1ef2c-8c41-4c86-b83d-9e73ee648461 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:25.807749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:25.819783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09efd518-6230-4a2d-a193-e360b1ee4dff tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1495 microversion: 2.1 time: 0.456068 Aug 24 01:51:25.821867 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 136/258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:25 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1495 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:25.831034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Action: 'update', calling method: .version_select at 0x7f6b991c0820>, body: {"quota_set": {"ram": "2048"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:25.946011 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:25.957671 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0bf98caa-0892-46cc-ae97-f9f306fd1152 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 200 len: 1309 microversion: 2.1 time: 0.263237 Aug 24 01:51:25.972745 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 123/259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:25 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:25.978511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:25.979126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:25.986465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.987334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.987921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:25.988964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:25.989679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:25.990256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.020398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.021505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.023447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.025102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:26.025555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.026119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.027150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.103247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.104023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.104650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.105585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.106197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.106888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.198768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b6cdc15-eb23-48e2-9d35-3864de199e2e tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e?user_id=c7141f6d9b4f4efdbc8101fae6a84fb7" status: 200 len: 148 microversion: 2.57 time: 0.374815 Aug 24 01:51:26.199695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 137/260] 10.222.0.49 () {62 vars in 1384 bytes} [Wed Aug 24 01:51:25 2022] PUT /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e?user_id=c7141f6d9b4f4efdbc8101fae6a84fb7 => generated 148 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:51:26.212067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb96fcd-523a-4b3d-b59b-0b270c290406 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] Calling method '.version_select at 0x7f6b9824ff70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:26.329712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:26.341055 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a5fabb47-f059-427a-b841-0834b92fb503 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1462 microversion: 2.1 time: 0.366579 Aug 24 01:51:26.342220 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 124/261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:25 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1462 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:26.350067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeb96fcd-523a-4b3d-b59b-0b270c290406 tempest-QuotasAdminTestV257-424101248 tempest-QuotasAdminTestV257-424101248-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e?user_id=c7141f6d9b4f4efdbc8101fae6a84fb7" status: 200 len: 190 microversion: 2.57 time: 0.141879 Aug 24 01:51:26.357132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 138/262] 10.222.0.49 () {60 vars in 1364 bytes} [Wed Aug 24 01:51:26 2022] GET /compute/v2.1/os-quota-sets/0f02d7379fe0415f8c126a3a1513b13e?user_id=c7141f6d9b4f4efdbc8101fae6a84fb7 => generated 190 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:51:26.444306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1838006346", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "0c6330be-cca7-4bf4-967a-c3f5a62fa964"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:26.569367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] validate_networks() for [('0c6330be-cca7-4bf4-967a-c3f5a62fa964', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:26.661555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:26.662421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:26.666335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:26.670696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.671438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.672036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:26.673670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:26.674294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:26.675545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.635821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:27.646221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:27.648849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:27.650354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:27.652179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:27.657809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0f68a02-b85e-4ba4-8426-eea53e375513 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1613 microversion: 2.1 time: 1.299049 Aug 24 01:51:27.658388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 139/263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:26 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1613 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:27.668395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:27.669381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:27.681993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.684063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.685293 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.686865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.687368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.687834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.688547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.689067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.689495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.689932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.692261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.692754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.718370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=13 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:27.756230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:27.763526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for user 6223af42e4e34d7cb4f327824ac148af and project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:27.780230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:27.791755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:27.902060 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c1dad7c7-a3fb-4a63-af88-5412ded73d66 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.558522 Aug 24 01:51:27.905478 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 125/264] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:51:27.949422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:27.950466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:27.961447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.961982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.962578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:27.963413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:27.964246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:27.964856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.075635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.119265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db8d2c9b-30e8-46c3-abdd-8c6827f82aa3 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1341 microversion: 2.1 time: 0.451895 Aug 24 01:51:28.127968 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 140/265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:27 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1341 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:28.166738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:28.171136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:28.177827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.191693 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7c0f068e-b766-44bd-84db-e9c82e6e5d1a tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1453 microversion: 2.1 time: 0.280523 Aug 24 01:51:28.192302 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 126/266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:27 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1453 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:28.204049 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:28.206556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:28.206699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.211047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.222588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.224742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.225296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.225813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.226319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.227180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.234105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.236475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.238061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.238666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.275835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 HTTP/1.1 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:28.278892 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:51:28.280117 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ada1ef2c-8c41-4c86-b83d-9e73ee648461'} Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:28.280877 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:51:28.282646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:28.286776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:28.286776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bc81b8d-e307-4870-9d0e-a28afb71147d tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 404 len: 111 microversion: 2.1 time: 0.151030 Aug 24 01:51:28.286776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 141/267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:28 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:28.307651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:28.308165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:28.474459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.480524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '714604146ea24ed6a1be55a4c1ef50a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24eff4cc6b584b03a5964b39852a8214', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.481734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: c590b19d-c876-47a0-8261-444f49717dea] flavor_id is None. Assuming migration. {{(pid=128566) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 01:51:28.482374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: c590b19d-c876-47a0-8261-444f49717dea] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128566) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 01:51:28.489859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.493743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:28.497410 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-324a9c00-621b-4e65-958a-cbc8640c6dbe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1262 microversion: 2.25 time: 0.214474 Aug 24 01:51:28.498249 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 142/268] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:28 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1262 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:28.560397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b18df3-c86a-4d5a-8d28-953f8387f7ee", "name": "network-vif-deleted", "tag": "247757db-32b8-4c79-bf0b-653cfda163d9"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:28.607358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.607993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.609131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.625530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] Creating event network-vif-deleted:247757db-32b8-4c79-bf0b-653cfda163d9 for instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee on n-h1-854121-3 Aug 24 01:51:28.637426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-277928cf-1d4d-401b-bfa7-6aa45be93805 req-99eccbb7-c52f-47b3-998a-69c3d6b3c97d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118579 Aug 24 01:51:28.643938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 143/269] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:28.649994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-784312971", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:28.749992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:28.904655 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cffe2f0e-9479-44d8-9ec6-59ba2382ecee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea/action" status: 202 len: 0 microversion: 2.1 time: 0.707852 Aug 24 01:51:28.906109 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 127/270] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:51:28 2022] POST /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:51:28.919520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:28.920505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:28.943753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.945571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.946284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:28.948513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:28.949945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:28.951002 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.608452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:29.622536 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1b3bdc25-7af5-4358-b8d6-e13f9e6ae28b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1471 microversion: 2.1 time: 0.710253 Aug 24 01:51:29.625961 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 128/271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:28 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1471 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:29.649435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:29.649961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:29.650323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:29.650729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:29.651142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:29.666967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:29.673067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.675095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.676079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:29.677235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.678636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.681388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.685219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.685851 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.686656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.687353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.689236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.690122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.692197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.705626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:29.738805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Getting quotas for project 917b0d2fd2ae4f40a9d9300765789560. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:29.754712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Getting quotas for user 53c8133445dc4eff9daf264eb5c20591 and project 917b0d2fd2ae4f40a9d9300765789560. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:29.772140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:29.775610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:29.873459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a185b38-e80e-496a-9732-132fa3fb68d7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227207 Aug 24 01:51:29.874890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 144/272] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:29.880583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:29.881618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:29.888896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.889620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.890426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.891627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.892282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.892949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.955959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:29.956852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:29.962327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:29.964895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lazy-loading 'fault' on Instance uuid b6b18df3-c86a-4d5a-8d28-953f8387f7ee {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:30.055291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c21040e4e0814111bea2074b9ab6104a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7c2a7a33674f3eae10ccaf1e7ca3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.073477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95d0b9fe-bc92-4a3b-8dc7-14645f4ecfd8 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 200 len: 1329 microversion: 2.1 time: 0.192054 Aug 24 01:51:30.074846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 145/273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:29 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 1329 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:30.083677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:30.084287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:30.113566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:30.114069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:30.115828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:30.117399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:30.117875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:30.118326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:30.491372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.505628 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ce6dd12d-5c2e-42d8-8d29-6b4a752c0778 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1341 microversion: 2.1 time: 0.877390 Aug 24 01:51:30.506239 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 129/274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:29 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1341 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:30.516963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc3a6f32-c3ba-4212-8c95-91d4f1bacdc8 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:30.523379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bc3a6f32-c3ba-4212-8c95-91d4f1bacdc8 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:30.638198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.659863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.661770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.669271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-949aee90-9b40-4ccd-bf01-40d4e8827f45 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1314 microversion: 2.25 time: 0.593086 Aug 24 01:51:30.681845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 146/275] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:30 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:30.702268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:30.702946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:30.715979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:30.716467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:30.716928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:30.717636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:30.732428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:30.733502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:30.739368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bc3a6f32-c3ba-4212-8c95-91d4f1bacdc8 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:30.754701 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc3a6f32-c3ba-4212-8c95-91d4f1bacdc8 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1219 microversion: 2.1 time: 0.247147 Aug 24 01:51:30.767992 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 130/276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:30 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1219 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:31.095954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:31.096664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:31.103258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.108376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.109214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.109684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.110031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.114606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.144014 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] HTTP exception thrown: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Request method failure captured: Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee HTTP/1.1 Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPxTnQ-ydjHBJxTQgCERBggOjhnCqXKYpb9qEXdM-2mmZ4Ffs26dMw7LWgyRDvYZF9__vpw1dkxSn60OVlOPlEeVopUhdUfHNz6tigpGR8_4xj5Wv9swumBZ0XLkQd1agbhA8eFYWIBoKENCzzfPyvbzO1sBQ0QyvYsE14-jPxckCw Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:31.157035 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: c21040e4e0814111bea2074b9ab6104a Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:31.158286 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'b6b18df3-c86a-4d5a-8d28-953f8387f7ee'} Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:31.158958 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:31.160680 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:31.162775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Returning 404 to user: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:31.163654 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b5f257fe-f5cf-4255-8899-0de968ca5992 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 404 len: 111 microversion: 2.1 time: 0.072144 Aug 24 01:51:31.165223 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 131/277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:31 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:51:31.177126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d96feef-b2aa-4025-8f69-05b8acab86b9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:31.180059 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:31.180059 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:31.200581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d96feef-b2aa-4025-8f69-05b8acab86b9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.201356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d96feef-b2aa-4025-8f69-05b8acab86b9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.201793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d96feef-b2aa-4025-8f69-05b8acab86b9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.392231 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d96feef-b2aa-4025-8f69-05b8acab86b9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 299 microversion: 2.1 time: 0.218615 Aug 24 01:51:31.404141 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 132/278] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:51:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:31.420334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1ba15f68-dd05-4823-8c2b-eb4a6f842147 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:31.423774 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:31.423774 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:31.485572 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1ba15f68-dd05-4823-8c2b-eb4a6f842147 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.073320 Aug 24 01:51:31.487298 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 133/279] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 01:51:31.528411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b2d54e8f-e2fb-42b2-a1f5-a807f1461e9d tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1398696068"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:31.538272 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:31.538272 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:31.544753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-b2d54e8f-e2fb-42b2-a1f5-a807f1461e9d tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 5744f895-63ae-40f0-86cf-a9d165e7b66a for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:31.623501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:31.633657 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b2d54e8f-e2fb-42b2-a1f5-a807f1461e9d tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120690 Aug 24 01:51:31.637296 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 134/280] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:31.651335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b809aa6-a5e0-4906-8a9c-4ee1255f0fcf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1471 microversion: 2.1 time: 0.968324 Aug 24 01:51:31.655276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 147/281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:30 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1471 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:31.661946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:31.665572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:31.666219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:31.670083 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:31.670083 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:31.684094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.686126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.686813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.699435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.699947 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.700385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.714740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:31.715282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:31.715753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:31.960114 n-d-854121-3 devstack@n-api.service[128567]: WARNING nova.scheduler.client.report [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] [req-65fc9012-44c5-436a-90a4-6179e050ab7b] Failed to update aggregates to [5744f895-63ae-40f0-86cf-a9d165e7b66a] for resource provider with UUID 38ce6b84-dc05-46d1-acb4-a77a529c2875. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-65fc9012-44c5-436a-90a4-6179e050ab7b"}]} Aug 24 01:51:32.093078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:32.105478 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f19c26b7-850f-4e4a-bb6e-f602c5b13dad tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1319 microversion: 2.1 time: 0.462045 Aug 24 01:51:32.106428 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 135/282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:31 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1319 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:32.117756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:32.120032 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:32.135007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.136137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.137238 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.139468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.141460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.142071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.148759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac882f2f-b06a-48e9-ab17-18e26b7fc536 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.492245 Aug 24 01:51:32.149333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 148/283] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:51:31 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:32.155745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:32.155745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:32.171654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.172797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.173346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.174069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.174621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.182125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.335707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:32.338259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:32.348826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:32.349997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3104e5e5-ea5f-4d51-82d7-a7bd7a0993b1 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1271 microversion: 2.1 time: 0.199549 Aug 24 01:51:32.350381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:32.353984 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2c7f1566-f7c1-49e8-a461-60fd999ccf72 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1320 microversion: 2.25 time: 0.242666 Aug 24 01:51:32.357454 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 136/284] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:32 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1320 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:32.366322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 149/285] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:32 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:32.369923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3fadfa3b-5376-418d-9476-fab804e06bf8 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:32.373285 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:32.373285 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:32.395799 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3fadfa3b-5376-418d-9476-fab804e06bf8 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.036787 Aug 24 01:51:32.405147 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 137/286] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 01:51:32 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:32.421120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04144d79-51e9-4e50-8b7c-e69b274d6459 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:32.433327 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:32.433327 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:32.491471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04144d79-51e9-4e50-8b7c-e69b274d6459 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.500802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04144d79-51e9-4e50-8b7c-e69b274d6459 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.505724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04144d79-51e9-4e50-8b7c-e69b274d6459 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.679754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:32.680602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:32.687544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.695054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.700666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.704312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.704917 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.705436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:32.754537 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04144d79-51e9-4e50-8b7c-e69b274d6459 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.346118 Aug 24 01:51:32.756494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 150/287] 10.222.0.49 () {60 vars in 1191 bytes} [Wed Aug 24 01:51:32 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:51:32.767208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffb56cae-a477-4652-b8d7-8b70e813ad8e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:32.770255 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:32.770255 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:32.825518 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffb56cae-a477-4652-b8d7-8b70e813ad8e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.062569 Aug 24 01:51:32.828278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 151/288] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:32 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:32.847940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7df79ea7-3a08-4e1c-9659-a3b3db2a9e6a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1573890552"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:32.865011 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:32.865011 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:32.865011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-7df79ea7-3a08-4e1c-9659-a3b3db2a9e6a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 3baa6485-a04c-4ab3-bad3-397a7eab90dc for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:32.940024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7df79ea7-3a08-4e1c-9659-a3b3db2a9e6a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105806 Aug 24 01:51:32.941311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 152/289] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:32 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:32.967252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfd654c7-e184-4a5f-aa30-d53027c81a75 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:32.977335 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:32.977335 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:32.991346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfd654c7-e184-4a5f-aa30-d53027c81a75 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:32.992846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfd654c7-e184-4a5f-aa30-d53027c81a75 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:32.993451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfd654c7-e184-4a5f-aa30-d53027c81a75 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.117245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:33.128837 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b58cd171-310d-4a75-a3fb-c80f4c224c87 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1471 microversion: 2.1 time: 0.453223 Aug 24 01:51:33.158501 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 138/290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:32 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1471 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:33.167770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:33.173566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:33.188454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.188986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.189431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.190145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.190607 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.205174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.247245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfd654c7-e184-4a5f-aa30-d53027c81a75 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.298270 Aug 24 01:51:33.248587 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 153/291] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:32 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:33.260787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d05cbef-8419-4d69-9595-bcda70f87d76 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:33.261781 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:33.261781 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:33.283313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d05cbef-8419-4d69-9595-bcda70f87d76 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.024266 Aug 24 01:51:33.286357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 154/292] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:51:33 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:51:33.296915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-205d6d48-6641-4a7d-acf9-78dd49d327f9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:33.303967 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:33.303967 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:33.325770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-205d6d48-6641-4a7d-acf9-78dd49d327f9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.326701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-205d6d48-6641-4a7d-acf9-78dd49d327f9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.327988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-205d6d48-6641-4a7d-acf9-78dd49d327f9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.593116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-205d6d48-6641-4a7d-acf9-78dd49d327f9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.299837 Aug 24 01:51:33.594300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 155/293] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:33 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:33.604680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:33.605934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:33.629424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.631388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.633037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.637882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.638638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.639807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.790906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:33.804649 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bdc7eda9-1ef6-42bc-baf8-b3c1999e732c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1319 microversion: 2.1 time: 0.645045 Aug 24 01:51:33.805743 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 139/294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:33 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:33.824389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:33.825044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:33.848268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.848794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.849243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:33.849958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:33.850422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:33.850860 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:34.295279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:34.304750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f700348-c195-4f57-8455-a8ff1132be3b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.709128 Aug 24 01:51:34.309261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 156/295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:33 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:34.318895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e5d3bd-0700-4039-82f9-aabfba7bf280", "name": "network-vif-plugged", "status": "completed", "tag": "54c813f2-14b4-4fdd-a5d4-e7577be462d2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:34.340632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:34.341152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:34.342836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:34.367273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] Creating event network-vif-plugged:54c813f2-14b4-4fdd-a5d4-e7577be462d2 for instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 on n-h1-854121-3 Aug 24 01:51:34.381806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f87fef4b-2f14-4e3a-8c2b-2ba68baa1b1b req-8b071b94-aa3d-4ad8-bb93-d3f5f7b72b51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071108 Aug 24 01:51:34.385458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 157/296] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:34.395028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-935166b5-c43f-43f5-982a-df2261d62252 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:34.398120 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:34.398120 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:34.443761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-935166b5-c43f-43f5-982a-df2261d62252 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056569 Aug 24 01:51:34.444335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 158/297] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:34 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:34.455396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:34.459379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:34.473516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:34.474558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:34.475170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:34.479501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:34.480197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:34.480818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:34.525607 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:34.536142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:34.538883 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:34.540272 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e409fed3-74ea-48e0-8214-a682d61a2058 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.733415 Aug 24 01:51:34.541414 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 140/298] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:33 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:34.556916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d128aa0-f3bc-476b-8ba1-e8dc22faecc6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1428881922"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:34.561155 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:34.561155 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:34.563391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-8d128aa0-f3bc-476b-8ba1-e8dc22faecc6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid ccf0a959-c5e1-44ed-b55f-f92dbace07ae for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:34.592232 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8d128aa0-f3bc-476b-8ba1-e8dc22faecc6 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.049304 Aug 24 01:51:34.594332 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 141/299] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:34.776103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:34.786109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c2d3737-c582-41b3-8f2d-57af6f019bf7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1471 microversion: 2.1 time: 0.336646 Aug 24 01:51:34.787801 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 159/300] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:34 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:34.792885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41791610-cd6d-4bca-8812-f4e09594d859 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:34.798375 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:34.798375 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:34.826886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41791610-cd6d-4bca-8812-f4e09594d859 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:34.827388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41791610-cd6d-4bca-8812-f4e09594d859 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:34.827818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41791610-cd6d-4bca-8812-f4e09594d859 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:34.850735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-13768008", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:34.930046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:35.018082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41791610-cd6d-4bca-8812-f4e09594d859 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.228489 Aug 24 01:51:35.025807 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 160/301] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:35.030859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:35.032231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:35.034979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:35.040638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.042522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.042522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.042522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.042796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.043219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.394833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:35.408882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32e7c4ab-b064-4023-9c07-f677cee6bc3f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1319 microversion: 2.1 time: 0.380973 Aug 24 01:51:35.409929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 161/302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:35 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:35.415582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9df11c2-c45a-4b5a-85fd-fae7a40f5349 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:35.424063 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:35.424063 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:35.425428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9df11c2-c45a-4b5a-85fd-fae7a40f5349 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '024469d9162b44bdaa69ee104f8e1b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413698782fdc4d73ba41089528c46af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9df11c2-c45a-4b5a-85fd-fae7a40f5349 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Request method failure captured: Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 42 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPwa8JodzcwChj2XxfrcMUZIQIjNN9ht4DpSXqcPlx31e_kMgjgY6kLuyc6oIeBBlI5jt4egNEtLxPziW64ODN2FLaqYpOatPS-PK4lV1oU-rvfQPrlzQIKEByoiz94DLmI9xuShzmq15ljQteRHehhSPGvGleRSphyEY0gWQQ9TME Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:35.427507 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/413698782fdc4d73ba41089528c46af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/413698782fdc4d73ba41089528c46af5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_413698782fdc4d73ba41089528c46af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 413698782fdc4d73ba41089528c46af5 Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-940616257 Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 024469d9162b44bdaa69ee104f8e1b85 Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-940616257-project Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: {"remove_host": {"host": "n-h1-854121-3"}} Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:35.428849 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '11', 'body': {'remove_host': {'host': 'n-h1-854121-3'}}} Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:35.429650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 24 01:51:35.430885 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:35.432856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9df11c2-c45a-4b5a-85fd-fae7a40f5349 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:35.433834 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9df11c2-c45a-4b5a-85fd-fae7a40f5349 tempest-AggregatesAdminNegativeTestJSON-940616257 tempest-AggregatesAdminNegativeTestJSON-940616257-project] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 403 len: 121 microversion: 2.1 time: 0.022059 Aug 24 01:51:35.434413 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 162/303] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:35 2022] POST /compute/v2.1/os-aggregates/11/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:35.442982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:35.445098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:35.456171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.457065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.457757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.458704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.459379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.460015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.617794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:35.618775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:35.619505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:35.620088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:35.620814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:35.639073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.642978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.643447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.644290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.644745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.645200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.670327 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Getting quotas for project e5aff87beda84cf590022e8869dde8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:35.675850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Getting quotas for user 5f00a714b8254b36a2b46c6b2d3025a8 and project e5aff87beda84cf590022e8869dde8bf. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:35.689691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:35.692180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:35.758558 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-325ccb20-d09b-4816-9034-8de744c1e83c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162845 Aug 24 01:51:35.759947 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 142/304] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:35.774060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc76b799-cd78-4083-866b-6e69ebcbc01a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:35.781954 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:35.781954 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:35.791340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc76b799-cd78-4083-866b-6e69ebcbc01a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:35.792235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc76b799-cd78-4083-866b-6e69ebcbc01a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:35.793018 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc76b799-cd78-4083-866b-6e69ebcbc01a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:35.818294 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:36.062198 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc76b799-cd78-4083-866b-6e69ebcbc01a tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.300897 Aug 24 01:51:36.062885 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 143/305] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:35 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:36.074164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:36.077504 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:36.099236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.099998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.102249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.103481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.104103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.107256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.359390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.372284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d803a0c6-d1b8-4139-a783-6efe6b2d4363 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.933730 Aug 24 01:51:36.372890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 163/306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:35 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:36.399726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a090a18-34c2-4854-8400-a04172ff49f7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:36.402392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a090a18-34c2-4854-8400-a04172ff49f7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:36.439195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.451867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.460208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.463471 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d5ec94ad-8c2f-4b09-b03d-e5d39cb9b261 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.393918 Aug 24 01:51:36.481244 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 144/307] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:36 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:36.493709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a9043c-8cda-43e7-97be-1345fefa5e8d", "tag": "601fde78-de20-487b-ba11-2b5778ebefcd"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:36.523315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.523918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.524488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.541188 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] Creating event network-changed:601fde78-de20-487b-ba11-2b5778ebefcd for instance 96a9043c-8cda-43e7-97be-1345fefa5e8d on n-h2-854121-3 Aug 24 01:51:36.547528 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-10a37ab7-e08d-46e6-baa6-83901619b236 req-dae8f2c1-62cb-47eb-920f-69fd4a07f60e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057907 Aug 24 01:51:36.548934 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 145/308] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:36.555180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:36.556279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:36.571559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.573657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.574022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.574764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.575317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.579180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.719982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a090a18-34c2-4854-8400-a04172ff49f7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.736605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a090a18-34c2-4854-8400-a04172ff49f7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1221 microversion: 2.1 time: 0.357768 Aug 24 01:51:36.745009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 164/309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:36 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1221 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:36.748376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8fbb333-0f14-451f-ac2e-2eee927a2410 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:36.749214 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:36.749214 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:36.788474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8fbb333-0f14-451f-ac2e-2eee927a2410 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.049662 Aug 24 01:51:36.793832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 165/310] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:36 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:36.797885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:36.799150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:36.807450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.807953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.808393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.809779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:36.810801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:36.811429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:36.855818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:36.868851 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5d96886d-e9e7-49a3-8fe6-4d931b5adfd6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.318759 Aug 24 01:51:36.870110 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 146/311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:36 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:36.874886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d3bfecec-13b9-428d-8d64-824b58503a23 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1996317015"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:36.878482 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:36.878482 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:36.879647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-d3bfecec-13b9-428d-8d64-824b58503a23 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Generated uuid c3f89941-fb2e-4d9c-bcde-1a50043b026b for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:36.911269 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d3bfecec-13b9-428d-8d64-824b58503a23 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038589 Aug 24 01:51:36.912243 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 147/312] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:36.924765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-db64aac3-51f3-46e6-95db-6215645bb979 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-51732928"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:36.934704 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:36.934704 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:36.935777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-db64aac3-51f3-46e6-95db-6215645bb979 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 32869091-f911-4716-b150-984b77283ae1 for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:36.994659 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-db64aac3-51f3-46e6-95db-6215645bb979 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075583 Aug 24 01:51:36.995274 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 148/313] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:37.001470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:37.004541 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:37.004541 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:37.013853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.014645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.015278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.024939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.025506 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.026169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.035234 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.compute.aggregates [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Failed to remove host nonexist_host from aggregate 12. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 01:51:37.036065 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 12 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Request method failure captured: Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 42 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPzabDcZf59a8-RqGVng9FsfaGVuA12GIwPkUS2YjMqGXU6l7tbL8Z1xLEn-TAj1SXYcqiocPQhP2WJ0WR6eZjMYvj7svOniRoRKF_-TCqiREgfgVbqdtvLNSttL3T5bd9cZ0mHXT2UY6VaMykrA9BaGGPDjB9CnoysJzDk46TevWI Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: def608696af2463a9554067074f4c419 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:37.038511 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/def608696af2463a9554067074f4c419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/def608696af2463a9554067074f4c419"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_def608696af2463a9554067074f4c419"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: def608696af2463a9554067074f4c419 Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851 Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 81299ee769d24ee7a209545447b48af7 Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: {"remove_host": {"host": "nonexist_host"}} Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:37.039953 n-d-854121-3 devstack@n-api.service[128566]: exception: Cannot remove host nonexist_host in aggregate 12 Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 24 01:51:37.041190 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 24 01:51:37.042715 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 12 Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.044046 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 12 Aug 24 01:51:37.046638 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.050377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 12 {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:37.051524 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3037d2b3-580d-4e9f-b124-7fb599b55aa3 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 94 microversion: 2.1 time: 0.054857 Aug 24 01:51:37.058133 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 149/314] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:36 2022] POST /compute/v2.1/os-aggregates/12/action => generated 94 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:37.065013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-91827df8-d57f-4705-84e1-7c3c06976aa3 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:37.069348 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:37.069348 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:37.085307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91827df8-d57f-4705-84e1-7c3c06976aa3 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.086063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91827df8-d57f-4705-84e1-7c3c06976aa3 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.086575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91827df8-d57f-4705-84e1-7c3c06976aa3 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.091604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:37.294662 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-91827df8-d57f-4705-84e1-7c3c06976aa3 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 241 microversion: 2.1 time: 0.234971 Aug 24 01:51:37.295665 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 150/315] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:37 2022] POST /compute/v2.1/os-aggregates/13/action => generated 241 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:37.300601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-88713040-460d-4043-b93c-af03e1efccc8 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:37.305276 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:37.305276 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:37.313112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:37.323721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16b13b52-c659-4c6e-b9cd-13b754b9bc04 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1469 microversion: 2.1 time: 0.530228 Aug 24 01:51:37.338394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 166/316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:36 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:37.354537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e82ce957-b410-49de-b3c7-e11a239adac6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:37.355741 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-88713040-460d-4043-b93c-af03e1efccc8 tempest-AggregatesAdminNegativeTestJSON-1560759851 tempest-AggregatesAdminNegativeTestJSON-1560759851-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058961 Aug 24 01:51:37.356334 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 151/317] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:37 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:37.363086 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:37.363086 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:37.375424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e82ce957-b410-49de-b3c7-e11a239adac6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.375917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e82ce957-b410-49de-b3c7-e11a239adac6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.376523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e82ce957-b410-49de-b3c7-e11a239adac6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.541559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e82ce957-b410-49de-b3c7-e11a239adac6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 226 microversion: 2.1 time: 0.198801 Aug 24 01:51:37.545516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 167/318] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:37 2022] POST /compute/v2.1/os-aggregates/13/action => generated 226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:37.554552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:37.555554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:37.562944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.563508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.564058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.565140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.565678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.566165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.653816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-55823345", "block_migration": true, "disk_over_commit": false}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:37.656985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:37.672746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.673590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.676302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.677620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.679824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.680459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.772481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:37.783894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bf70c09-e796-441a-ba04-83d27de5139c tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.233369 Aug 24 01:51:37.785035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 168/319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:37 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:37.807737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:37.809039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:37.817549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.818870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.819589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.820988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:37.821692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:37.822310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:37.847808 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lazy-loading 'flavor' on Instance uuid 98e5d3bd-0700-4039-82f9-aabfba7bf280 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:37.914291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Going to try to live migrate instance to tempest-host-55823345 {{(pid=128566) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:51:37.923986 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] HTTP exception thrown: Compute host tempest-host-55823345 could not be found. Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Request method failure captured: Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280/action HTTP/1.1 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 105 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQV1ExPWvRNxPCy29h8FB5BfatE0tCvr01VG9kT-uMxBPHOovX8MyORrkfzHXdeK0gcVVkzrPPxbBVYGb8SNn4r4K2yfUHxbkWmZ-W9n7N1knhqqvruFWGSEjO2ocCVLaP6aV0H_pgFgttd_HzUtVrLnNpLmSIYkjjqz5fxR5oMt4o Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 5908678812eb4c94a6c36e265c177931 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:37.928209 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5908678812eb4c94a6c36e265c177931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5908678812eb4c94a6c36e265c177931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5908678812eb4c94a6c36e265c177931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5908678812eb4c94a6c36e265c177931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 5908678812eb4c94a6c36e265c177931 Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-LiveMigrationNegativeTest-686608316-project-admin Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 590ea56ebb954c0fbbaf8a6b23d20db1 Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-LiveMigrationNegativeTest-686608316-project-admin Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: {"os-migrateLive": {"host": "tempest-host-55823345", "block_migration": true, "disk_over_commit": false}} Aug 24 01:51:37.929875 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: exception: Compute host tempest-host-55823345 could not be found. Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '98e5d3bd-0700-4039-82f9-aabfba7bf280', 'body': {'os-migrateLive': {'host': 'tempest-host-55823345', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:51:37.931275 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-55823345 could not be found. Aug 24 01:51:37.934746 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-55823345 could not be found. Aug 24 01:51:37.939459 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-55823345 could not be found. Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Returning 400 to user: Compute host tempest-host-55823345 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:37.947780 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c3de6e3c-a53d-46dc-81b1-43e5812b887d tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280/action" status: 400 len: 98 microversion: 2.1 time: 0.587276 Aug 24 01:51:37.953137 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 152/320] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Aug 24 01:51:37 2022] POST /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280/action => generated 98 bytes in 594 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:51:37.960806 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5685455b-aba6-49fc-86c5-348e4a20bb39 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:37.962170 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:37.962170 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:37.976423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:37.989972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:37.991871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:37.993786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2e850a2-5782-44ac-aa0f-529a56d9f2a0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.194146 Aug 24 01:51:37.994573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 169/321] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:37 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:37.999677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.000358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:38.009347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.009837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.010739 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5685455b-aba6-49fc-86c5-348e4a20bb39 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055943 Aug 24 01:51:38.010857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.015643 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 153/322] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:37 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:38.015777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.015777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.015777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.146473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:38.148610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:38.159520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57b949ee-df4f-4d3c-8919-15e36f5a620c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1273 microversion: 2.1 time: 0.163185 Aug 24 01:51:38.166408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-4645701", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "703d5e47-7c1f-4c8b-a044-dfccc07fdccf"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:38.175251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 170/323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:37 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:38.180090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.180707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:38.188389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.188916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.189754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.190997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.192200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.192635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.232043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] validate_networks() for [('703d5e47-7c1f-4c8b-a044-dfccc07fdccf', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:38.402250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:38.411306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f790e909-efc0-4c72-b7ab-296711bead45 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.234919 Aug 24 01:51:38.421577 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 171/324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:38 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:38.431260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.432900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:38.446545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.449010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.449532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.450333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.451387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.452924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.634031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:38.643649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e6c1fd4-5261-4f86-bafb-e624dd5ddb61 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1469 microversion: 2.1 time: 0.220200 Aug 24 01:51:38.645492 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 172/325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:38 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:38.649990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff3d8f98-e237-46bc-80fb-5cfed5e690d4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1006809248"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:38.652571 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:38.652571 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:38.653467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-ff3d8f98-e237-46bc-80fb-5cfed5e690d4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid b8825975-b520-4d5f-a147-f04d7664a5ce for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:38.693569 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff3d8f98-e237-46bc-80fb-5cfed5e690d4 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046285 Aug 24 01:51:38.695671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 173/326] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:38.701637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05025172-00a4-41ec-b1b8-e4c3787325d4", "tag": "a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:38.713897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.714945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.715590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.729399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] Creating event network-changed:a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0 for instance 05025172-00a4-41ec-b1b8-e4c3787325d4 on n-h1-854121-3 Aug 24 01:51:38.737615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e3c5364f-0f4a-4c4f-aed0-72c61b5b512e req-ee7910f6-f4ea-4854-9d5d-3880657f5411 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040020 Aug 24 01:51:38.744009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 174/327] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:38.749704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:38.750339 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:38.750935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:38.751525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:38.752013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:38.753741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eba8b5b-2a6d-4f3f-b45b-c116135fa767 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.754807 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:38.754807 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:38.766457 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.773011 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.773605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.774460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.775056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.775565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.783078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eba8b5b-2a6d-4f3f-b45b-c116135fa767 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.037162 Aug 24 01:51:38.784929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 175/328] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:38.796314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b77f7805-9b87-4ee1-bb2f-48da84a92160 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.798354 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:38.798354 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:38.809991 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b77f7805-9b87-4ee1-bb2f-48da84a92160 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b77f7805-9b87-4ee1-bb2f-48da84a92160 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Request method failure captured: Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzkmhvd5cypmdFgLUpsSEsk4Way3d5MT9nbfXH59FS4_N1scqPcCpnpSjOagTLUQVLkQ2XbE15LOqlCK4bg4NbSc_g_fwTPowXltYu2F4aaSybl9StFoI0VWAjQ_X2hGTn3JqPTt46yd53tVwcTuQGcMicxMKbgrDHYr6rlVwJXXY Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:38.813337 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 17e7874ebc2a4dbabd77ade8ba07beac Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: exception: Aggregate 14 could not be found. Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '14'} Aug 24 01:51:38.814834 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:38.815747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 24 01:51:38.817012 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:38.819339 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Getting quotas for project 00ec459a29ce43e88d22dc615c3bb38f. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:38.819895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b77f7805-9b87-4ee1-bb2f-48da84a92160 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:38.821701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b77f7805-9b87-4ee1-bb2f-48da84a92160 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.031974 Aug 24 01:51:38.822456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 176/329] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:38 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 01:51:38.831272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-879253288", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:38.836324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Getting quotas for user a04ed83057e54f179e52bbf1ae15f9f2 and project 00ec459a29ce43e88d22dc615c3bb38f. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:38.858905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:38.861926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:38.904281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:51:38.939221 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8f9e1531-1b7e-4af6-bc7f-3744e6954c55 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926073 Aug 24 01:51:38.942376 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 154/330] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:38.965516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:38.966230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:38.978046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.978746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.979503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:38.980372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:38.981013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:38.981779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.202149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:39.227460 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-73343db2-dea5-4ca5-8151-1ff9584d3426 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.283953 Aug 24 01:51:39.247739 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 155/331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:38 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:39.256584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e8534147-395b-4ecb-8420-eb53b2397f3b tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:39.257657 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:39.257657 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:39.279099 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e8534147-395b-4ecb-8420-eb53b2397f3b tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e8534147-395b-4ecb-8420-eb53b2397f3b tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Request method failure captured: Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPzkmhvd5cypmdFgLUpsSEsk4Way3d5MT9nbfXH59FS4_N1scqPcCpnpSjOagTLUQVLkQ2XbE15LOqlCK4bg4NbSc_g_fwTPowXltYu2F4aaSybl9StFoI0VWAjQ_X2hGTn3JqPTt46yd53tVwcTuQGcMicxMKbgrDHYr6rlVwJXXY Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:39.281916 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 17e7874ebc2a4dbabd77ade8ba07beac Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: exception: Aggregate 14 could not be found. Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '14'} Aug 24 01:51:39.283967 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:39.285293 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:39.286425 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:39.287593 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:39.287593 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:39.287593 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:39.287593 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Aug 24 01:51:39.287593 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:39.313283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e8534147-395b-4ecb-8420-eb53b2397f3b tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:39.314725 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e8534147-395b-4ecb-8420-eb53b2397f3b tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.065364 Aug 24 01:51:39.315502 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 156/332] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:39.325406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4bb9035e-5cbd-453d-8a3e-6bb7a89a5921 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:39.326385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4bb9035e-5cbd-453d-8a3e-6bb7a89a5921 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:39.442155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4bb9035e-5cbd-453d-8a3e-6bb7a89a5921 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:39.451344 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4bb9035e-5cbd-453d-8a3e-6bb7a89a5921 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1229 microversion: 2.1 time: 0.134332 Aug 24 01:51:39.452549 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 157/333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:39 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1229 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:39.469880 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:39.470986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:39.471943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:51:39.472339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:51:39.473105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:51:39.473744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:51:39.474573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:51:39.486681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.494911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.495613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.496830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.497495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.497880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.498333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.498463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.498878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.500931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.501396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.501882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.541031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Getting quotas for project c417d3076cb7493eb2faebbad91ac38d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:51:39.546391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Getting quotas for user e0e6c635ba444a0c8cc501127d819774 and project c417d3076cb7493eb2faebbad91ac38d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:51:39.561647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:51:39.565134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:51:39.694791 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aab0432b-75c2-4d52-9d68-26be8d156d5b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869885 Aug 24 01:51:39.695792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 177/334] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:51:39.718863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:39.719593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:39.746319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.746949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.747405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.763747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.764246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.764684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.818161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:39.828749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:39.836292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:39.837497 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2179a00b-7cbb-4d9b-9f4f-1650660ab468 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.382794 Aug 24 01:51:39.839771 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 158/335] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:39 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:39.848912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b52dc164-921d-480d-b7e8-0b67b2692f3f tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1973256531", "name": "tempest-test_aggregate-1064188380"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:39.884423 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:39.884423 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:39.886147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.aggregate [None req-b52dc164-921d-480d-b7e8-0b67b2692f3f tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 20f54853-388a-47a7-9760-1f98c746e955 for aggregate {{(pid=128566) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:39.920130 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b52dc164-921d-480d-b7e8-0b67b2692f3f tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.078449 Aug 24 01:51:39.921215 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 159/336] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Aug 24 01:51:39 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:39.936083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:39.936971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:39.957449 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.957982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.959630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:39.962557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:39.963055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:39.976365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:40.240305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:40.261026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cab9b1ae-636d-4ddf-8fe4-ba454af21573 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1273 microversion: 2.1 time: 0.554780 Aug 24 01:51:40.261673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 178/337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:39 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1273 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:40.285210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5ef5466-f2e8-43e3-b84b-ddba11037d7d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:40.290642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5ef5466-f2e8-43e3-b84b-ddba11037d7d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:40.530188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5ef5466-f2e8-43e3-b84b-ddba11037d7d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:40.548227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:40.552013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5ef5466-f2e8-43e3-b84b-ddba11037d7d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1218 microversion: 2.1 time: 0.286904 Aug 24 01:51:40.554411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 179/338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:40 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:40.560578 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-354bba1b-da44-436a-8f56-79f62c2fb2c0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.637432 Aug 24 01:51:40.563801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f189fa26-e8ff-4e65-a10a-bc5e7626ffc9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:40.566105 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:40.566105 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:40.573682 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 160/339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:39 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:40.581065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:40.581955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:40.589023 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:40.589722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:40.590885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:40.592545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:40.593189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:40.594414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:40.638956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f189fa26-e8ff-4e65-a10a-bc5e7626ffc9 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.081282 Aug 24 01:51:40.639619 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 180/340] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:40 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:40.653382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:40.656991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:40.673691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:40.677443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:40.678226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:40.679194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:40.679897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:40.680553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:40.921173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:40.939036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92c5f4ba-8653-4d19-bb16-b3271800fd62 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1281 microversion: 2.1 time: 0.296646 Aug 24 01:51:40.942123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 181/341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:40 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:40.955085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68ef7cf8-487f-4cf5-8ff6-043ff6e83329 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:40.957556 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:40.957556 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:40.974779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-68ef7cf8-487f-4cf5-8ff6-043ff6e83329 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68ef7cf8-487f-4cf5-8ff6-043ff6e83329 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Request method failure captured: Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPzkmhvd5cypmdFgLUpsSEsk4Way3d5MT9nbfXH59FS4_N1scqPcCpnpSjOagTLUQVLkQ2XbE15LOqlCK4bg4NbSc_g_fwTPowXltYu2F4aaSybl9StFoI0VWAjQ_X2hGTn3JqPTt46yd53tVwcTuQGcMicxMKbgrDHYr6rlVwJXXY Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:51:40.978207 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 17e7874ebc2a4dbabd77ade8ba07beac Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: exception: Aggregate 15 could not be found. Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '15'} Aug 24 01:51:40.979507 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:40.980253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:40.981842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68ef7cf8-487f-4cf5-8ff6-043ff6e83329 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:40.983536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68ef7cf8-487f-4cf5-8ff6-043ff6e83329 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.040069 Aug 24 01:51:40.984114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 182/342] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:40 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:40.999121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:41.001157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:41.023834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:41.025834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:41.026633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:41.030500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:41.031118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:41.031580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:41.808966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:41.825120 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-17fb66c9-5607-483f-97d2-06d9466bc52b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 1.249706 Aug 24 01:51:41.827406 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 161/343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:40 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:41.849422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-704e9064-c6f4-45ea-b9c1-e2b3fa22388e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:41.852956 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:41.852956 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:41.868554 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-704e9064-c6f4-45ea-b9c1-e2b3fa22388e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-704e9064-c6f4-45ea-b9c1-e2b3fa22388e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Request method failure captured: Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPzkmhvd5cypmdFgLUpsSEsk4Way3d5MT9nbfXH59FS4_N1scqPcCpnpSjOagTLUQVLkQ2XbE15LOqlCK4bg4NbSc_g_fwTPowXltYu2F4aaSybl9StFoI0VWAjQ_X2hGTn3JqPTt46yd53tVwcTuQGcMicxMKbgrDHYr6rlVwJXXY Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:51:41.870738 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9325d989b5264ce2897f6bb9e2fb07a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 9325d989b5264ce2897f6bb9e2fb07a3 Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-62374354 Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 17e7874ebc2a4dbabd77ade8ba07beac Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminTestJSON-62374354-project-admin Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: exception: Aggregate 15 could not be found. Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '15'} Aug 24 01:51:41.871942 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:51:41.872948 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:41.874214 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:41.876230 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:41.876230 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:41.876230 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:41.876230 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Aug 24 01:51:41.876230 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:41.879910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-704e9064-c6f4-45ea-b9c1-e2b3fa22388e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:41.881224 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-704e9064-c6f4-45ea-b9c1-e2b3fa22388e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.037580 Aug 24 01:51:41.882401 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 162/344] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:41 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:51:41.891551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:41.892462 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:41.904493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:41.905364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:41.906577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:41.907608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:41.908521 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:41.910031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.085171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.096573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.098404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.100744 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5ecc851-972c-47a3-bd4c-066419086a6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 1.113306 Aug 24 01:51:42.101231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 183/345] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:40 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:42.104696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.106253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.106987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:42.113980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.114843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.115406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.116391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.117021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.117585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.123214 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6eb63a15-f7fa-4cb2-a9f4-b21e3442198d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1279 microversion: 2.1 time: 0.239158 Aug 24 01:51:42.123798 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 163/346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:41 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:42.150753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.151384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:42.161725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.162223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.162664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.163435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.163831 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.168233 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.199748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.210272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e97abda-c080-4a0b-a327-6c1fd28594d0 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1270 microversion: 2.1 time: 0.107837 Aug 24 01:51:42.211195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 184/347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:42.216655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bc5a13c-c9eb-4838-9594-97c1b021fdd8 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1422645084"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:42.220901 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.220901 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.222226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-0bc5a13c-c9eb-4838-9594-97c1b021fdd8 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 0d85639a-b9c3-4069-948d-f4cbaa575844 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:42.262766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bc5a13c-c9eb-4838-9594-97c1b021fdd8 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050132 Aug 24 01:51:42.264009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 185/348] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:42.269491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.270382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:42.279971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.280875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.282155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.283197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.283900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.284534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.360739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.370717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3795189-de8e-45d8-a782-af850315a6eb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1287 microversion: 2.1 time: 0.105196 Aug 24 01:51:42.371621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 186/349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:42.611302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e55e005-6475-413c-b9aa-015bf1e334df tempest-AZAdminNegativeTestJSON-154363001 tempest-AZAdminNegativeTestJSON-154363001-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.612062 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.612062 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.612931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e55e005-6475-413c-b9aa-015bf1e334df tempest-AZAdminNegativeTestJSON-154363001 tempest-AZAdminNegativeTestJSON-154363001-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'fb207580364d43f5be8116734e78d8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddafbdc9d69c499c803f9396274be1b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e55e005-6475-413c-b9aa-015bf1e334df tempest-AZAdminNegativeTestJSON-154363001 tempest-AZAdminNegativeTestJSON-154363001-project] Request method failure captured: Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQtmzhX6H9q27tBpZgkRiSzogrc-50_BMcKL-0Vt9s7MpyK9asBuiYrYpfzxU9VqlVjkLBLoKV7x3WsEqGgAXMNMaWRZG0awlPLkrVF-Y-nb5cTsYZGFhmlK3f0ipKZS5gzkGq-TPQ8qNVdtpUIc0MyxVHp9SLFtvq7ZyplZsJ4sDA Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ddafbdc9d69c499c803f9396274be1b5 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AZAdminNegativeTestJSON-154363001 Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:42.615811 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ddafbdc9d69c499c803f9396274be1b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddafbdc9d69c499c803f9396274be1b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ddafbdc9d69c499c803f9396274be1b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ddafbdc9d69c499c803f9396274be1b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AZAdminNegativeTestJSON-154363001 Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ddafbdc9d69c499c803f9396274be1b5 Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-154363001 Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AZAdminNegativeTestJSON-154363001-project Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: fb207580364d43f5be8116734e78d8d7 Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AZAdminNegativeTestJSON-154363001-project Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 01:51:42.617075 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:51:42.617783 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 24 01:51:42.618826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:42.621091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e55e005-6475-413c-b9aa-015bf1e334df tempest-AZAdminNegativeTestJSON-154363001 tempest-AZAdminNegativeTestJSON-154363001-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:42.622149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e55e005-6475-413c-b9aa-015bf1e334df tempest-AZAdminNegativeTestJSON-154363001 tempest-AZAdminNegativeTestJSON-154363001-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.249383 Aug 24 01:51:42.628398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 187/350] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:42.633635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9436281b-7c45-4b50-b718-747a85cfab9e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.634641 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.634641 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.645375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9436281b-7c45-4b50-b718-747a85cfab9e tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.014728 Aug 24 01:51:42.646233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 188/351] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:42.658640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ca35874-71ac-4b0b-9fba-77446ef07b1d tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:42.663389 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.663389 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.666277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:42.680848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:42.702538 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b40a1a95-87d0-4c24-96d8-eb6815c8e00b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.561148 Aug 24 01:51:42.716564 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 164/352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:42.723389 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ca35874-71ac-4b0b-9fba-77446ef07b1d tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.069723 Aug 24 01:51:42.732230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 189/353] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 01:51:42 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:42.751305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ab6ae4f9-18f2-446f-a6f9-aea7d4803fe0 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.754014 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.754014 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:42.775699 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ab6ae4f9-18f2-446f-a6f9-aea7d4803fe0 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.037232 Aug 24 01:51:42.776478 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 165/354] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:42.789553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d820c1dd-c54e-454c-94b5-5ae1bd0c7e30 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.790810 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.790810 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.849754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:42.851585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d820c1dd-c54e-454c-94b5-5ae1bd0c7e30 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.067762 Aug 24 01:51:42.853017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:42.855201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 190/355] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:42 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:42.863544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.864408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.865097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.866120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.866794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.867708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:42.872083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-951c3075-ce93-4e58-bc85-05736030b773 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-92038171", "availability_zone": "tempest-test_az-1686165005"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:42.874986 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.874986 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.880013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-951c3075-ce93-4e58-bc85-05736030b773 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 41d7630a-fd48-43aa-ad5c-a1a608b04453 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:42.939303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-951c3075-ce93-4e58-bc85-05736030b773 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.080915 Aug 24 01:51:42.942351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 191/356] 10.222.0.49 () {60 vars in 1165 bytes} [Wed Aug 24 01:51:42 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:42.955416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1959588-6228-4944-8085-ec6b4e0155fc tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-92038171_new", "availability_zone": "tempest-test_az-1686165005_new"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:42.958220 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:42.958220 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:42.995227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1959588-6228-4944-8085-ec6b4e0155fc tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:42.995685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1959588-6228-4944-8085-ec6b4e0155fc tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:42.996094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1959588-6228-4944-8085-ec6b4e0155fc tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.029527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1959588-6228-4944-8085-ec6b4e0155fc tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.079420 Aug 24 01:51:43.031585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 192/357] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 01:51:42 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:43.043870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b60b5940-3c84-45ac-8dea-f3226eec0784 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.044917 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:43.044917 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:43.054481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b60b5940-3c84-45ac-8dea-f3226eec0784 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.016082 Aug 24 01:51:43.055087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 193/358] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:43.066631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc9b3922-7e13-4c99-bdd2-408af01548c6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.067437 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:43.067437 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:43.098242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc9b3922-7e13-4c99-bdd2-408af01548c6 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035285 Aug 24 01:51:43.099150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 194/359] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:43 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 01:51:43.111569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdb2db1c-af29-4491-8b5a-43c5d33dad1a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1076445400"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:43.115448 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:43.115448 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:43.118269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-cdb2db1c-af29-4491-8b5a-43c5d33dad1a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Generated uuid 3409a996-9ae7-4850-a88a-84217df7438c for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 01:51:43.146918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdb2db1c-af29-4491-8b5a-43c5d33dad1a tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041674 Aug 24 01:51:43.147566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 195/360] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 01:51:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:43.158693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.159369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:43.169136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.169648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.170078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.170986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.172105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.172706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.219426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.251638 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f370eeb1-ed86-4f9d-b64b-51022e317599 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.407237 Aug 24 01:51:43.253037 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 166/361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:42 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:43.258544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.259151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:43.266184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.266677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.267121 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.267808 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.268260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.268832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.632187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.652262 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4b61cef9-a540-4b0a-bbb7-c5dac50bf12c tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.397337 Aug 24 01:51:43.654451 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 167/362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:43.666655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d1a0d052-1a48-4f62-917a-a65476f7a0cb tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.669693 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:43.669693 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:51:43.698682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.711135 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d1a0d052-1a48-4f62-917a-a65476f7a0cb tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.054859 Aug 24 01:51:43.712399 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 168/363] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:43.714075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.718346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.719697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f87bdba-05e8-49ff-b390-3569c70cc84f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.564809 Aug 24 01:51:43.721722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.722756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:43.725296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=5,nova_api:INSERT=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:43.739503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 196/364] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:43.742142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.743893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.744422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.745058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:43.745237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.745966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.746432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.746862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.762004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.762763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.763201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.763909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.764363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.764822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.874179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:43.886344 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-82ed8d9d-5c2b-4f66-941e-1dd6164d066c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1276 microversion: 2.1 time: 0.171172 Aug 24 01:51:43.889398 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 169/365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:43.897668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:43.898279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:43.910278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.910771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.911206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:43.911913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:43.912396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:43.912836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.085887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.098951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f336a22c-eb82-4312-b4c9-47bc48f32f4e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.357942 Aug 24 01:51:44.101086 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 197/366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:44.107439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69fd727e-deb7-4017-aa13-b99616a89bf0 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.108678 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:44.108678 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:44.145542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69fd727e-deb7-4017-aa13-b99616a89bf0 tempest-AggregatesAdminTestJSON-62374354 tempest-AggregatesAdminTestJSON-62374354-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.042420 Aug 24 01:51:44.146388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 198/367] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:51:44 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:51:44.158088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a9043c-8cda-43e7-97be-1345fefa5e8d", "name": "network-vif-plugged", "status": "completed", "tag": "601fde78-de20-487b-ba11-2b5778ebefcd"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:44.172217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.173123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.173744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.189138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] Creating event network-vif-plugged:601fde78-de20-487b-ba11-2b5778ebefcd for instance 96a9043c-8cda-43e7-97be-1345fefa5e8d on n-h2-854121-3 Aug 24 01:51:44.196172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2d304184-0ca3-46a1-9743-f97a373164a7 req-6b7e6ddd-998d-467e-8168-459181043c2e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046160 Aug 24 01:51:44.197628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 199/368] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:44.204527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.205450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.216867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.217594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.218225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.220098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.221421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.222036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.256342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] HTTP exception thrown: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Request method failure captured: Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee HTTP/1.1 Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxTnQ-ydjHBJxTQgCERBggOjhnCqXKYpb9qEXdM-2mmZ4Ffs26dMw7LWgyRDvYZF9__vpw1dkxSn60OVlOPlEeVopUhdUfHNz6tigpGR8_4xj5Wv9swumBZ0XLkQd1agbhA8eFYWIBoKENCzzfPyvbzO1sBQ0QyvYsE14-jPxckCw Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:51:44.258877 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c21040e4e0814111bea2074b9ab6104a Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.260067 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b6b18df3-c86a-4d5a-8d28-953f8387f7ee'} Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:44.260779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.261849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.264606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Returning 404 to user: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:44.268025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2d3d599-deac-47da-9f6a-2baf5670c653 tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 404 len: 111 microversion: 2.1 time: 0.068157 Aug 24 01:51:44.269518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 200/369] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:51:44 2022] DELETE /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:44.280525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.285332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.297319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.297850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.300114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.300883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.301336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.304362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.394658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.402640 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-01e81e59-eeb6-4b10-914d-ee935b6a1a57 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.512147 Aug 24 01:51:44.413356 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 170/370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:43 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:44.423220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.424066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] [instance: b6b18df3-c86a-4d5a-8d28-953f8387f7ee] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.430353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.431054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.431662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.432513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.433203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.433771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.448150 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] HTTP exception thrown: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Request method failure captured: Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee HTTP/1.1 Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPxTnQ-ydjHBJxTQgCERBggOjhnCqXKYpb9qEXdM-2mmZ4Ffs26dMw7LWgyRDvYZF9__vpw1dkxSn60OVlOPlEeVopUhdUfHNz6tigpGR8_4xj5Wv9swumBZ0XLkQd1agbhA8eFYWIBoKENCzzfPyvbzO1sBQ0QyvYsE14-jPxckCw Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:51:44.449997 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6a7c2a7a33674f3eae10ccaf1e7ca3ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 6a7c2a7a33674f3eae10ccaf1e7ca3ce Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-134827121 Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: c21040e4e0814111bea2074b9ab6104a Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-AggregatesAdminTestJSON-134827121-project Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.451303 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'b6b18df3-c86a-4d5a-8d28-953f8387f7ee'} Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:51:44.452094 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. Aug 24 01:51:44.454281 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:51:44.457522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] Returning 404 to user: Instance b6b18df3-c86a-4d5a-8d28-953f8387f7ee could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:51:44.458581 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4d51cf84-9b0a-4691-81ee-c29c35ea074d tempest-AggregatesAdminTestJSON-134827121 tempest-AggregatesAdminTestJSON-134827121-project] 10.222.0.49 "GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee" status: 404 len: 111 microversion: 2.1 time: 0.044175 Aug 24 01:51:44.464973 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 171/371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:44 2022] GET /compute/v2.1/servers/b6b18df3-c86a-4d5a-8d28-953f8387f7ee => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:51:44.679440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.680065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.687485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.687699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.688969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.689425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.690221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.690881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.691325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.697637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-809e101e-5deb-4a0f-b65e-af60e1bbdd07 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.423295 Aug 24 01:51:44.698331 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 201/372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:44 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:44.750257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.750918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.758689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.759564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.760228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.761128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.761730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.762305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.925909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.935055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.937685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:44.938830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61d3d9a6-bc34-4bc9-b0fe-a30886c6596c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.195525 Aug 24 01:51:44.948752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 202/373] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:44 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:51:44.948752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:44.948752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:44.965510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.965628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.966445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:44.967160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:44.967616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:44.968042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.182788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:45.201302 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b1f4a70b-58d2-4e85-9626-1ef5f53a1b99 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.525617 Aug 24 01:51:45.215650 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 172/374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:44 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:45.215650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:45.215650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:45.226482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.227270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.230732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.231796 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.232487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.233145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.434424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:45.448434 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99ae7d16-3f02-4bd7-aa0a-0335fdcc1695 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.507280 Aug 24 01:51:45.457113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 203/375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:44 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:45.462529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b", "tag": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:45.473530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.474029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.474443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.489409 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] Creating event network-changed:615ef30c-4b0d-4316-a6ac-25eb39ba6a63 for instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b on n-h1-854121-3 Aug 24 01:51:45.494484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3f1e1f2b-ffe6-4553-bac7-0b48e3b867ae req-cac6346e-20c4-4723-9f0f-141d33a0e0ad service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036088 Aug 24 01:51:45.495676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 204/376] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:45.502939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:45.503847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:45.511720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.512873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.513254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.514051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.514504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.514931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.656164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:45.664081 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fa68db5f-346f-4929-99ae-b0b80f11b786 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.458949 Aug 24 01:51:45.664660 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 173/377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:45 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:45.719319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:45.720150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:45.729520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.731720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.732663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.733452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.733959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.734741 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.931650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:45.941722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90bcd424-e3db-4956-ba62-1fa153161c4b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.444536 Aug 24 01:51:45.942411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 205/378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:45 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:45.947521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71638516-58f1-4f29-943c-d2c030cf9c0c", "tag": "883ece66-53cb-4cbd-a2db-f302be6ffbba"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:45.957541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:45.958192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:45.958785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:45.975060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] Creating event network-changed:883ece66-53cb-4cbd-a2db-f302be6ffbba for instance 71638516-58f1-4f29-943c-d2c030cf9c0c on n-h1-854121-3 Aug 24 01:51:45.980149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98f0cf6b-7700-4d13-bbbd-2d979eb80806 req-c0ffee22-40f7-4d7b-855b-adbca9fb3d57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036304 Aug 24 01:51:45.980751 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 206/379] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:45.999067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:46.000689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:46.012819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.013590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.014428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.015923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.016521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.017119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.211211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.221410 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ba11cc7f-84a6-41ed-8ed0-cc52ae17e9a4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.505927 Aug 24 01:51:46.235179 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 174/380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:45 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:46.248643 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:46.253097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:46.260252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.261115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.261797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.262640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.263217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.263746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.335656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.344366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.346228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.347482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20ca2d4e-eb4b-4cce-8589-89b32b69c3ab tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1362 microversion: 2.25 time: 0.354867 Aug 24 01:51:46.348149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 207/381] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:45 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:46.353248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05025172-00a4-41ec-b1b8-e4c3787325d4", "name": "network-vif-plugged", "status": "completed", "tag": "a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:46.362985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.363819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.364469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.368682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:46.377539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] Creating event network-vif-plugged:a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0 for instance 05025172-00a4-41ec-b1b8-e4c3787325d4 on n-h1-854121-3 Aug 24 01:51:46.383094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6839022e-5eba-4c83-a8ed-d06630903a76 req-4bc238a5-c8a0-4bf3-a3ea-d97a9aaa2cef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033557 Aug 24 01:51:46.383877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 208/382] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:46.470962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:46.472684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:46.479625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.480279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.480932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.483216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.483853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.484478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.648213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.657375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6007686-1c67-4e76-bead-9171f715d68b tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.190824 Aug 24 01:51:46.658383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 209/383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:46 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:46.667058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.676653 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-87dbec2e-51c1-4ef6-afad-1f697e1c1df6 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.452737 Aug 24 01:51:46.677342 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 175/384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:46 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:46.685140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:46.685824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:46.693629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.694118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.694656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.695690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.696147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.696569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.870971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:46.879292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fdb6e5df-79f1-4f3c-8efe-585a890f9d00 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.198407 Aug 24 01:51:46.885439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 210/385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:46 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:46.963428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:46.964233 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:46.971114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.971653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.972217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.972891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:46.973348 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:46.973787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:46.977996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:47.114554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.122677 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d46d7696-d06d-48f5-902d-8de234d62a64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.162834 Aug 24 01:51:47.123493 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 176/386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:46 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:47.246659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:47.247177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:47.253907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.254339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.254772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.255455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.255906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.256320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.374639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:47.376554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:47.385267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.386724 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.387569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.391110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.392131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.392910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.412106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.421144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c43cb48-6563-4977-86d3-b5e3d5b151cb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.178221 Aug 24 01:51:47.421951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 211/387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:47 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:47.530497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca33f41-3d19-480f-8b0b-031f2aee8e6c", "tag": "fa730c8b-9e3c-42b1-89ad-fc103e63dac8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:47.542524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.543398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.543974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.556609 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] Creating event network-changed:fa730c8b-9e3c-42b1-89ad-fc103e63dac8 for instance cca33f41-3d19-480f-8b0b-031f2aee8e6c on n-h2-854121-3 Aug 24 01:51:47.561402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-27292d90-b8c7-4acd-8fc6-a5e4ce986511 req-f6bb4600-0771-4f9e-b1df-ecf9dedf3c33 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035581 Aug 24 01:51:47.562511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 212/388] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:51:47.588787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.597962 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.599481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.600663 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b2ae07ae-68a1-4169-9202-5f13425268f4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1559 microversion: 2.25 time: 0.234323 Aug 24 01:51:47.602190 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 177/389] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:47 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:51:47.680304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:47.681378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:47.689652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.690344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.690929 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.691920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.697214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.698191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.904493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:47.912346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:47.913143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:47.914295 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4d5018c0-4fe2-4ea0-9f26-6429febbe69f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.239711 Aug 24 01:51:47.915348 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 178/390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:47 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:51:47.920822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.921294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.921884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:47.922005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.922752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.923112 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:47.923253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.923595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.930768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.931455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.932070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:47.932977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:47.933759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:47.934341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.088105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 96a9043c-8cda-43e7-97be-1345fefa5e8d {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:48.144545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-421026fc-82b1-4c51-87e1-b73cd3ee752b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 2052 microversion: 2.25 time: 0.523863 Aug 24 01:51:48.145320 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 213/391] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:47 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 2052 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:48.150862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.151675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.160635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.161498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.162258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.163026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.163575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.163977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:48.164676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.172141 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-500b0f29-47ac-4fbc-aa60-2f00c1aafff7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.254717 Aug 24 01:51:48.172917 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 179/392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:47 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:48.191837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.192674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.199530 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.200183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.200785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.201632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.202253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.202858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.378582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:48.387455 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c3aca71d-2a5e-4f21-b8be-9d67e88ba91c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.201048 Aug 24 01:51:48.388118 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 180/393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:48.393824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.395046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.410507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.411274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.412029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.415671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.416359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.416999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.429282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:48.441333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3a5f789-2f38-4d8d-ad19-1eb23951e277 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.294824 Aug 24 01:51:48.442138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 214/394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:48.447789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.448388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.454700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.455385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.455964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.456860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.457444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.457994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.710257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 96a9043c-8cda-43e7-97be-1345fefa5e8d {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:48.725156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:48.753758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e929119f-c6d7-4305-a7e4-d581d050b2e3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.309016 Aug 24 01:51:48.754985 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 215/395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:48.773906 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1342ef8a-d7fc-40ae-a90e-6c24173c4953 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 2052 microversion: 2.25 time: 0.384213 Aug 24 01:51:48.774725 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 181/396] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 2052 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:48.810434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.814304 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:51:48.814304 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:51:48.816387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.817068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.817668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.819053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.819855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.821184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.850574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-425612b1-d715-4bd3-9a42-37de62bb6899 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048437 Aug 24 01:51:48.851757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 216/397] 10.222.0.49 () {60 vars in 1217 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:51:48.867460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-3", "block_migration": "auto"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:48.871606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.879834 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=7 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:48.883085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.883892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.884595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.885671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.886738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.888150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.925636 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'flavor' on Instance uuid 96a9043c-8cda-43e7-97be-1345fefa5e8d {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:48.936217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:48.936856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:48.943851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.944364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.944795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.945759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:48.946218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:48.946691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:48.958678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Going to try to live migrate instance to n-h1-854121-3 {{(pid=128566) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:51:49.183413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:49.196111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cfcb659-444c-4321-97b3-ec21c8ff1c75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.264540 Aug 24 01:51:49.199027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 217/398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:48 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:49.217054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:49.218107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:49.227739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.228456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.229245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:49.230209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.230806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.231593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:49.428675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:49.438929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d293c093-3e83-400d-84b9-cbe84a5ccec7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.226140 Aug 24 01:51:49.439748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 218/399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:49 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:49.446332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:49.447317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:49.453924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=38 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:49.462552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.463300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.464509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:49.465967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.466586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.467098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:49.923062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:49.932165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73da8132-ba72-4551-ba0a-9e8bec83af06 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.490301 Aug 24 01:51:49.943854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 219/400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:49 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:49.949244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:49.950145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:49.953737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:49.975459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.977056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.979620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:49.980474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:49.981201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:49.982091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:50.328476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:50.343996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e28d4c93-b161-42d2-a85a-7e3265fd0103 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.403772 Aug 24 01:51:50.345560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 220/401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:49 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:50.351910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:50.352749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:50.361306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:50.362789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:50.363609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:50.364683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:50.365505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:50.366068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:50.550464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=44 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:50.612438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:50.630536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4da00578-9192-4dfe-914a-362753a46486 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.280034 Aug 24 01:51:50.633385 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 221/402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:50 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:50.639852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:50.640890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:50.657394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:50.658142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:50.658823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:50.660402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:50.665278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:50.666532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.065996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:51.074282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1c6a68c-1933-4b1b-b812-0dd2d946271c tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.438783 Aug 24 01:51:51.074865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 222/403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:50 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:51.079979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:51.086448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:51.092896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.094037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.094674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.095978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.096582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.097175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.377833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:51.388205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8f5c4ee-502f-4b6d-9807-175831f70f2f tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.312111 Aug 24 01:51:51.388831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 223/404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:51 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:51.396538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:51.397377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:51.417530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.418278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.418905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.419783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.420854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.421935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.576675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:51.586702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11868577-b983-4718-8a34-c3d8bfa4eec0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.193884 Aug 24 01:51:51.597038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 224/405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:51 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:51.597038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:51.597038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:51.599878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.600373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.602066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.602798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.603289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.603718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.802946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:51.814466 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85b859f1-f95f-4843-a51e-54482dc9d872 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.225485 Aug 24 01:51:51.815696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 225/406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:51 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:51.821218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:51.822081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:51.829608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.830613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.831540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.832472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:51.833175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:51.833817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:51.864522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:52.274296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:52.283233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edfb5405-d841-42f8-a69a-6702ef9c146b tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1319 microversion: 2.1 time: 0.466216 Aug 24 01:51:52.294082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 226/407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:51 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:52.316614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:52.317274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:52.335299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:52.337257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:52.337758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:52.341576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:52.342132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:52.345126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:53.058492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:53.068960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ebeead4-c22d-48d3-8666-d547cd20f3a6 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.768427 Aug 24 01:51:53.073877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 227/408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:52 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:53.079915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:53.080521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:53.096124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:53.102830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:53.105395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:53.106313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:53.108335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:53.109547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:53.583021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:53.599399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbe9c2e0-5a5b-4134-a002-e6328f944382 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.523599 Aug 24 01:51:53.612643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 228/409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:53 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:53.623367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:53.624645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:53.634221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:53.642818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:53.643356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:53.644111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:53.644591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:53.645054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.287323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:54.301602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75b63ce0-0fff-4bc0-bdd8-58d92653c474 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.687784 Aug 24 01:51:54.302186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 229/410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:53 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:54.323342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:54.324394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:54.333543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.334043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.334479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.336781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.337452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.338061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.683661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:54.697167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cacd0a3a-3517-4062-9f67-9f50f9263b7b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.391217 Aug 24 01:51:54.698928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 230/411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:54 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:54.704053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca33f41-3d19-480f-8b0b-031f2aee8e6c", "name": "network-vif-plugged", "status": "completed", "tag": "fa730c8b-9e3c-42b1-89ad-fc103e63dac8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:54.746135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.752277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.752853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.784453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] Creating event network-vif-plugged:fa730c8b-9e3c-42b1-89ad-fc103e63dac8 for instance cca33f41-3d19-480f-8b0b-031f2aee8e6c on n-h2-854121-3 Aug 24 01:51:54.798729 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-034016c0-2b20-452f-84f8-49235e760e02 req-1d0221b2-ba09-4c33-978c-37b56cc65ca7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098469 Aug 24 01:51:54.804955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 231/412] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:54.815727 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3c414130-010d-45cc-9672-980a4ea6cd4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d/action" status: 202 len: 0 microversion: 2.25 time: 5.954296 Aug 24 01:51:54.817741 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 182/413] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:51:48 2022] POST /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d/action => generated 0 bytes in 5958 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:51:54.823470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:54.824539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:54.826775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:54.828223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:54.846532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.847024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.848104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.849376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.850560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.852623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.852949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.854791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.855552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:54.856541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:54.857382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:54.858450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.429249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.439412 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8f2ebad6-fe9b-4fe6-802f-fd5d260fd8d1 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.620299 Aug 24 01:51:55.440083 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 183/414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:54 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:55.445969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:55.446788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:55.458314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.462444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.463164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.464178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.464830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.465397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.472770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.485878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-899db1cc-da15-4a00-b593-6a25c0e2d132 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1469 microversion: 2.1 time: 0.679344 Aug 24 01:51:55.486749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 232/415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:54 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1469 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:55.491711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:55.495815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:55.529975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.532026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.532688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.535226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.535989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.537699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.819003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.832897 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d452981-295a-425e-8b25-ff981f804137 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.391318 Aug 24 01:51:55.836998 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 184/416] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:55 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:55.844597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:55.846848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:55.853565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.854341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.854998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.856507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.857209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.857849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.930972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.943498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.946344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:55.949692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2869759b-289a-4c1a-b2e0-d882807d8013 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.459842 Aug 24 01:51:55.966524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 233/417] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:55 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:55.979694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:55.982307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:55.989054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.989767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.990362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:55.991223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:55.991856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:55.992436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.216611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf393a38-1575-4323-a827-6b96f8122fc7 tempest-DeleteServersAdminTestJSON-486465475 tempest-DeleteServersAdminTestJSON-486465475-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4/action" status: 202 len: 0 microversion: 2.1 time: 0.248478 Aug 24 01:51:56.219905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 234/418] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:51:55 2022] POST /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:51:56.231051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:56.231701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:56.246271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.246769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.247208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.247926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.248381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.257251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.341343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:56.350845 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-24c123a7-037f-415a-92f3-afa08a9696c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.510524 Aug 24 01:51:56.371317 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 185/419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:55 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:56.387025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:56.387648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:56.398772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.399492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.400151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.402712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.403510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.405421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.484242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.484755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.485197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.485660 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lazy-loading 'fault' on Instance uuid 05025172-00a4-41ec-b1b8-e4c3787325d4 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:56.701504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:56.716794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1dadbfa4-b347-4abe-a5a0-229310a983cc tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.495423 Aug 24 01:51:56.719143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 235/420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:56 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:56.727084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:56.729145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:56.750772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.751266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.751698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.752411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.752897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.753516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.817093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:56.873285 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c66e8572-f5c4-4288-a6b9-d1a1729c1f06 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1452 microversion: 2.1 time: 0.500528 Aug 24 01:51:56.885089 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 186/421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:56 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1452 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:56.891727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:56.892337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:56.907557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.908376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.909035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:56.909930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:56.910569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:56.911197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.130756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:57.142104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77b09050-748b-4ecd-9013-a96b0e62bc55 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.421295 Aug 24 01:51:57.159074 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 236/422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:56 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:57.165826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:57.166891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:57.176295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.177457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.180050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.181592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.182374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.183365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.261441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:51:57.504585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5c1b7ae-8820-4673-876b-2490818109c3 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 204 len: 0 microversion: 2.1 time: 0.342085 Aug 24 01:51:57.507443 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 237/423] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:51:57 2022] DELETE /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:51:57.520055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:57.520839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:57.531635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.532131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.532575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.533329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.534242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.534242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.839471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:57.852012 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81885f65-9f2c-4936-a203-85e7a7ca7713 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1321 microversion: 2.1 time: 0.965604 Aug 24 01:51:57.853030 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 187/424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:56 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1321 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:57.858665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71638516-58f1-4f29-943c-d2c030cf9c0c", "name": "network-vif-plugged", "status": "completed", "tag": "883ece66-53cb-4cbd-a2db-f302be6ffbba"}, {"server_uuid": "a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b", "name": "network-vif-plugged", "status": "completed", "tag": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:57.880005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.880554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.881640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.901992 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Creating event network-vif-plugged:883ece66-53cb-4cbd-a2db-f302be6ffbba for instance 71638516-58f1-4f29-943c-d2c030cf9c0c on n-h1-854121-3 Aug 24 01:51:57.902500 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] Creating event network-vif-plugged:615ef30c-4b0d-4316-a6ac-25eb39ba6a63 for instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b on n-h1-854121-3 Aug 24 01:51:57.929917 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-b1287266-2302-4e73-b3e8-70c9c4ae668a req-a0db24b7-2c33-452b-a5b3-c2a85060739c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075132 Aug 24 01:51:57.930845 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 188/425] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:57.935967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:57.936699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:57.954786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.955382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.955972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.956533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:57.957487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:57.958187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:57.993202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.007043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.009017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.012355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cac4b4b-64b9-463b-b26e-7447e3f73ed8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.502249 Aug 24 01:51:58.014183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 238/426] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:57 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:51:58.020460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:58.027625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:58.054695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.057521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.058202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.059982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.060631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.064183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.123726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.124847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.125571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.126281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lazy-loading 'fault' on Instance uuid 05025172-00a4-41ec-b1b8-e4c3787325d4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:51:58.406120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.415882 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cb883b4f-cdbe-4bf6-8586-71dfc387cee0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1476 microversion: 2.1 time: 0.483830 Aug 24 01:51:58.417059 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 189/427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:57 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:58.449349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:58.450059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.451073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:58.467576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f57caaa7-33ca-4359-8b4d-e4e69bb4e6a2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1458 microversion: 2.1 time: 0.446692 Aug 24 01:51:58.468272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 239/428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:58 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1458 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:58.488010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:58.490604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:58.494420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.496148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.498185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.500358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.505357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.506406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.513671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.518213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.518685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.520988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.521847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.522286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.535546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:58.836117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=13 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:58.878042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.888381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60c44d9d-8306-4516-9566-855740c48f07 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.412485 Aug 24 01:51:58.893494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 240/429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:58 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:58.898405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a9043c-8cda-43e7-97be-1345fefa5e8d", "name": "network-vif-unplugged", "status": "completed", "tag": "601fde78-de20-487b-ba11-2b5778ebefcd"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:51:58.924588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.926261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.926886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.954003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] Creating event network-vif-unplugged:601fde78-de20-487b-ba11-2b5778ebefcd for instance 96a9043c-8cda-43e7-97be-1345fefa5e8d on n-h2-854121-3 Aug 24 01:51:58.956656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:58.961260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:51:58.967557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-967ea936-572c-4620-886b-4bc04d2a3254 req-b7d9c3ee-feb3-41cd-a101-418eb61ded7a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072395 Aug 24 01:51:58.969178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 241/430] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:51:58.972198 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2bba0ee2-1115-4c99-8275-ee925fe6b4d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.553822 Aug 24 01:51:58.984751 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 190/431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:58 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:58.986263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:58.987222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:58.997480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:58.998017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:58.998468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:58.999689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:59.000144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:59.000800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:59.040743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:59.042118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:59.051463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:59.053949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:59.054961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:59.055949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:59.056751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:59.057755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:59.575181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:51:59.586473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b020fce-9d17-476a-baa6-fc1bebbb8fc7 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1470 microversion: 2.1 time: 0.616014 Aug 24 01:51:59.607944 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 242/432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:58 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1470 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:51:59.625751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:51:59.626392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:51:59.633022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:59.641555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:59.642034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:51:59.642783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:51:59.643357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:51:59.643771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.114885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.135640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.137196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.138390 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-415c88ba-7ae5-442d-81dd-47a25ce5e2df tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 1.102106 Aug 24 01:52:00.138957 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 191/433] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:51:59 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:52:00.155794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:00.156416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:00.177909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.178324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.178761 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.179474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.179940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.180362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.251727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.252225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.252663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.253140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lazy-loading 'fault' on Instance uuid 05025172-00a4-41ec-b1b8-e4c3787325d4 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:00.475353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.494700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6df6d63-da7c-41c3-bafe-3c2b5d76776c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1475 microversion: 2.1 time: 0.884148 Aug 24 01:52:00.501326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 243/434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:51:59 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1475 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:00.524092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:00.524595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:00.536323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.537322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.538163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.545523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.554179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.554692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.609880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Request method failure captured: Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c/diagnostics HTTP/1.1 Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQkiYrXZKpi3yv-3O-NwQnMM8w2P7BtbDU4O4-llLY_jcd0wbnzaCKoG_l9Ex7UlNw5BbCWhJ81FYG6pffoJDpI1hJd-O2q1sm9PRQDwZ29YWCdUU0yDuF1TYRgv4_A675Ugg4voBBGwmHuu_kXEt_K0Pp-wWL_C9PCSM3oK4zQEYk Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e5aff87beda84cf590022e8869dde8bf Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:00.612543 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e5aff87beda84cf590022e8869dde8bf Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiagnosticsNegativeTest-1684199522-project Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 5f00a714b8254b36a2b46c6b2d3025a8 Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1684199522-project Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:00.613879 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'cca33f41-3d19-480f-8b0b-031f2aee8e6c'} Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:52:00.614554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 24 01:52:00.615717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:00.618192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:00.620814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dd9e7e7-9bee-4e6e-85a0-78d4bccca61d tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.118011 Aug 24 01:52:00.623125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 244/435] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:52:00 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c/diagnostics => generated 117 bytes in 121 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:00.636740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:00.640610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:00.653318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.653945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.656513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.657536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.658101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.659458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.677904 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.687495 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9221fd40-b8fb-4990-8f25-9b881c647fa7 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1458 microversion: 2.1 time: 0.547404 Aug 24 01:52:00.700924 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 192/436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:00 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1458 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:00.721676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:00.722921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:00.729342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.731060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.731723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.732674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.733472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.734641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:00.957624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:00.968770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c393a91-de07-4e85-8c46-6a74072b4b4e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1318 microversion: 2.1 time: 0.343727 Aug 24 01:52:00.983542 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 245/437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:00 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:00.989211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:00.990040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:00.997402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:00.998469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:00.999117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.000062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.000711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.001558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.040665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:52:01.142487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd31ebbf-6c51-4c8e-bb30-72c66f276823 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 204 len: 0 microversion: 2.1 time: 0.157098 Aug 24 01:52:01.145399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 246/438] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:00 2022] DELETE /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:01.154201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a9043c-8cda-43e7-97be-1345fefa5e8d", "tag": "601fde78-de20-487b-ba11-2b5778ebefcd"}, {"server_uuid": "05025172-00a4-41ec-b1b8-e4c3787325d4", "name": "network-vif-deleted", "tag": "a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:01.166557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.167068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.167495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.194708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Creating event network-changed:601fde78-de20-487b-ba11-2b5778ebefcd for instance 96a9043c-8cda-43e7-97be-1345fefa5e8d on n-h2-854121-3 Aug 24 01:52:01.195060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] Creating event network-vif-deleted:a853f22e-dbf0-4a24-b0e7-9d2a8d1087f0 for instance 05025172-00a4-41ec-b1b8-e4c3787325d4 on n-h1-854121-3 Aug 24 01:52:01.206427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d635c677-c9bc-4da2-8685-971564b8e8f6 req-b110c7de-8d97-4552-aafb-d3201e771800 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.057766 Aug 24 01:52:01.208476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 247/439] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:01.214098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:01.214952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:01.225557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.226362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.226518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.254170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.254809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.255561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.469853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:01.498030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8aaf3f7a-3aba-42ab-8409-ba9fc70c5f78 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1476 microversion: 2.1 time: 0.287522 Aug 24 01:52:01.501405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 248/440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:01 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:01.511163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:01.516077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:01.533974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.536951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.539312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.540301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.542796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.543475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.631882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:01.652543 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-51299020-4fa5-4acd-b723-73a74c3a40a1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1329 microversion: 2.1 time: 0.950291 Aug 24 01:52:01.661535 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 193/441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:00 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1329 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:01.674266 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:01.674890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:01.707126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.708901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.710628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.717580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.718291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.718900 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.892216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:01.923315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:01.924960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:01.926158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77ac67b9-1388-400d-9073-d7f11819401b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.423582 Aug 24 01:52:01.940502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 249/442] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:01 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:01.955005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:01.955629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:01.978119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.980046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.980658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:01.986606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:01.987303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:01.989277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.055757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.056744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.057385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.058311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lazy-loading 'fault' on Instance uuid 05025172-00a4-41ec-b1b8-e4c3787325d4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:02.121564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c8133445dc4eff9daf264eb5c20591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '917b0d2fd2ae4f40a9d9300765789560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:02.129376 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb89e67b-1267-4515-a0fc-5355f2ab1782 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 200 len: 1309 microversion: 2.1 time: 0.185578 Aug 24 01:52:02.130595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 250/443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:01 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 1309 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:02.144228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:02.144228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:02.150850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.153742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.154258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.155707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.156280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.156767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.219143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:02.275621 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a1a313fa-be4a-4d8a-acdb-bc1dd9f4bfe9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1475 microversion: 2.1 time: 0.605637 Aug 24 01:52:02.300579 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 194/444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:01 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1475 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:02.522260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:02.528765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:02.528765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:02.543330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.543824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.543960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95ca33df-ea94-4c7b-a469-96a8e7ee4e43 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1467 microversion: 2.1 time: 0.412848 Aug 24 01:52:02.544264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.544455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 251/445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:02 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1467 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:02.552133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.553743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.554384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.576603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:02.579600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:02.599457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.599847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.600283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.615670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.616193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.618520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.679723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lazy-loading 'flavor' on Instance uuid 71638516-58f1-4f29-943c-d2c030cf9c0c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:02.899321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f92703b8-4563-4e5c-9e41-a29c7f50fc55 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c/action" status: 202 len: 0 microversion: 2.1 time: 0.321428 Aug 24 01:52:02.901871 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 252/446] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:02 2022] POST /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:52:02.914165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "name": "network-vif-unplugged", "status": "completed", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:02.932200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:02.933588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:02.934629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:02.960694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Creating event network-vif-unplugged:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h1-854121-3 Aug 24 01:52:02.978380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] Instance c590b19d-c876-47a0-8261-444f49717dea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:52:03.000299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cea7956d-58f6-4700-bbf2-b02fdb59d904 req-e76986dc-0a3f-402a-8282-44b47cdfd2dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095201 Aug 24 01:52:03.005505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 253/447] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:03.021139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:03.021972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:03.036169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.037501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.037982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.048863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.049690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.050445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.086181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:03.110024 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-326655ca-1578-4881-8a1c-f64238365da1 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1476 microversion: 2.1 time: 0.589604 Aug 24 01:52:03.116331 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 195/448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:02 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:03.129890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:03.131423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:03.150453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.151322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.151979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.152924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.153599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.154224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.559769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:03.569167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30e55761-85c2-40a2-8646-5d21e3180290 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1533 microversion: 2.1 time: 0.561451 Aug 24 01:52:03.572384 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 254/449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:03 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1533 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:03.582052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:03.583790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:03.597272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.609806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.610134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.610884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:03.611462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:03.611768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:03.617696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:04.154686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.167053 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-11d9ac31-3b6d-4753-a9f9-382bc550f883 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1475 microversion: 2.1 time: 1.048364 Aug 24 01:52:04.167864 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 196/450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:03 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1475 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:04.171928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.180921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.182473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.185968 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:04.187010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:04.189781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6de8ab56-f187-4235-8477-6f96d3bbbe57 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.609303 Aug 24 01:52:04.202657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 255/451] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:03 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:04.202657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:04.202657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:04.213506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.215598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.216417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.218590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.219580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.220266 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.221959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.225372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.225836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.226830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.227494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.228154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.248248 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 HTTP/1.1 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:04.250747 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.251968 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '05025172-00a4-41ec-b1b8-e4c3787325d4'} Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:04.252652 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.253806 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.254812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:04.254812 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8d482147-67ba-4717-9e45-a4aa221bd2b4 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 404 len: 111 microversion: 2.1 time: 0.083131 Aug 24 01:52:04.254812 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 197/452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:04 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:04.273463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-feec1d9a-7e40-4c6b-9b61-e5c1e5e4a5e5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'create', calling method: .version_select at 0x7f6b92855550>, body: {"pool": "e4e21d0c-49ed-41b8-af2c-c599dfad641a"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:04.597016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.635787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8075164f-942d-4e59-8ff9-0db3cbd9fecb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1475 microversion: 2.1 time: 0.443299 Aug 24 01:52:04.652465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 256/453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:04 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1475 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:04.663130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:04.665839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:04.673785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:04.695747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.699990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.703995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.706322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.709924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.710710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.879628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f00a714b8254b36a2b46c6b2d3025a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5aff87beda84cf590022e8869dde8bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:04.901116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ceee3e9-2dd0-4ec1-b0ea-e7e700030344 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 200 len: 1306 microversion: 2.1 time: 0.253660 Aug 24 01:52:04.905869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 257/454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:04 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 1306 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:04.918865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:04.919646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:04.938977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.940361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.941091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.942160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:04.943096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:04.943749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:04.963294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 HTTP/1.1 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:04.965506 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.966752 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05025172-00a4-41ec-b1b8-e4c3787325d4'} Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:04.967437 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:04.969759 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:04.971278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:04.972159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19257fbc-cab6-4939-b504-fcb9069c0788 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 404 len: 111 microversion: 2.1 time: 0.065078 Aug 24 01:52:04.974324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 258/455] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:04 2022] DELETE /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:04.988015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca33f41-3d19-480f-8b0b-031f2aee8e6c", "name": "network-vif-deleted", "tag": "fa730c8b-9e3c-42b1-89ad-fc103e63dac8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:05.009851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.010497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.011250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.025722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] Creating event network-vif-deleted:fa730c8b-9e3c-42b1-89ad-fc103e63dac8 for instance cca33f41-3d19-480f-8b0b-031f2aee8e6c on n-h2-854121-3 Aug 24 01:52:05.032266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a488e206-c1c6-4b27-a36d-305f046e1839 req-310f9721-7438-49e3-97b0-4c33979be75e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055362 Aug 24 01:52:05.033187 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 259/456] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:05.042528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:05.043468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: 05025172-00a4-41ec-b1b8-e4c3787325d4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:05.051751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.052306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.052835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.053596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.054113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.054599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.072833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 HTTP/1.1 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:05.074553 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:05.075805 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05025172-00a4-41ec-b1b8-e4c3787325d4'} Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:05.076481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. Aug 24 01:52:05.077656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.078636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance 05025172-00a4-41ec-b1b8-e4c3787325d4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:05.078636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a16c6607-6603-4f30-b7eb-5658770a65bb tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4" status: 404 len: 111 microversion: 2.1 time: 0.041674 Aug 24 01:52:05.078636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 260/457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:05 2022] GET /compute/v2.1/servers/05025172-00a4-41ec-b1b8-e4c3787325d4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:05.084320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:05.084984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:05.091673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.092254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.093328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.094079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.094597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.095082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.127079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 HTTP/1.1 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:05.129965 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.131252 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ada1ef2c-8c41-4c86-b83d-9e73ee648461'} Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:05.132090 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.133831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.137281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:05.138169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1aa892ef-44e2-4655-9a76-3baecacb7b87 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 404 len: 111 microversion: 2.1 time: 0.057583 Aug 24 01:52:05.138932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 261/458] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:05 2022] DELETE /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:52:05.146178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:05.156288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.156927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.157370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.169892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Creating event network-changed:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h1-854121-3 Aug 24 01:52:05.177640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] Instance c590b19d-c876-47a0-8261-444f49717dea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:52:05.189438 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-47db7c46-c4c7-4f5d-a3d4-fd5ba826ab6a req-43268f26-001c-49f3-a1cd-c2e882845c99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046565 Aug 24 01:52:05.190336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 262/459] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:05.196053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:05.196800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] [instance: ada1ef2c-8c41-4c86-b83d-9e73ee648461] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:05.203923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.204583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.205068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.205763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.206223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.206772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.222584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] HTTP exception thrown: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Request method failure captured: Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 HTTP/1.1 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYPxvRfkubxYluZKUwRpG3f33dmyBxZ4_x92U1W3JtBw6QlWpmhsO5hX0EwpUyiZfVWys7bETox5Spz4HEeg3xqeE1IqWvhOCE-4y73rpOwpWsYDANTSA7YiVFETTNJ0F7L87kILuixiNo8Mjv-STj6dZRbNDWPx6mAcxkdEl6K6SZs Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:05.224234 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_917b0d2fd2ae4f40a9d9300765789560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 917b0d2fd2ae4f40a9d9300765789560 Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-957674381 Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 53c8133445dc4eff9daf264eb5c20591 Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersAdminTestJSON-957674381-project Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.225466 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ada1ef2c-8c41-4c86-b83d-9e73ee648461'} Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:05.226145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. Aug 24 01:52:05.227772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:05.228812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] Returning 404 to user: Instance ada1ef2c-8c41-4c86-b83d-9e73ee648461 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:05.228812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41a8f098-56d8-41a8-bbb3-772e232aa4d2 tempest-DeleteServersAdminTestJSON-957674381 tempest-DeleteServersAdminTestJSON-957674381-project] 10.222.0.49 "GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461" status: 404 len: 111 microversion: 2.1 time: 0.034220 Aug 24 01:52:05.230000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 263/460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:05 2022] GET /compute/v2.1/servers/ada1ef2c-8c41-4c86-b83d-9e73ee648461 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:05.235340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:05.235961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:05.243435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.243435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.243735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.244349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.244832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.245260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.645565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:05.654391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9796fe59-0f42-43f1-9a88-5b0d6f004b75 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1458 microversion: 2.1 time: 0.423307 Aug 24 01:52:05.656059 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 264/461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:05 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1458 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:05.662433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:05.663273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:05.675072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.677413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.678625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:05.681033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:05.695709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:05.702612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:06.641327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:06.669300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:06.674707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:06.678367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-156a29f5-970a-4d0c-8425-5b75003c3d51 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 1.020719 Aug 24 01:52:06.684915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 265/462] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:05 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:06.690570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:06.698190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:06.710368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:06.711091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:06.711795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:06.712731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:06.713389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:06.716172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:07.440114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:07.448598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c8680bc-1aa3-4ac7-a997-7167900c5c24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1473 microversion: 2.1 time: 0.762076 Aug 24 01:52:07.455991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 266/463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:06 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1473 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:07.465140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:07.465749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:07.482573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:07.483374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:07.484111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:07.485052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:07.485497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:07.485918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.656304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3a4f7b2-98c5-4811-ae9a-2d9156c75ec4 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1609 microversion: 2.1 time: 1.198037 Aug 24 01:52:08.658560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 267/464] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:07 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1609 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:08.685336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:08.687202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] [instance: cca33f41-3d19-480f-8b0b-031f2aee8e6c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:08.708295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.710632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.717074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.719468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.720485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.721201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.738978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] HTTP exception thrown: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Request method failure captured: Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c HTTP/1.1 Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQkiYrXZKpi3yv-3O-NwQnMM8w2P7BtbDU4O4-llLY_jcd0wbnzaCKoG_l9Ex7UlNw5BbCWhJ81FYG6pffoJDpI1hJd-O2q1sm9PRQDwZ29YWCdUU0yDuF1TYRgv4_A675Ugg4voBBGwmHuu_kXEt_K0Pp-wWL_C9PCSM3oK4zQEYk Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e5aff87beda84cf590022e8869dde8bf Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:08.741229 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e5aff87beda84cf590022e8869dde8bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e5aff87beda84cf590022e8869dde8bf Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1684199522 Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiagnosticsNegativeTest-1684199522-project Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 5f00a714b8254b36a2b46c6b2d3025a8 Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1684199522-project Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. Aug 24 01:52:08.742995 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cca33f41-3d19-480f-8b0b-031f2aee8e6c'} Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:08.743866 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. Aug 24 01:52:08.746539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:08.750037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] Returning 404 to user: Instance cca33f41-3d19-480f-8b0b-031f2aee8e6c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:08.751214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08960c82-113f-4698-bc4b-b542506a2f66 tempest-ServerDiagnosticsNegativeTest-1684199522 tempest-ServerDiagnosticsNegativeTest-1684199522-project] 10.222.0.49 "GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c" status: 404 len: 111 microversion: 2.1 time: 0.088048 Aug 24 01:52:08.752347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 268/465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:08 2022] GET /compute/v2.1/servers/cca33f41-3d19-480f-8b0b-031f2aee8e6c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:08.761109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:08.761907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:08.769345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.770164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.771415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.772393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.773030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.773655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.859606 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-feec1d9a-7e40-4c6b-9b61-e5c1e5e4a5e5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.605861 Aug 24 01:52:08.866840 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 198/466] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:52:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:08.867676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:08.868291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:08.882376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.884568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.885103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:08.888381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:08.889419 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:08.890796 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:09.055671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:09.082564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:09.084609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:09.088687 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e40fbf24-f3aa-4cfd-83df-d7d8193b4c1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.334874 Aug 24 01:52:09.091914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 269/467] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:08 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:09.100837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:09.105628 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:09.105628 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:09.111257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:09.114255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:09.117641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:09.118757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:09.119709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:09.120359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:09.183908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd008976-3d1a-42a2-86f5-79474a919470 tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.090539 Aug 24 01:52:09.187343 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 270/468] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:52:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:09.201355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: .version_select at 0x7f6b98e7a040>, body: {"addFloatingIp": {"address": "172.25.9.81"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:09.203983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:09.219011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:09.219787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:09.220403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:09.222239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:09.223608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:09.225235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:09.335946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:52:09.336608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquired lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:52:09.979697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:10.054004 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-74252c58-2a4d-411c-940b-23b8343eed27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1473 microversion: 2.1 time: 1.188619 Aug 24 01:52:10.056241 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 199/469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:08 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1473 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:10.062287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:10.065873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:10.079488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.080183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.080811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.081898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.082505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.083079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.119144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Lazy-loading 'flavor' on Instance uuid 71638516-58f1-4f29-943c-d2c030cf9c0c {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:10.148016 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 71638516-58f1-4f29-943c-d2c030cf9c0c while it is in vm_state suspended Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Request method failure captured: Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c/action HTTP/1.1 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 97 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQV1ExPWvRNxPCy29h8FB5BfatE0tCvr01VG9kT-uMxBPHOovX8MyORrkfzHXdeK0gcVVkzrPPxbBVYGb8SNn4r4K2yfUHxbkWmZ-W9n7N1knhqqvruFWGSEjO2ocCVLaP6aV0H_pgFgttd_HzUtVrLnNpLmSIYkjjqz5fxR5oMt4o Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 5908678812eb4c94a6c36e265c177931 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:10.156204 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5908678812eb4c94a6c36e265c177931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5908678812eb4c94a6c36e265c177931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5908678812eb4c94a6c36e265c177931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5908678812eb4c94a6c36e265c177931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 5908678812eb4c94a6c36e265c177931 Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-686608316 Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-LiveMigrationNegativeTest-686608316-project-admin Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 590ea56ebb954c0fbbaf8a6b23d20db1 Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-LiveMigrationNegativeTest-686608316-project-admin Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": true, "disk_over_commit": false}} Aug 24 01:52:10.157888 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: exception: Cannot 'os-migrateLive' instance 71638516-58f1-4f29-943c-d2c030cf9c0c while it is in vm_state suspended Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '71638516-58f1-4f29-943c-d2c030cf9c0c', 'body': {'os-migrateLive': {'host': 'n-h2-854121-3', 'block_migration': True, 'disk_over_commit': False}}} Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 01:52:10.158695 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:10.161870 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 71638516-58f1-4f29-943c-d2c030cf9c0c while it is in vm_state suspended Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 71638516-58f1-4f29-943c-d2c030cf9c0c while it is in vm_state suspended Aug 24 01:52:10.166601 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:10.171509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 71638516-58f1-4f29-943c-d2c030cf9c0c while it is in vm_state suspended {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:10.173056 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e3daf61f-3707-4ed0-a351-77e4dd97ab2e tempest-LiveMigrationNegativeTest-686608316 tempest-LiveMigrationNegativeTest-686608316-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c/action" status: 409 len: 155 microversion: 2.1 time: 0.114892 Aug 24 01:52:10.174049 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 200/470] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:10 2022] POST /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c/action => generated 155 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:52:10.190698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:10.191321 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:10.201062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.201062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.201062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.201062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.202262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.202262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.813888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:10.826256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:10.829889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:10.833805 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9f1baf87-6702-48a4-96e4-6821f055860c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.644557 Aug 24 01:52:10.857692 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 201/471] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:10 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:10.868926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:10.874943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:10.891978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.895372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.896562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.897976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:10.901780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:10.904285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:10.982006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:52:11.211369 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9dec582b-5ccb-4f44-8b7c-f570208852d5 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "DELETE /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 204 len: 0 microversion: 2.1 time: 0.351899 Aug 24 01:52:11.212395 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 202/472] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:10 2022] DELETE /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:11.224744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:11.226375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:11.240771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:11.242584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:11.244941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:11.245876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:11.249314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:11.251935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:11.900341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:11.915586 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d69a8af4-237f-419b-8e97-60e9b3d7166a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1470 microversion: 2.1 time: 0.699882 Aug 24 01:52:11.918417 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 203/473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:11 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1470 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:11.937591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:11.939555 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:11.952164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:11.952925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:11.953793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:11.955544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:11.956176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:11.957122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:12.306808 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:12.325416 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-55e0eb65-4be8-436b-99d7-de87db25b84f tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1464 microversion: 2.1 time: 0.401259 Aug 24 01:52:12.328948 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 204/474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:11 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1464 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:12.337404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:12.341676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:12.359142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:12.359649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:12.360089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:12.365141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:12.365141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:12.365141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:12.760865 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:12.777771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:12.779461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:12.781527 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a1f2c4e4-687a-4884-bddf-3aeaf55d286b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1569 microversion: 2.25 time: 0.453085 Aug 24 01:52:12.797091 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 205/475] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:12 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1569 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:12.808686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:12.814457 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:12.823009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:12.828034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:12.828820 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:12.829773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:12.830441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:12.831074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:12.954901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:13.027788 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6f5b5be6-36d6-48e9-af9f-b7e55eb775ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea/action" status: 204 len: 0 microversion: 2.1 time: 0.227851 Aug 24 01:52:13.047075 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 206/476] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:12 2022] POST /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:13.630378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c74de3fd-4818-457f-9987-43a355cbec5c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:13.648750 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c74de3fd-4818-457f-9987-43a355cbec5c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.599122 Aug 24 01:52:13.659201 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 207/477] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:52:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:13.660325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c74de3fd-4818-457f-9987-43a355cbec5c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:13.661275 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c74de3fd-4818-457f-9987-43a355cbec5c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001253 Aug 24 01:52:13.676889 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 208/478] 10.222.0.49 () {56 vars in 886 bytes} [Wed Aug 24 01:52:13 2022] GET /compute/ => generated 377 bytes in 17 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 01:52:13.693429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:13.694205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:13.720650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Building network info cache for instance {{(pid=128567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:52:13.740156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:13.749880 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:13.750345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:13.751097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:13.751572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:13.752007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:14.374235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:14.384484 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7b1095f8-e3b9-4b0e-8cb5-113930ac544b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1470 microversion: 2.1 time: 0.706439 Aug 24 01:52:14.409093 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 209/479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:13 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1470 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:14.415805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:14.416658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:14.425153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:14.426958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:14.427869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:14.428598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:14.430154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:14.430858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:14.431505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:14.775694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:14.788216 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c6ea48ee-a87a-4d0b-aa84-8dc73d16814d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1464 microversion: 2.1 time: 0.377638 Aug 24 01:52:14.790546 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 210/480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:14 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:15.202392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-19760d23-bfd7-4848-9f82-d365ee33c14d tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-534756889", "id": 2042875863, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:15.207057 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:15.207057 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:15.260150 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-19760d23-bfd7-4848-9f82-d365ee33c14d tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.468283 Aug 24 01:52:15.261416 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 211/481] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:14 2022] POST /compute/v2.1/flavors => generated 424 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:15.278874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b", "tag": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:15.301047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:15.304044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:15.305721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:15.337208 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] Creating event network-changed:615ef30c-4b0d-4316-a6ac-25eb39ba6a63 for instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b on n-h1-854121-3 Aug 24 01:52:15.352431 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-925f415a-2cdb-4c8d-8af2-2f8245c87a25 req-3d28a201-356a-4b54-9e60-40a089928330 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087498 Aug 24 01:52:15.357342 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 212/482] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:15.367479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:15.368529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:15.377817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:15.378575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:15.380157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:15.381365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:15.382148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:15.382889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:15.934895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:15.966928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:15.975556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:15.977113 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1f37a08c-6d94-4066-aa7c-1741201d3f7d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1559 microversion: 2.25 time: 0.616112 Aug 24 01:52:15.983199 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 213/483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:15 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1559 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:15.998146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "name": "network-vif-plugged", "status": "completed", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:16.009925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:16.010563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:16.011180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:16.027853 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Creating event network-vif-plugged:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h1-854121-3 Aug 24 01:52:16.039203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] Instance c590b19d-c876-47a0-8261-444f49717dea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:52:16.061249 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-5d0b2f40-2cfd-4bdb-b373-353d2d28e774 req-9bdef4f0-cdff-48ed-990d-fb56f08e57a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076499 Aug 24 01:52:16.062495 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 214/484] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:16.068877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1aab9ad0-e0f6-4b71-99f3-c97f471c4c3d tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:16.093400 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1aab9ad0-e0f6-4b71-99f3-c97f471c4c3d tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028779 Aug 24 01:52:16.099065 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 215/485] 10.222.0.49 () {58 vars in 1182 bytes} [Wed Aug 24 01:52:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:52:16.105312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:16.106292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:16.113737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:16.114502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:16.115227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:16.116351 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:16.117065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:16.117650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:16.825130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:16.834128 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2dcb916e-a054-44b6-bb66-8480fe65383c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1470 microversion: 2.1 time: 0.733695 Aug 24 01:52:16.835259 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 216/486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:16 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1470 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:16.841861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:16.842896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:16.852667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:16.855756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:16.856367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:16.860740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:16.861428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:16.862053 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:17.114554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:17.122976 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-59f853a1-9ca5-46c3-99f3-39d0647ad91a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1464 microversion: 2.1 time: 0.286552 Aug 24 01:52:17.137977 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 217/487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:16 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:17.143203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-be887c6e-51de-4031-b780-11bad0f4b33b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '.version_select at 0x7f6b9282e0d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:17.147759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be887c6e-51de-4031-b780-11bad0f4b33b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:17.148493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be887c6e-51de-4031-b780-11bad0f4b33b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:17.149438 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be887c6e-51de-4031-b780-11bad0f4b33b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:17.163999 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-be887c6e-51de-4031-b780-11bad0f4b33b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1105 microversion: 2.25 time: 0.024503 Aug 24 01:52:17.164867 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 218/488] 10.222.0.49 () {60 vars in 1184 bytes} [Wed Aug 24 01:52:17 2022] GET /compute/v2.1/os-migrations => generated 1105 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:17.179012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-35ff7fe6-1814-49fe-9a18-2e48b7d2a2b9 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-616371078", "id": 5506154, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:17.194570 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:17.194570 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:17.215975 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-35ff7fe6-1814-49fe-9a18-2e48b7d2a2b9 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.040500 Aug 24 01:52:17.217734 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 219/489] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:17 2022] POST /compute/v2.1/flavors => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:17.681102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9282ed30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:17.684623 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:17.684623 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:17.686772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:17.687428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:17.688231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:17.706627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:17.707271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:17.707712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:17.742628 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] HTTP exception thrown: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Request method failure captured: Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad HTTP/1.1 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 56 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRQ0X2VDSLklpTbTIu2vTx1hqJykBn4Lf4Ycng7R0fa3_UJ5-hyph2FGo1uLCdTJl71kRvbeCm7sulldXdIuWD3WYtyZCDdPd0Ljvf35p1WFi18-oVMzLtDGCPKsPC32MmV5WRs4H49cDp64Qxc74ZDaPYZ4uzbUrMakcuihICJxG4 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:17.746310 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: ebc1828d597e497f95c03dc43090936f Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:17.747699 n-d-854121-3 devstack@n-api.service[128566]: exception: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '5377c18f-4a49-4f8e-9088-89ef50892aad', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.748532 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:17.749752 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:17.751077 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:17.751077 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:17.751077 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:17.753343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Returning 404 to user: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:17.755180 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ad8dfced-0fef-4d48-8146-20912c0a491f tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad" status: 404 len: 110 microversion: 2.53 time: 0.536299 Aug 24 01:52:17.756277 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 220/490] 10.222.0.49 () {62 vars in 1309 bytes} [Wed Aug 24 01:52:17 2022] PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad => generated 110 bytes in 538 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:52:17.766361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:17.767590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:17.778751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:17.779432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:17.780615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:17.781726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:17.782335 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:17.783659 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.082358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 96a9043c-8cda-43e7-97be-1345fefa5e8d {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:18.110323 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-909d7b30-1079-4065-920f-28a928095a75 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 2052 microversion: 2.25 time: 0.345685 Aug 24 01:52:18.126144 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 221/491] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:17 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 2052 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:18.146213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd7e541f-b915-4f63-9bfa-0fddb0f204e4 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:18.156152 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bd7e541f-b915-4f63-9bfa-0fddb0f204e4 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028997 Aug 24 01:52:18.157024 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 222/492] 10.222.0.49 () {58 vars in 1182 bytes} [Wed Aug 24 01:52:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:52:18.161781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9295e430>, body: {"status": "disabled"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:18.165039 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:18.165039 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:18.167090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.167840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.168524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.186765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.188783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.190340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.205693 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] HTTP exception thrown: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Request method failure captured: Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad HTTP/1.1 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 22 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRQ0X2VDSLklpTbTIu2vTx1hqJykBn4Lf4Ycng7R0fa3_UJ5-hyph2FGo1uLCdTJl71kRvbeCm7sulldXdIuWD3WYtyZCDdPd0Ljvf35p1WFi18-oVMzLtDGCPKsPC32MmV5WRs4H49cDp64Qxc74ZDaPYZ4uzbUrMakcuihICJxG4 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:18.209602 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: ebc1828d597e497f95c03dc43090936f Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: {"status": "disabled"} Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: exception: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:18.211288 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '5377c18f-4a49-4f8e-9088-89ef50892aad', 'body': {'status': 'disabled'}} Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:18.212125 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:18.213528 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:18.217731 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:18.217731 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:18.221297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Returning 404 to user: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:18.224850 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a452da2b-00dd-4dad-9420-7a9214b3f703 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad" status: 404 len: 110 microversion: 2.53 time: 0.066600 Aug 24 01:52:18.245880 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 223/493] 10.222.0.49 () {62 vars in 1309 bytes} [Wed Aug 24 01:52:18 2022] PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:52:18.254634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:18.255814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:18.268490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.269187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.270409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.271330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.271953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.272538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.586500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:18.594787 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0e1ca8fb-66fb-4aa0-acd4-075a93274be8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1470 microversion: 2.1 time: 0.347838 Aug 24 01:52:18.600271 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 224/494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:18 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:18.613110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71638516-58f1-4f29-943c-d2c030cf9c0c", "name": "network-vif-deleted", "tag": "883ece66-53cb-4cbd-a2db-f302be6ffbba"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:18.628474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.637149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.637908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.660475 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] Creating event network-vif-deleted:883ece66-53cb-4cbd-a2db-f302be6ffbba for instance 71638516-58f1-4f29-943c-d2c030cf9c0c on n-h1-854121-3 Aug 24 01:52:18.673273 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-f375566f-9820-411c-b436-5bd2a66037cc req-ce688032-0ca8-4cec-99a3-901d217bb5b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071458 Aug 24 01:52:18.674752 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 225/495] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:18.683434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71638516-58f1-4f29-943c-d2c030cf9c0c", "name": "network-vif-unplugged", "status": "completed", "tag": "883ece66-53cb-4cbd-a2db-f302be6ffbba"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:18.726726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.727474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.728125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.759991 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] Creating event network-vif-unplugged:883ece66-53cb-4cbd-a2db-f302be6ffbba for instance 71638516-58f1-4f29-943c-d2c030cf9c0c on n-h1-854121-3 Aug 24 01:52:18.795773 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-037d535e-b5d3-4ebf-8662-d2b16ba12a8b req-6df77764-dc98-4dbc-a515-2351c6083efc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119574 Aug 24 01:52:18.797571 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 226/496] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:18.805175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:18.805901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:18.816581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.816581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.816581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.817750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.817750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.817750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.855198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.856532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.857190 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.858374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lazy-loading 'fault' on Instance uuid 71638516-58f1-4f29-943c-d2c030cf9c0c {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:18.891388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Updating instance_info_cache with network_info: [{"id": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63", "address": "fa:16:3e:00:7f:56", "network": {"id": "703d5e47-7c1f-4c8b-a044-dfccc07fdccf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1014499828-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "00ec459a29ce43e88d22dc615c3bb38f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap615ef30c-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:52:18.938278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Releasing lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:52:18.939372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-590d531e-056f-4d90-bec8-cd7e7e4f90f9 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 202 len: 0 microversion: 2.1 time: 9.749241 Aug 24 01:52:18.940886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:18.941072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 271/497] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:09 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 0 bytes in 9751 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:52:18.950857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3956b83b-1876-4ed4-a513-cc397f83358c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Action: 'create', calling method: .version_select at 0x7f6b92824940>, body: {"keypair": {"name": "tempest-keypair-929206611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoqGuiUsFEj9tnYz7uOrWq8VYNIW6ml7tACL+5iK3hYHgsw4W5KkejsxkU7NEVNWF6GcekHaO2zcS8cUPVr/X1YyBxZPu9JAqswZraYvCIYJqJ3yPdfvzBmtl63WnD8LA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:18.953388 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9550ecdc-e20a-4d2e-91a3-3cc6658c0eb7 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 200 len: 1308 microversion: 2.1 time: 0.153738 Aug 24 01:52:18.954316 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 227/498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:18 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:18.972369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92c1ef70>, body: {"status": "enabled"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:18.975876 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:18.975876 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:18.977551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.981091 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.981744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:18.994180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:18.994638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3956b83b-1876-4ed4-a513-cc397f83358c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for project 4f2880aeff3141ca85e2148b1473f471. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:18.998334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:18.998802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:19.008651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3956b83b-1876-4ed4-a513-cc397f83358c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for user 09c8b150bd864992a5eba1af41e760ae and project 4f2880aeff3141ca85e2148b1473f471. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:19.008954 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] HTTP exception thrown: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Request method failure captured: Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: request: PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad HTTP/1.1 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 21 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRQ0X2VDSLklpTbTIu2vTx1hqJykBn4Lf4Ycng7R0fa3_UJ5-hyph2FGo1uLCdTJl71kRvbeCm7sulldXdIuWD3WYtyZCDdPd0Ljvf35p1WFi18-oVMzLtDGCPKsPC32MmV5WRs4H49cDp64Qxc74ZDaPYZ4uzbUrMakcuihICJxG4 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:19.017077 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a6fe5a85a98c4c47ab64def2247fe93c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: a6fe5a85a98c4c47ab64def2247fe93c Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587 Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: ebc1828d597e497f95c03dc43090936f Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: {"status": "enabled"} Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: exception: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:19.018715 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '5377c18f-4a49-4f8e-9088-89ef50892aad', 'body': {'status': 'enabled'}} Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:19.019850 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:19.021176 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:19.022466 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. Aug 24 01:52:19.022466 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:19.024316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Returning 404 to user: Service 5377c18f-4a49-4f8e-9088-89ef50892aad could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:19.031082 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-492bde0d-b7c2-48ce-8a54-13540801e21c tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad" status: 404 len: 110 microversion: 2.53 time: 0.074719 Aug 24 01:52:19.035674 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 228/499] 10.222.0.49 () {62 vars in 1309 bytes} [Wed Aug 24 01:52:18 2022] PUT /compute/v2.1/os-services/5377c18f-4a49-4f8e-9088-89ef50892aad => generated 110 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:52:19.053773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-867647111", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "0c6330be-cca7-4bf4-967a-c3f5a62fa964"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:19.055996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3956b83b-1876-4ed4-a513-cc397f83358c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113426 Aug 24 01:52:19.056672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 272/500] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:52:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:19.085745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6ee2819-0664-42d9-aa14-75f8a7bbb3e7 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'create', calling method: .version_select at 0x7f6b9283eb80>, body: {"pool": "e4e21d0c-49ed-41b8-af2c-c599dfad641a"} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:19.134993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:19.187632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] validate_networks() for [('0c6330be-cca7-4bf4-967a-c3f5a62fa964', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:20.147533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:20.148042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:20.148603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:20.149204 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:20.149675 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:20.165035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.166236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.166938 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.168050 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.171006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.172163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.202604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:20.213084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for user 6223af42e4e34d7cb4f327824ac148af and project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:20.249463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:20.253853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:20.323670 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8ad8d130-a2cc-42b0-9a71-b34b6683d047 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.282618 Aug 24 01:52:20.324312 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 229/501] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:52:20.350722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:20.354586 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:20.354586 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:20.356016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.358087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.358712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.359653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.360267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.360872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.403374 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-91fbd8ec-89e0-41e2-b322-ec7fa85576ef tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.055015 Aug 24 01:52:20.410503 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 230/502] 10.222.0.49 () {60 vars in 1178 bytes} [Wed Aug 24 01:52:20 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:20.702896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ace1ab00-8dbb-46bd-b3fb-a09c0dd05671 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:20.704650 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:20.704650 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:20.711611 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-ace1ab00-8dbb-46bd-b3fb-a09c0dd05671 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ace1ab00-8dbb-46bd-b3fb-a09c0dd05671 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin] Request method failure captured: Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRTSjCpFg9Vykw2_3m8Y6h9LcjKABysAMmpdSr0Fdobigbg4oRj4aAUJ58wwBZpNKpYejMOCiIv2pKKhY3tV7S3zUxSFwXNOpl4DUQdepx1dBbLP6dS6-LWqMjMz4cGmBEcoHtkngttLc6Ilab_2JiqeOccFF8iU62hcLyrntlfmFU Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: c05afe86da3f423eb8c02550bb159821 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:20.730805 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c05afe86da3f423eb8c02550bb159821"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c05afe86da3f423eb8c02550bb159821"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c05afe86da3f423eb8c02550bb159821"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c05afe86da3f423eb8c02550bb159821"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: c05afe86da3f423eb8c02550bb159821 Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 25d1128cee194bd196990c2da5a353b9 Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:20.732547 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid timestamp for date invalid_time Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'invalid_time'} Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:20.733450 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 24 01:52:20.735449 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.739099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ace1ab00-8dbb-46bd-b3fb-a09c0dd05671 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:20.741559 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ace1ab00-8dbb-46bd-b3fb-a09c0dd05671 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025 tempest-InstanceUsageAuditLogNegativeTestJSON-2114156025-project-admin] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.328815 Aug 24 01:52:20.742709 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 231/503] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 01:52:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 332 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:52:20.764602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:20.770551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:20.787472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.788961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.790736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.793738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.794235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.794676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.888544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6ee2819-0664-42d9-aa14-75f8a7bbb3e7 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.830414 Aug 24 01:52:20.890157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 273/504] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:52:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:20.897952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:20.898730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 71638516-58f1-4f29-943c-d2c030cf9c0c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:20.913110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.919438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.920135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.921085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:20.921661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:20.922161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:20.956025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] HTTP exception thrown: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Request method failure captured: Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c HTTP/1.1 Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQUvqmNXLa3y8CiL6Xk0TuRnJauQccGXXhL2y9EivdTc75II1yBE6_NtiHidry_FVmNFWGcr9uk6XawcgVn7KXwAsBhIzieUmIyaWFNw9UbVk-eCVe7K0ZPdyPvk6SAO3n4QfYJQFYbQBILrGqhkdMSLNk83b7dOBDbIavsGcvVVJg Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c417d3076cb7493eb2faebbad91ac38d Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:20.957752 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c417d3076cb7493eb2faebbad91ac38d Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveMigrationNegativeTest-453401999-project Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e0e6c635ba444a0c8cc501127d819774 Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveMigrationNegativeTest-453401999-project Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. Aug 24 01:52:20.959059 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '71638516-58f1-4f29-943c-d2c030cf9c0c'} Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:20.959800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. Aug 24 01:52:20.961033 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:20.962157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Returning 404 to user: Instance 71638516-58f1-4f29-943c-d2c030cf9c0c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:20.962157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04658475-8206-4b3f-879c-b7be2eca1115 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c" status: 404 len: 111 microversion: 2.1 time: 0.067889 Aug 24 01:52:20.962157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 274/505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:20 2022] GET /compute/v2.1/servers/71638516-58f1-4f29-943c-d2c030cf9c0c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:20.966659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:20.967387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:21.048437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.058358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.060281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.062108 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f1ebcbd-bb07-4e3b-9d9f-ec1a20afe331 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1261 microversion: 2.25 time: 0.101521 Aug 24 01:52:21.062796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 275/506] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:20 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:21.081196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.083881 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:21.083881 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:21.085560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.086342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.086794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.087793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.089011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.089679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.136507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-319503c6-0e0b-4737-8c2a-59fd8b16e53d tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.072495 Aug 24 01:52:21.137158 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 276/507] 10.222.0.49 () {60 vars in 1211 bytes} [Wed Aug 24 01:52:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:21.303360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa8f43c8-9a4b-4111-8cb0-6533c8a06edf tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.304314 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:21.304314 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:21.305450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa8f43c8-9a4b-4111-8cb0-6533c8a06edf tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f44003157bec4733a5f1a355ba0c2b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5db6302bf943dcb254bba6888b55f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa8f43c8-9a4b-4111-8cb0-6533c8a06edf tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Request method failure captured: Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYRSEAGaNFrukhNmz0bEblfN2LoVd1uBZsktAwz8tcMOuYH-vqIUArBxzOJBncdHI1ThMiROWmh92po8g9OtuDNAelDaHIzMmnZXtqKDuD-2rrnlUS9rIxcU15Y9Jf8NjOi6NkT1B15Rk8LGbuyGsCyAoGoXUDdirqAk2xZv5VUU7Z8 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ab5db6302bf943dcb254bba6888b55f2 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:21.307200 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ab5db6302bf943dcb254bba6888b55f2 Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f44003157bec4733a5f1a355ba0c2b6d Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project Aug 24 01:52:21.308940 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:52:21.309637 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 24 01:52:21.311573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.312819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa8f43c8-9a4b-4111-8cb0-6533c8a06edf tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:21.312819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa8f43c8-9a4b-4111-8cb0-6533c8a06edf tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.168925 Aug 24 01:52:21.314477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 277/508] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:52:21 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:21.319712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.245"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:21.323096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:21.333043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.333833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.335215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.336136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.336772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.337491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.372299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:52:21.372788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquired lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:52:21.451155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.460883 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1a0b2588-b68f-4dfc-97e8-a424b1d36daa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1462 microversion: 2.1 time: 0.716393 Aug 24 01:52:21.462025 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 232/509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:20 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1462 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:21.466818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.469668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:21.478729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.479229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.479670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.480386 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.480884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.481316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.509344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:52:21.605800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:21.648933 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2229d98f-ed87-4102-8d4b-c9e1ea7394b4 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "DELETE /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 204 len: 0 microversion: 2.1 time: 0.185365 Aug 24 01:52:21.653490 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 233/510] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:21 2022] DELETE /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:21.660257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.663785 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:21.663785 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:21.665397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.666152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.666878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.667807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.668461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.669074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.705350 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e016bd55-7128-4326-9f11-b2ec99df7035 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049312 Aug 24 01:52:21.715469 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 234/511] 10.222.0.49 () {60 vars in 1178 bytes} [Wed Aug 24 01:52:21 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:21.721828 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-43c333ab-f824-4de1-98fb-8449600e2297 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.749778 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:21.749778 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:21.751818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-43c333ab-f824-4de1-98fb-8449600e2297 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f44003157bec4733a5f1a355ba0c2b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab5db6302bf943dcb254bba6888b55f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-43c333ab-f824-4de1-98fb-8449600e2297 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Request method failure captured: Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2001:52:21 HTTP/1.1 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRSEAGaNFrukhNmz0bEblfN2LoVd1uBZsktAwz8tcMOuYH-vqIUArBxzOJBncdHI1ThMiROWmh92po8g9OtuDNAelDaHIzMmnZXtqKDuD-2rrnlUS9rIxcU15Y9Jf8NjOi6NkT1B15Rk8LGbuyGsCyAoGoXUDdirqAk2xZv5VUU7Z8 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ab5db6302bf943dcb254bba6888b55f2 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:21.754199 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ab5db6302bf943dcb254bba6888b55f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ab5db6302bf943dcb254bba6888b55f2 Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: f44003157bec4733a5f1a355ba0c2b6d Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project Aug 24 01:52:21.755686 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '2022-08-24 01:52:21'} Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:52:21.756362 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 24 01:52:21.757771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:21.760086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-43c333ab-f824-4de1-98fb-8449600e2297 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:21.761312 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-43c333ab-f824-4de1-98fb-8449600e2297 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239 tempest-InstanceUsageAuditLogNegativeTestJSON-188400239-project] 10.222.0.49 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24 01:52:21" status: 403 len: 128 microversion: 2.1 time: 0.044392 Aug 24 01:52:21.769848 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 235/512] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 01:52:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-24%2001%3A52%3A21 => generated 128 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:21.781918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:21.782979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:21.793128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.793923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.794509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:21.795610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:21.796211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:21.796859 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.038287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a.", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 01:52:22.039369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Releasing lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:52:22.040117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.040117 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Request method failure captured: Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action HTTP/1.1 Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 46 Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQpX4xf_-PyGbFibMPl9mlTXE81YVwCGuGys9TsiJ6_1i234PWas0lnnL33dT6Oexcve0dZyZyb98x5RwEkn6VLG1GKOMPWs17U67gSHt_8y0BiLM_XTET6xmcIE83dgd6qiqBJKEUgkGWeyR_c55LFx6ndxD3PJE9UQrfXgGl9CpQ Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:22.053657 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a04ed83057e54f179e52bbf1ae15f9f2 Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: {"addFloatingIp": {"address": "172.25.9.245"}} Aug 24 01:52:22.055254 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b', 'body': {'addFloatingIp': {'address': '172.25.9.245'}}} Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.056082 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 01:52:22.057295 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.058403 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.059647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] Aug 24 01:52:22.061468 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:22.063704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Returning 400 to user: Cannot associate floating IP 172.25.9.245 (7b254eb2-b78f-4ac6-94bb-abe6edc3b142) with port 615ef30c-4b0d-4316-a6ac-25eb39ba6a63 using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network e4e21d0c-49ed-41b8-af2c-c599dfad641a. Aug 24 01:52:22.063704 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-f63c8c31-086e-4645-b9e0-2d95e1553912'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:22.064965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a7c809b-6cfa-4122-80fc-0c592860a737 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 400 len: 381 microversion: 2.1 time: 0.749307 Aug 24 01:52:22.069636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 278/513] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:21 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 381 bytes in 754 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:52:22.080112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.080112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:22.096818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.098601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.099049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.099779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.100236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.100663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.135663 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fea9cc44-eefb-4c59-92d5-6e48e60a45db tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1613 microversion: 2.1 time: 0.363057 Aug 24 01:52:22.164623 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 236/514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:21 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1613 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:22.180772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.186818 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:22.186818 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:52:22.188568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.189251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.189841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.190781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.191407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.191983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.227163 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f4b551c9-cb65-4c69-9c71-6a500b7f15cf tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-854121-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.061112 Aug 24 01:52:22.237333 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 237/515] 10.222.0.49 () {60 vars in 1235 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/os-services?host=n-d-854121-3&binary=xxx => generated 16 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:22.245015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d98f300b-719a-4e8e-97ff-5a112747543e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '.version_select at 0x7f6b9294c0d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.550913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:22.559968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b669f622-6bc1-498b-b0d9-5e79f708139d tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1475 microversion: 2.1 time: 0.488938 Aug 24 01:52:22.568208 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 279/516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1475 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:22.582579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.583527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:22.594481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.595034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.595739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.597937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.598883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.599487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.692293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:22.702148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:22.703756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:22.704917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6258c5f6-01ee-4d88-8c40-360ec44773fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1319 microversion: 2.25 time: 0.135395 Aug 24 01:52:22.712655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 280/517] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:22.719667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63307bd3-b648-48fb-9d16-1bca9018a504 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '.version_select at 0x7f6b926bf8b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.724452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63307bd3-b648-48fb-9d16-1bca9018a504 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.725581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63307bd3-b648-48fb-9d16-1bca9018a504 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.725581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63307bd3-b648-48fb-9d16-1bca9018a504 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.751398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63307bd3-b648-48fb-9d16-1bca9018a504 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.037120 Aug 24 01:52:22.752681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 281/518] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:22.757801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.761062 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:22.761062 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:22.763052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.764622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.765312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.766334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.767025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.767674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.793652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86ba4664-88d0-48d6-93c7-c7840ccfccb5 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.038638 Aug 24 01:52:22.794763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 282/519] 10.222.0.49 () {60 vars in 1178 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:22.806553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:22.809341 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:22.809341 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:22.810880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.811512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.812055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.812934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:22.813504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:22.814029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:22.821268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:22.855868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81b828b2-9357-42ec-bd16-43e91fe79b61 tempest-ServicesAdminNegativeV253TestJSON-1507021587 tempest-ServicesAdminNegativeV253TestJSON-1507021587-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.053010 Aug 24 01:52:22.857085 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 283/520] 10.222.0.49 () {60 vars in 1239 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:23.089863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dac4e3-dbb4-4698-835f-099a5805d308 tempest-ServicesAdminNegativeV253TestJSON-1317095912 tempest-ServicesAdminNegativeV253TestJSON-1317095912-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:23.093082 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:23.093082 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:23.094185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64dac4e3-dbb4-4698-835f-099a5805d308 tempest-ServicesAdminNegativeV253TestJSON-1317095912 tempest-ServicesAdminNegativeV253TestJSON-1317095912-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'caa32a853ab140b79a5a3a7e42c27e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967d3ddc49e44f12944891b39b0cbfbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dac4e3-dbb4-4698-835f-099a5805d308 tempest-ServicesAdminNegativeV253TestJSON-1317095912 tempest-ServicesAdminNegativeV253TestJSON-1317095912-project] Request method failure captured: Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYROBQmtigmW9HAbYRfsKGmlVCVpZ2RiCJ2SMaiuwdpTbtQQemCvCHfXi48LJPvb9JABN5Mf28Q16jDP736ix7Yvv4mfooVI0Qrbd5chdOyj9sEDwpi68lRCsXhZB7tiGm-57dqzYdATgMagRHKCQqS9xIMKfhvehpHgeMlIVKzN-e8 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.53 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 967d3ddc49e44f12944891b39b0cbfbf Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1317095912 Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:52:23.096100 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/967d3ddc49e44f12944891b39b0cbfbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/967d3ddc49e44f12944891b39b0cbfbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/967d3ddc49e44f12944891b39b0cbfbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_967d3ddc49e44f12944891b39b0cbfbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1317095912 Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 967d3ddc49e44f12944891b39b0cbfbf Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1317095912 Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1317095912-project Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: caa32a853ab140b79a5a3a7e42c27e64 Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1317095912-project Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 01:52:23.097534 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:52:23.098264 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 01:52:23.099313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:52:23.102382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dac4e3-dbb4-4698-835f-099a5805d308 tempest-ServicesAdminNegativeV253TestJSON-1317095912 tempest-ServicesAdminNegativeV253TestJSON-1317095912-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:23.103350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64dac4e3-dbb4-4698-835f-099a5805d308 tempest-ServicesAdminNegativeV253TestJSON-1317095912 tempest-ServicesAdminNegativeV253TestJSON-1317095912-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.238543 Aug 24 01:52:23.108362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 284/521] 10.222.0.49 () {60 vars in 1178 bytes} [Wed Aug 24 01:52:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 24 01:52:23.114792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1165572963", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:23.174814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:24.292511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:24.293242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:24.293473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:24.293883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:24.294534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:24.308636 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d98f300b-719a-4e8e-97ff-5a112747543e tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/7b254eb2-b78f-4ac6-94bb-abe6edc3b142" status: 202 len: 0 microversion: 2.1 time: 2.068199 Aug 24 01:52:24.309838 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 238/522] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:52:22 2022] DELETE /compute/v2.1/os-floating-ips/7b254eb2-b78f-4ac6-94bb-abe6edc3b142 => generated 0 bytes in 2072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:52:24.313383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.315412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.315871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.318839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.319781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:24.320004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.321275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:24.323283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.335730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.336866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.339260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.341466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.342745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.345331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.350613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:24.356327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:24.371250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:24.374376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:24.454775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d4c3474-7473-4df7-badb-5087d9042af4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345040 Aug 24 01:52:24.464839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 285/523] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:52:24.472584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:24.473254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:24.521954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.522458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.522898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.523619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:24.524071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:24.529447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:24.821849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:24.834665 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-59594800-e156-4081-87f8-3666ffa7c82a tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1475 microversion: 2.1 time: 0.519247 Aug 24 01:52:24.839559 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 239/524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:24 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1475 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:24.844146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1665599792", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "5506154", "adminPass": "***", "networks": [{"uuid": "2453c4d7-ff64-4c70-a628-425538e69002"}], "security_groups": [{"name": "tempest-securitygroup--1734501880"}], "key_name": "tempest-keypair-929206611", "user_data": "}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:24.847550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:24.880903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:24.896125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:24.901589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ea09270-b2cc-4946-9d4e-775c217077cd tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 0.435394 Aug 24 01:52:24.905424 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 286/525] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:24 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:24.914875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: .version_select at 0x7f6b98eeb4c0>, body: {"removeFloatingIp": {"address": "172.25.9.81"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:25.104547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] validate_networks() for [('2453c4d7-ff64-4c70-a628-425538e69002', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:25.324054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:25.331507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:25.331995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:25.332428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:25.333164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:25.333786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:25.335106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.190263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:52:26.191056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquired lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:52:26.420944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:26.421999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:26.422801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:26.423385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:26.424355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:26.439102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.443414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.444079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.445083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.445954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.450489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.490132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for project 4f2880aeff3141ca85e2148b1473f471. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:26.498686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for user 09c8b150bd864992a5eba1af41e760ae and project 4f2880aeff3141ca85e2148b1473f471. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:26.545160 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:26.556510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:26.668183 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a4c0534a-7d58-4986-8653-45326a263c47 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.831619 Aug 24 01:52:26.669264 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 240/526] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:52:26.674547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:26.675326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:26.687369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.688063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.688686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.689682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.690287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.690886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.853801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:26.868952 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bb4e476b-6f8a-4d07-8c75-aa97ee2f980a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1271 microversion: 2.1 time: 0.198481 Aug 24 01:52:26.870034 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 241/527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:26 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:26.875272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:26.881959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:26.884956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:26.894513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.907864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.908495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.909426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.910034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:26.910622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:26.979913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:26.981446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.002429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:27.003256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lazy-loading 'fault' on Instance uuid 98e5d3bd-0700-4039-82f9-aabfba7bf280 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:27.141473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e6c635ba444a0c8cc501127d819774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c417d3076cb7493eb2faebbad91ac38d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:27.150050 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0e9a5e90-ca48-4ced-a168-9bc9da74bc65 tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 200 len: 1309 microversion: 2.1 time: 0.278780 Aug 24 01:52:27.153234 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 242/528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:26 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:27.158222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:27.166657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:27.175205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:27.176873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.177565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:27.178507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:27.179176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.179833 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:27.582815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:27.596379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:27.597931 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:27.599157 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-451aacfc-6510-4bac-9240-05f9cde28333 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 0.444701 Aug 24 01:52:27.599707 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 243/529] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:27 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:27.613575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e5d3bd-0700-4039-82f9-aabfba7bf280", "name": "network-vif-deleted", "tag": "54c813f2-14b4-4fdd-a5d4-e7577be462d2"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:27.638451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:27.639340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.639987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:27.669468 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] Creating event network-vif-deleted:54c813f2-14b4-4fdd-a5d4-e7577be462d2 for instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 on n-h1-854121-3 Aug 24 01:52:27.683866 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-44dd7af3-2922-463c-af30-b845f54d51b7 req-5d892d2f-75a0-4f74-a596-6ba938d3d270 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076686 Aug 24 01:52:27.684861 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 244/530] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:27.707688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-813b19e3-84cf-46a5-a24e-9af81d2ad0cf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:27.709639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-813b19e3-84cf-46a5-a24e-9af81d2ad0cf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:27.857094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-813b19e3-84cf-46a5-a24e-9af81d2ad0cf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:27.864582 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-813b19e3-84cf-46a5-a24e-9af81d2ad0cf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1258 microversion: 2.1 time: 0.173493 Aug 24 01:52:27.867216 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 245/531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:27 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:27.894383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:27.895625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:27.905339 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:27.906722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.907448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:27.909535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:27.910887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:27.912112 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:28.053846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:28.071557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-781bb60f-eeb5-4deb-bae4-f3cca6a7dc6f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1271 microversion: 2.1 time: 0.181271 Aug 24 01:52:28.072151 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 246/532] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:27 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:28.175949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:28.177180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] [instance: 98e5d3bd-0700-4039-82f9-aabfba7bf280] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:28.189972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:28.191201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:28.195458 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:28.196670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:28.197781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:28.199844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:28.240572 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] HTTP exception thrown: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Request method failure captured: Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 HTTP/1.1 Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQUvqmNXLa3y8CiL6Xk0TuRnJauQccGXXhL2y9EivdTc75II1yBE6_NtiHidry_FVmNFWGcr9uk6XawcgVn7KXwAsBhIzieUmIyaWFNw9UbVk-eCVe7K0ZPdyPvk6SAO3n4QfYJQFYbQBILrGqhkdMSLNk83b7dOBDbIavsGcvVVJg Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: c417d3076cb7493eb2faebbad91ac38d Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:28.246947 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c417d3076cb7493eb2faebbad91ac38d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: c417d3076cb7493eb2faebbad91ac38d Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-453401999 Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-LiveMigrationNegativeTest-453401999-project Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: e0e6c635ba444a0c8cc501127d819774 Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-LiveMigrationNegativeTest-453401999-project Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. Aug 24 01:52:28.249207 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '98e5d3bd-0700-4039-82f9-aabfba7bf280'} Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:28.250106 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. Aug 24 01:52:28.252448 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:28.258168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] Returning 404 to user: Instance 98e5d3bd-0700-4039-82f9-aabfba7bf280 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:28.262951 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9e6f7a4c-503e-4744-947a-7a247ba2371e tempest-LiveMigrationNegativeTest-453401999 tempest-LiveMigrationNegativeTest-453401999-project] 10.222.0.49 "GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280" status: 404 len: 111 microversion: 2.1 time: 0.087723 Aug 24 01:52:28.271034 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 247/533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:28 2022] GET /compute/v2.1/servers/98e5d3bd-0700-4039-82f9-aabfba7bf280 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:52:29.188590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-443038594", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:29.281059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:29.835630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Building network info cache for instance {{(pid=128567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:52:29.920495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:29.920940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:29.921410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:29.921814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:29.922219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:29.947540 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:29.948039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:29.948519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:29.949452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:29.950599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:29.952649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.023171 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Getting quotas for project 7c47edb9fb8f4e42836583685ee94de6. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:30.044123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Getting quotas for user 785f8e0c4f1c4cb5ab1a1163e40ce4b7 and project 7c47edb9fb8f4e42836583685ee94de6. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:30.079182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:30.082947 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:30.192979 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-09c477f8-9018-424d-9bb6-bd31a3cb7fa2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.642536 Aug 24 01:52:30.203596 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 248/534] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:52:30.210120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:30.211208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:30.220274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.221015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.221782 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.222660 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.223264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.224008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.532397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:30.542089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:30.547257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:30.548415 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-58d0d0c1-aae5-48dc-9ebd-7e887b90db78 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 0.342910 Aug 24 01:52:30.550753 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 249/535] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:30 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:30.561570 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:30.562372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:30.579895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.584365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.585311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.586358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.595874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.596541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.754065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:30.767123 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e6be3ee4-ef0a-4cf1-81c4-7c4595ce77e9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1316 microversion: 2.1 time: 0.211429 Aug 24 01:52:30.780757 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 250/536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:30 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:30.790336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:30.790999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:30.816626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.817387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.817993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:30.818874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:30.819672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:30.820547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.101568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:31.112937 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c51e5d1b-11f5-40e0-a162-f63221b77249 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.338505 Aug 24 01:52:31.114126 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 251/537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:30 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:31.126138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:31.145191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.145670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.148178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.177483 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] Creating event network-changed:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h2-854121-3 Aug 24 01:52:31.192155 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-9d970b51-a4b2-4bf9-9060-ca3abfb149b7 req-e5d870cc-7df3-4474-9198-0edca42d9a67 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076086 Aug 24 01:52:31.192822 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 252/538] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:31.199691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae3c136-7568-495f-b0af-a52d224de1ef", "tag": "29ec5588-fd93-4bde-abed-db7b9c317973"}, {"name": "network-changed", "server_uuid": "a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b", "tag": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:31.211299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.212039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.212617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.230308 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Creating event network-changed:29ec5588-fd93-4bde-abed-db7b9c317973 for instance dae3c136-7568-495f-b0af-a52d224de1ef on n-h2-854121-3 Aug 24 01:52:31.230806 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] Creating event network-changed:615ef30c-4b0d-4316-a6ac-25eb39ba6a63 for instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b on n-h1-854121-3 Aug 24 01:52:31.241985 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c14c82f0-9581-49a3-a1cc-9332ecfd30b4 req-23bff97b-e1d4-4928-b32a-e9b4f1bdf7f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046894 Aug 24 01:52:31.243024 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 253/539] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:31.249788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:31.250684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:31.258242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.260069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.260761 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.261662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.262270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.262854 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.397144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:31.407467 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-79a67db6-7455-49d4-90aa-fd568eb1be05 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1225 microversion: 2.1 time: 0.162241 Aug 24 01:52:31.408387 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 254/540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:31 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1225 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:31.578767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Updating instance_info_cache with network_info: [{"id": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63", "address": "fa:16:3e:00:7f:56", "network": {"id": "703d5e47-7c1f-4c8b-a044-dfccc07fdccf", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1014499828-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "00ec459a29ce43e88d22dc615c3bb38f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap615ef30c-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:52:31.594141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Releasing lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:52:31.595144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f98e012-90c3-45ed-b6a5-6023fd68d3bb tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 202 len: 0 microversion: 2.1 time: 6.688431 Aug 24 01:52:31.595617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 287/541] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:24 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 0 bytes in 6689 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:52:31.607342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:31.608339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:31.622005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.623082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.623683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.625692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:31.635043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:31.635594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:31.744465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1951941406", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:31.862859 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:32.520768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:32.521478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:32.522088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:32.522602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:32.523475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:32.538353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:32.539613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:32.546316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:32.548041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:32.549049 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:32.549766 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:32.577709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Getting quotas for project 252e5b66d64748d29ca1b14fcc1c7dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:32.582685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Getting quotas for user 790b3ad5def74474a13ee83ae83e534d and project 252e5b66d64748d29ca1b14fcc1c7dd3. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:32.598105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:32.607187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:32.691207 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-17e9ddf0-8228-48fc-8b87-a4afed0137e9 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211436 Aug 24 01:52:32.705948 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 255/542] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:52:32.712021 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2538c433-e7d3-4eea-b996-a3781b7c739b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '.version_select at 0x7f6b927d8e50>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:32.807338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:32.825241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:32.831646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:32.833638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de854b5d-8201-45e3-a591-8ff7ea67e71c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 1.236686 Aug 24 01:52:32.869352 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 288/543] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:31 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:32.876394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:32.877306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:32.887325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:32.887823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:32.889583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:32.891097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:32.891757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:32.892407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:33.590325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:33.601048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1799f96-8f38-450d-8bc5-51f668636076 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.730076 Aug 24 01:52:33.601866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 289/544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:32 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:33.610030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:33.614653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:33.626389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:33.629178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:33.629816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:33.633529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:33.634145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:33.634680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.034881 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2538c433-e7d3-4eea-b996-a3781b7c739b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/2600b359-7135-4939-bd5d-ec76f874ae16" status: 202 len: 0 microversion: 2.1 time: 1.327722 Aug 24 01:52:34.036133 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 256/545] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:52:32 2022] DELETE /compute/v2.1/os-floating-ips/2600b359-7135-4939-bd5d-ec76f874ae16 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:52:34.045970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:34.046821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.055473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.056332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.057594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.058474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.059903 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.060861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.135161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:34.146068 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5055c1b8-9dc6-4799-868b-2450e5494df0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1279 microversion: 2.1 time: 0.108620 Aug 24 01:52:34.161531 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 257/546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:34 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1279 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:34.167920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:34.168848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.176373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.177095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.177739 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.179009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.179662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.180272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.201732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:34.209781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f965745-53bf-41b0-8071-e84e8afff15d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.603954 Aug 24 01:52:34.210360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 290/547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:33 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:34.231726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:34.242642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.260211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.261123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.261776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.262742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.264009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.264500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:34.264901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.273120 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1381eebd-2b5c-4561-b95c-ed9b106056fb tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1266 microversion: 2.1 time: 0.110013 Aug 24 01:52:34.285085 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 258/548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:34 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:34.285085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd4d4b42-813d-433a-8676-89e3cb30b50b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: .version_select at 0x7f6b9945c160>, body: {"addFloatingIp": {"address": ""}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd4d4b42-813d-433a-8676-89e3cb30b50b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Request method failure captured: Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action HTTP/1.1 Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 34 Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQpX4xf_-PyGbFibMPl9mlTXE81YVwCGuGys9TsiJ6_1i234PWas0lnnL33dT6Oexcve0dZyZyb98x5RwEkn6VLG1GKOMPWs17U67gSHt_8y0BiLM_XTET6xmcIE83dgd6qiqBJKEUgkGWeyR_c55LFx6ndxD3PJE9UQrfXgGl9CpQ Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:34.286086 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a04ed83057e54f179e52bbf1ae15f9f2 Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: {"addFloatingIp": {"address": ""}} Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:34.287405 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b', 'body': {'addFloatingIp': {'address': ''}}} Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi '' Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:34.288219 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:52:34.289648 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:52:34.290774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 24 01:52:34.290774 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.290774 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd4d4b42-813d-433a-8676-89e3cb30b50b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:34.290774 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fd4d4b42-813d-433a-8676-89e3cb30b50b tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 400 len: 142 microversion: 2.1 time: 0.011889 Aug 24 01:52:34.294917 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 259/549] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:34 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 142 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:52:34.299777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:34.302358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.312092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.312841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.313639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.314547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.315501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.316125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.340628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:34.366541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:34.398538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:52:34.399272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquired lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:52:34.558381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Releasing lock "refresh_cache-a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:52:34.558945 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] HTTP exception thrown: floating IP not found Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Request method failure captured: Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action HTTP/1.1 Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 41 Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQpX4xf_-PyGbFibMPl9mlTXE81YVwCGuGys9TsiJ6_1i234PWas0lnnL33dT6Oexcve0dZyZyb98x5RwEkn6VLG1GKOMPWs17U67gSHt_8y0BiLM_XTET6xmcIE83dgd6qiqBJKEUgkGWeyR_c55LFx6ndxD3PJE9UQrfXgGl9CpQ Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:34.563208 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a04ed83057e54f179e52bbf1ae15f9f2 Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:34.564810 n-d-854121-3 devstack@n-api.service[128566]: exception: floating IP not found Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.565760 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 24 01:52:34.568272 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.569743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Returning 404 to user: floating IP not found {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:34.569743 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-215262eb-7bd9-4956-879b-5e0f196cb8a5 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 404 len: 67 microversion: 2.1 time: 0.268928 Aug 24 01:52:34.571515 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 260/550] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:34 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 67 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:52:34.578026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea9c17dc-d096-484e-b6fa-b8c4a802e097 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Action: 'action', calling method: .version_select at 0x7f6b9945c430>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:34.627726 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-ea9c17dc-d096-484e-b6fa-b8c4a802e097 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea9c17dc-d096-484e-b6fa-b8c4a802e097 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Request method failure captured: Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action HTTP/1.1 Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 44 Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQpX4xf_-PyGbFibMPl9mlTXE81YVwCGuGys9TsiJ6_1i234PWas0lnnL33dT6Oexcve0dZyZyb98x5RwEkn6VLG1GKOMPWs17U67gSHt_8y0BiLM_XTET6xmcIE83dgd6qiqBJKEUgkGWeyR_c55LFx6ndxD3PJE9UQrfXgGl9CpQ Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:34.629810 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a04ed83057e54f179e52bbf1ae15f9f2 Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:52:34.631414 n-d-854121-3 devstack@n-api.service[128566]: exception: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:34.632336 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 24 01:52:34.634463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:34.637226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea9c17dc-d096-484e-b6fa-b8c4a802e097 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:34.638262 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ea9c17dc-d096-484e-b6fa-b8c4a802e097 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action" status: 404 len: 88 microversion: 2.1 time: 0.065714 Aug 24 01:52:34.643070 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 261/551] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:34 2022] POST /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b/action => generated 88 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:52:34.650902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae3c136-7568-495f-b0af-a52d224de1ef", "name": "network-vif-plugged", "status": "completed", "tag": "29ec5588-fd93-4bde-abed-db7b9c317973"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:34.664799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.665773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.666559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.683419 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] Creating event network-vif-plugged:29ec5588-fd93-4bde-abed-db7b9c317973 for instance dae3c136-7568-495f-b0af-a52d224de1ef on n-h2-854121-3 Aug 24 01:52:34.689709 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-27a496a0-9e67-44a4-b6c1-55fe9b381b65 req-8e71708a-11ec-40c2-aa4c-23d455d2dc10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045057 Aug 24 01:52:34.691182 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 262/552] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:34.697315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:34.698268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.706071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.706924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.707548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.708448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.709157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.709745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.741077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:34.889404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:34.900388 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d08f0f8-f843-46cc-80b3-e2fb268a8ea3 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.207739 Aug 24 01:52:34.901196 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 263/553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:34 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:34.906479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:34.907801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:34.914297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.914786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.915226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.916109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:34.916565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:34.917013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:34.943836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:52:35.031450 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-07b5de0d-06e0-443a-baac-03fd8b9c2610 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 204 len: 0 microversion: 2.1 time: 0.128333 Aug 24 01:52:35.032040 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 264/554] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:34 2022] DELETE /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:35.150836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.154532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1236208757", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:35.160146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.161969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.163686 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4bc2461-9ae8-4953-a6ed-3e9b20b8b421 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 0.936841 Aug 24 01:52:35.164250 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 291/555] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:34 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:35.168925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:35.170288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.175553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:35.177376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.178117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.178720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.180043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.180143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.180613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.233716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:35.234653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:35.235204 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:35.235676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:35.236147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:35.251880 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.252368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.255964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.257229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.258876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.259801 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.281265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Getting quotas for project 8f10fa11758f45f4834c17042e7fae27. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:35.285684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Getting quotas for user dec73c7ebbae4c44becb11c4b4f73b73 and project 8f10fa11758f45f4834c17042e7fae27. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:35.301128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:35.303964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:35.378603 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bdc22258-92a5-4f85-88fe-e3685a3e0d98 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.345060 Aug 24 01:52:35.381202 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 265/556] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:52:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:52:35.386447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:35.387557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.400169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.400753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.401212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.401942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.402401 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.402822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.554199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.565190 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a4aab460-f124-4401-af7c-0933b5f420f3 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1279 microversion: 2.1 time: 0.180361 Aug 24 01:52:35.566765 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 266/557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:35.593271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:35.594414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.612341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.613141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.613538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.615856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.616348 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.616877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.738758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.759243 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-38d758b1-dd0e-40e2-bfeb-8bcba090a7d1 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1539 microversion: 2.1 time: 0.593704 Aug 24 01:52:35.773033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 292/558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1539 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:35.791926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:35.792837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.807985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.813685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.814138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.815486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.816128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.816570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.824289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.834558 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5e9abb41-125a-47bb-b352-dbfab69cb3f0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.266484 Aug 24 01:52:35.848297 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 267/559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:35.854149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:35.857042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.862743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:35.940668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.953195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.955694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11d7b4ea-58f8-40bd-8305-15311a9de73a tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1272 microversion: 2.1 time: 0.193883 Aug 24 01:52:35.956957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 293/560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:35.963290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.965249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:35.967526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:35.971154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:35.974893 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-337c7610-d3eb-4265-be64-95c6ad2fe813 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "PUT /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1359 microversion: 2.75 time: 0.125292 Aug 24 01:52:35.976394 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 268/561] 10.222.0.49 () {62 vars in 1297 bytes} [Wed Aug 24 01:52:35 2022] PUT /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1359 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:35.981381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.981890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.982363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:35.986920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:35.989938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:35.990780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.007251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:36.007952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:36.339587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.349429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.351019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.356114 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1185029a-e3db-4ccc-9a22-13b4c4bd5d37 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1359 microversion: 2.75 time: 0.356309 Aug 24 01:52:36.357927 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 269/562] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1359 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:52:36.362561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4fb049-ae81-41e7-abcb-53a6429c40fe", "tag": "90cdf8e5-dc39-4eb7-b233-371dd8be2b97"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:36.373261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.374044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.374687 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.385881 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] Creating event network-changed:90cdf8e5-dc39-4eb7-b233-371dd8be2b97 for instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe on n-h1-854121-3 Aug 24 01:52:36.391065 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-d79bdcbe-0164-4ca7-ace6-4d155ed03609 req-0b4c607f-a734-48d0-982d-aa1f7e02abd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031762 Aug 24 01:52:36.391643 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 270/563] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:36.396564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:36.397276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:36.403842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.404967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.405410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.406114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.406574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.407003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.549325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.568341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.570004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.571422 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6202ee9e-3fac-4d22-9df7-616543eec66a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1361 microversion: 2.25 time: 0.178718 Aug 24 01:52:36.571975 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 271/564] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:36 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:36.591429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:36.592142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:36.601769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.602290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.602745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.603473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.604197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.604634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.651899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:36.664243 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd1e11df-349a-4a9e-8911-c6ab1770ff3a tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.705519 Aug 24 01:52:36.665164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 294/565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:35 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:36.783754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:36.784565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:36.792032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.792948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.794538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:36.796193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:36.796801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:36.797259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.043619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.052341 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1f873711-ca6b-4e13-946f-fbb9affc64a2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.468825 Aug 24 01:52:37.053130 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 272/566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:36 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:37.071648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:37.072579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:37.080838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.081583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.082022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.082726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.083209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.083633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.423363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.433288 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-402dbb9a-2156-4bf0-9b07-c3631043e07f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.367239 Aug 24 01:52:37.434124 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 273/567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:37 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:37.455810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:37.456939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:37.464739 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.465526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.466322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.467263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.468265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.468976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.511487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.521990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85ac091a-ef48-4a34-b8b2-62535bd71de4 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1539 microversion: 2.1 time: 0.744970 Aug 24 01:52:37.522815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 295/568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:36 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1539 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:37.528135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:37.530239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:37.536499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.537455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.537962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.538744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.539270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.539764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.605548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.618573 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f93d22ba-45ad-486d-94e6-abbbd8b29b9e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1272 microversion: 2.1 time: 0.169521 Aug 24 01:52:37.621892 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 274/569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:37 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:37.634523 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:37.636111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:37.645744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.646287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.646727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.647429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.647908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.648330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.772924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.784821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.789088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:37.799661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a0de5cd-cabd-4e11-b48a-bfb31284b8cb tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1411 microversion: 2.75 time: 0.275169 Aug 24 01:52:37.816756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 296/570] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:37 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1411 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:37.816756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:37.816756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:37.822363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.822820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.823459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:37.824877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:37.825966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:37.826559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.137460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:38.149175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35af9336-989a-4c32-8fbb-448e0a10d953 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.342230 Aug 24 01:52:38.150126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 297/571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:37 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:38.165805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:38.166437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:38.178724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.178724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.178724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.178724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.179186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.179186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.296268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:38.308085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:38.317996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:38.319715 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81e2b9f9-51e0-4bdc-b3a6-eb466d778d3f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1557 microversion: 2.25 time: 0.693009 Aug 24 01:52:38.320815 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 275/572] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:37 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1557 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:38.341446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "name": "network-vif-plugged", "status": "completed", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:38.366567 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.367878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.368352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.408483 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] Creating event network-vif-plugged:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h2-854121-3 Aug 24 01:52:38.413434 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-582503df-719a-4697-964b-de2b58bdf8a1 req-9526558a-7027-4fc3-bb96-b94b4f3b4451 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090279 Aug 24 01:52:38.414164 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 276/573] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:38.419935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b", "name": "network-vif-deleted", "tag": "615ef30c-4b0d-4316-a6ac-25eb39ba6a63"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:38.431173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.431723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.432082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.447104 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] Creating event network-vif-deleted:615ef30c-4b0d-4316-a6ac-25eb39ba6a63 for instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b on n-h1-854121-3 Aug 24 01:52:38.454485 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-8fc93cf4-a479-49b8-b6a2-af7b20d411b0 req-4b318b49-0ae8-4e4e-b508-2f0c51eb7059 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038478 Aug 24 01:52:38.455104 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 277/574] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:38.473222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:38.475400 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:38.491735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.494013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.494631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.495515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.496307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.496948 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.696413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:38.714042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce5e4b45-55d2-4b36-a91a-0309c47398da tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.560387 Aug 24 01:52:38.719788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 298/575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:38 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:38.727672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:38.729526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:38.737972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.739662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.740552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.741488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.742240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.742886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.762024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:38.793073 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a7ee0c53-5ec0-4ed4-af4f-c0dda7ac0f4b tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2049 microversion: 2.25 time: 0.334963 Aug 24 01:52:38.796237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 278/576] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:38 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2049 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:38.813520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:38.814559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:38.829003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.829812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.830476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.833522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.836278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.838038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.902731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:38.903336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:38.904508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:38.908205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lazy-loading 'fault' on Instance uuid a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:39.084795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.098017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d1a0df7-f536-499f-be61-1764adbf3cdc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.376587 Aug 24 01:52:39.099583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 299/577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:38 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:39.106124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.107914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.116625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.117538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.118247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.119837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.120521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.121530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.140484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.151483 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-91dc1114-2129-42f9-88a2-34f6cc2e13ee tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1319 microversion: 2.1 time: 0.353902 Aug 24 01:52:39.152427 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 279/578] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:38 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:39.167869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.168491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.181607 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.184395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.184877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.186157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.186623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.187051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.425970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.450682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3422512-81cc-4c9d-a9be-df237f94d2bd tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.347772 Aug 24 01:52:39.451296 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 300/579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:39.461682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.467604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.483868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.484415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.484884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.487673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.488485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.488761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.493798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:39.501801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:39.518737 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4eff6d3c-c151-480c-9451-e0e10700b1c8 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2049 microversion: 2.25 time: 0.364997 Aug 24 01:52:39.519588 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 280/580] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2049 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:39.525505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905726bf-8418-4196-b2f2-a87b85f9d790", "tag": "097f97f7-0082-460f-b4a0-b870aa1aa2c2"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:39.548977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.549630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.550240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.562672 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] Creating event network-changed:097f97f7-0082-460f-b4a0-b870aa1aa2c2 for instance 905726bf-8418-4196-b2f2-a87b85f9d790 on n-h2-854121-3 Aug 24 01:52:39.572181 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-f4053245-c412-4c9e-ae7f-ee0417a18401 req-e42b6e08-18da-4508-8e21-f2c8edeb3543 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051087 Aug 24 01:52:39.580906 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 281/581] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:39.586459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.587831 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.596522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.597557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.598054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.598156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.598694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.599153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.599582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.610485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.613743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.619941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6110f2e-80ad-407f-b660-ebe08e0a8dd1 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1417 microversion: 2.75 time: 0.167614 Aug 24 01:52:39.632826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 301/582] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1417 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:39.632826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.633141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:39.633231 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:52:39.633231 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:52:39.633231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.633231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.633231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.633595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.633595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.633595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.661459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c3f133d-593a-4bb2-8f35-0345ad97260f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039398 Aug 24 01:52:39.662409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 302/583] 10.222.0.49 () {60 vars in 1217 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:52:39.675257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:39.676500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.684790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.685616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.689927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.691110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.691648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.692124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.769475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:39.779337 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-275c0053-db1a-4bf9-b1bd-3599b99802cc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.196355 Aug 24 01:52:39.780594 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 282/584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:39.788180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.788980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.796669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.797551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.798221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.799168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.799850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.800505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.836278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0818dc04-47f8-44bf-9550-563903befac2 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef/action" status: 202 len: 0 microversion: 2.25 time: 0.164716 Aug 24 01:52:39.837541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 303/585] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:52:39 2022] POST /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:39.849199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:39.849987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:39.858185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.858808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.859330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:39.860246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:39.860922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:39.861534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.005867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:40.007715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.021654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-439925a3-a653-4368-825a-fd6136bb6a9e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2054 microversion: 2.25 time: 0.180110 Aug 24 01:52:40.022959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 304/586] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2054 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:40.023092 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6741ff93-f82a-4f35-a0c2-853ea6c2f92b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.237394 Aug 24 01:52:40.023753 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 283/587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:39 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:40.119381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:40.119985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:40.126195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.126870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.127293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.128166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.128613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.129102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.184797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:40.185433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:40.191883 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.192615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.193265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.194155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.194794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.195691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.265139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.265826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.266260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.266708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lazy-loading 'fault' on Instance uuid a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:40.295410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.304499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55db0521-372e-4b9a-bcd1-0a18def8eff3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.188577 Aug 24 01:52:40.308826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 305/588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:40 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:40.316302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04ed83057e54f179e52bbf1ae15f9f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00ec459a29ce43e88d22dc615c3bb38f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.324532 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5c41817d-2a30-4904-8430-e988d36d1232 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 200 len: 1319 microversion: 2.1 time: 0.143563 Aug 24 01:52:40.325145 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 284/589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:40 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:40.472851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:40.473458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:40.479382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.479862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.480290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.481028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.481457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.481910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.651494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:40.652152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:40.658612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.659100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.659532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.660226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.660683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.661136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.787958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.798520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.800026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.805124 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b63bc3a1-3fd5-4bc3-9064-ebc9cd187198 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1417 microversion: 2.75 time: 0.157511 Aug 24 01:52:40.817099 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 285/590] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:40 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1417 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:52:40.817099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:40.817099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:40.826115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.827010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.829825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.830296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.831647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:40.832156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:40.832595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:40.833795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06f0e4e6-b1bc-45b8-9921-ced54a71d9ab tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.365057 Aug 24 01:52:40.834357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 306/591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:40 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:40.983415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:40.992174 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec84e688-51ce-4f01-a5b4-7b37aea33a34 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.185102 Aug 24 01:52:41.002107 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 286/592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:40 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:41.045756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.046361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.048143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.049003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.052462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.053225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.053942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.054877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.055548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.056036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.058909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.059755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.060381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.062112 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.064056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.064678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.218138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:41.259763 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ca053098-256b-4be1-9d6d-90ae9498a729 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2054 microversion: 2.25 time: 0.216837 Aug 24 01:52:41.261059 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 287/593] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2054 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:41.331133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.331961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.342552 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.342902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.343464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.344336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.344972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.345741 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.503728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:41.512313 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f61f8595-0190-4d36-8375-7e222f1174c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.189366 Aug 24 01:52:41.512832 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 288/594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:41.517923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.518516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] [instance: a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.524465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.525043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.525482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.526176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.526626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.527092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.546361 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] HTTP exception thrown: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Request method failure captured: Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b HTTP/1.1 Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQpX4xf_-PyGbFibMPl9mlTXE81YVwCGuGys9TsiJ6_1i234PWas0lnnL33dT6Oexcve0dZyZyb98x5RwEkn6VLG1GKOMPWs17U67gSHt_8y0BiLM_XTET6xmcIE83dgd6qiqBJKEUgkGWeyR_c55LFx6ndxD3PJE9UQrfXgGl9CpQ Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:52:41.547514 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_00ec459a29ce43e88d22dc615c3bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 00ec459a29ce43e88d22dc615c3bb38f Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a04ed83057e54f179e52bbf1ae15f9f2 Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:41.548823 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b'} Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:41.549591 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. Aug 24 01:52:41.550802 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:41.551994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] Returning 404 to user: Instance a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:41.551994 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-030c7376-6db3-44fe-bc4a-e63fa3c82437 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631 tempest-FloatingIPsAssociationNegativeTestJSON-1129406631-project] 10.222.0.49 "GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b" status: 404 len: 111 microversion: 2.1 time: 0.034635 Aug 24 01:52:41.551994 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 289/595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/a4df1a8d-75d5-4d1b-8c16-df9e58b67a9b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:41.662906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:41.678862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07ce5a80-9ee4-49c5-a311-204667beb5a7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.637513 Aug 24 01:52:41.692899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 307/596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:41.835890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.836495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.844308 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.845042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.846348 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.847254 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.847872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.850189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.855505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:41.856209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:41.866567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.868653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.870553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.871792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:41.873589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:41.875289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:41.955978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:41.970305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:41.973042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:41.979872 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81d0af56-8630-4bbd-9e90-3c9ff5afbc0f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1417 microversion: 2.75 time: 0.149358 Aug 24 01:52:41.994088 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 290/597] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1417 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:42.015401 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:42.016795 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:42.023693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.024550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.025501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.026206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.026855 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.027372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.243651 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:42.251924 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b4a5aba-b83e-468e-b751-849da7201a06 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.242827 Aug 24 01:52:42.252738 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 291/598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:42 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:42.284130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:42.285393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:42.291556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.292049 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.292486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.295069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.295175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.295538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.392830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:42.405504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26b3b24b-9220-4a1e-8cc8-3c4bf631fd7f tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.554163 Aug 24 01:52:42.407570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 308/599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:41 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:42.538034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82be3418-e949-4bdd-87b2-9846743bebe5", "tag": "ed3075ef-12af-44cd-84a3-be7a53eff25a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:42.610090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.610726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.611419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.635808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] Creating event network-changed:ed3075ef-12af-44cd-84a3-be7a53eff25a for instance 82be3418-e949-4bdd-87b2-9846743bebe5 on n-h1-854121-3 Aug 24 01:52:42.642639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9e7fa40f-e9d4-4739-b8ec-712e5ab9d4b4 req-7d08eac9-7892-4539-8cc3-83ebd33dfcb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142565 Aug 24 01:52:42.644163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 309/600] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:52:42.651345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:42.652377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:42.661881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.662880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.663728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.665430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.666133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.667118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.879986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:42.903621 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-efff71e6-f163-4f6c-8ccb-ea56ca4bf23c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2034 microversion: 2.25 time: 0.623100 Aug 24 01:52:42.904920 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 292/601] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:42 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2034 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:52:42.927811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:42.929369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:42.937587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.938582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.939580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:42.940550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:42.941248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:42.942008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.082337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.094456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb01506d-61ef-424a-9c5f-c3fcf0b75899 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1313 microversion: 2.1 time: 0.448012 Aug 24 01:52:43.096457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 310/602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:42 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:43.104358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-3", "block_migration": "auto"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:43.110249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:43.119826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.120637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.121211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.122331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.123770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.124416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.252797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.262903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'flavor' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:52:43.274742 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ecf09f52-15f2-4bed-90de-2f7e2f822b81 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.365004 Aug 24 01:52:43.275996 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 293/603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:42 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:43.284433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Going to try to live migrate instance to n-h1-854121-3 {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:52:43.288455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:43.289707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:43.296877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.297763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.298381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.302363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.303119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.303892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.425505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.434195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.443923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.452102 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-862dda06-a622-4fb5-930d-a67b78daac6c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1438 microversion: 2.75 time: 0.174649 Aug 24 01:52:43.469271 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 294/604] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:43 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1438 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:43.480479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:43.481572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:43.488315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.488975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.489654 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.490576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:43.491491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:43.492120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:43.987704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:43.995637 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7230f175-d3c4-4cfe-999f-af21d8dd39ed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.525166 Aug 24 01:52:43.996286 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 295/605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:43 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:44.001624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:44.002224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:44.007863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.008345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.008807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.009558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.010026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.010430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.217313 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:44.245602 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cd1d239c-284e-49fe-a253-a024f2c2ee37 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.247932 Aug 24 01:52:44.246438 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 296/606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:43 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:44.265406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:44.268504 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:44.275703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.276503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.277170 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.278194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.278891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.279522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.386736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:44.387157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:44.387620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:44.388319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:44.388919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:44.423270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:44.467683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:44.475819 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.476606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.477218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.478467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.479286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.479869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.575252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:44.592672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:44.596443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:44.614410 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b07fcaf2-2d0e-4794-94ee-f2f21ba9e820 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "POST /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52/action" status: 202 len: 1495 microversion: 2.75 time: 0.353354 Aug 24 01:52:44.615237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 297/607] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:52:44 2022] POST /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52/action => generated 1495 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 01:52:44.643735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:44.644358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:44.660213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.660741 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.661242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.662003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.662459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.662882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.920999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:44.930857 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a5432fae-af2c-46b8-ba8f-d3c192b4a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1463 microversion: 2.1 time: 0.298592 Aug 24 01:52:44.934338 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 298/608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:44 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:44.941769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:44.942287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:44.962925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.966472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.969249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:44.970163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:44.976171 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:44.976630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.271475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=22 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:45.279517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:45.303950 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e2640427-dcb0-45cd-8106-b524bb642243 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.368241 Aug 24 01:52:45.304645 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 299/609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:44 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:45.322760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:45.323569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:45.333651 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.334232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.334748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.335598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.336352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.337128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.428241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:45.439728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:45.441317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:45.448178 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-63ae21d4-4481-4c49-ac4b-c89ba253e98f tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.132983 Aug 24 01:52:45.449718 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 300/610] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:45 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:45.461562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4fb049-ae81-41e7-abcb-53a6429c40fe", "name": "network-vif-plugged", "status": "completed", "tag": "90cdf8e5-dc39-4eb7-b233-371dd8be2b97"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:45.473163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.473655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.474088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.487472 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] Creating event network-vif-plugged:90cdf8e5-dc39-4eb7-b233-371dd8be2b97 for instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe on n-h1-854121-3 Aug 24 01:52:45.493166 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-10234973-3e84-4c03-ae41-63572f36775c req-cde7ba0e-6c5a-4b27-8a1f-4d68212e2987 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Aug 24 01:52:45.493968 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 301/611] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:45.501081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:45.504034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:45.511003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.511509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.511946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.512688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.513736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.514169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.636974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:45.639965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:45.648783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Old instance type m1.heat2, new instance type m1.heat {{(pid=128566) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 01:52:45.658349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:45.658520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:45.658896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:45.659312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:45.659714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:45.816416 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c649f028-a3c4-4b1c-bb7e-3e3a1b54860a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57/action" status: 202 len: 0 microversion: 2.1 time: 0.321343 Aug 24 01:52:45.817505 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 302/612] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:45 2022] POST /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:52:45.830352 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:45.830987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:45.850625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.851343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.851800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:45.857255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:45.857945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:45.858707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.129879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:46.148340 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6e17933a-e7ff-4817-8182-b80efbf8238b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.329875 Aug 24 01:52:46.153456 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 303/613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:45 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:46.166946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:46.168329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:46.175882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.176576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.177788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.179263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.180087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.180671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.346305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=36 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:46.467832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:46.498730 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c833db27-7871-410d-ac3a-69990eb39354 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.341097 Aug 24 01:52:46.509750 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 304/614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:46 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:46.526431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:46.527145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:46.535783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.536515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.537357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.538172 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.539067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.539663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.865745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:46.876849 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2ac7b5fd-e27b-41ec-9088-a6f90e51a7df tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1472 microversion: 2.1 time: 0.365328 Aug 24 01:52:46.888774 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 305/615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:46 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:46.895607 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:46.896943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:46.903278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.904301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.904910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:46.905672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:46.906804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:46.907346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.108839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:47.123378 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e6b4ff45-8c36-4713-8ef7-a0e6cb3b1e20 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.243683 Aug 24 01:52:47.128323 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 306/616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:46 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:47.137646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:47.145334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:47.158890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.160102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.161027 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.162106 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.162686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.163689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.246082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:47.256220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:47.257854 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:47.265019 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cd0d3e77-27ce-4a81-86e3-55abae13c219 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.133631 Aug 24 01:52:47.265758 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 307/617] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:47 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:47.271298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:47.272188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:47.278816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.279588 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.280213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.281385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.282006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.282596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.827632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:47.840957 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-739d367a-dffe-49c7-a474-dc39be7298dc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1384 microversion: 2.1 time: 0.573504 Aug 24 01:52:47.855397 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 308/618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:47 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1384 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:47.861505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:47.862198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:47.869590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.871554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.872586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:47.873416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:47.873961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:47.874459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.045139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:48.054971 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e5fb7fbd-3237-440a-a06a-0e680bec90a4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.196607 Aug 24 01:52:48.055564 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 309/619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:47 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:48.064536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:48.065161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:48.082810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.083309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.083752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.084461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.095473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.097012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.207560 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0014000a-13a4-4a07-b6ba-ed05765575a9 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef/action" status: 202 len: 0 microversion: 2.25 time: 5.108198 Aug 24 01:52:48.208342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 311/620] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:52:43 2022] POST /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef/action => generated 0 bytes in 5111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:52:48.215870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:48.216662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:48.244167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.245403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.246757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.249846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.250342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.252430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.514819 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:48.533662 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8ec02e66-9c76-4e69-832a-54e67002ff68 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1472 microversion: 2.1 time: 0.470741 Aug 24 01:52:48.548753 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 310/621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:48 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:48.548753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:48.548753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:48.556925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.557122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.557575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.558337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.558802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.559229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.610586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:48.625368 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bcd507d-9d8a-4d0c-95a0-c6125f22e5cb tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.415455 Aug 24 01:52:48.626322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 312/622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:48 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:48.641261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:48.641997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:48.659621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.660126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.660637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:48.661449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:48.661902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:48.662506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.011953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.032817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.038999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.040491 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-864b9a62-aafc-4db7-b789-b6ae68200892 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.504053 Aug 24 01:52:49.041623 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 311/623] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:48 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:49.048692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:49.049581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:49.063765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.064584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.065307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.066349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.074310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.082242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.083133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.084643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.084998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.106788 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c57eca8b-ee39-45f2-81c1-220ed104f026 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.479281 Aug 24 01:52:49.107594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 313/624] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:48 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:49.121336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:49.136929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:49.141256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:49.167228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.168900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.169544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.170966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.171945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.172443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.419432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.427199 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dabbb775-c312-4f41-be37-e9a5aa1fa67b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1583 microversion: 2.1 time: 0.384013 Aug 24 01:52:49.444223 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 312/625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:49 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1583 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:49.450069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905726bf-8418-4196-b2f2-a87b85f9d790", "name": "network-vif-plugged", "status": "completed", "tag": "097f97f7-0082-460f-b4a0-b870aa1aa2c2"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:49.461487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.462181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.462771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.477381 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] Creating event network-vif-plugged:097f97f7-0082-460f-b4a0-b870aa1aa2c2 for instance 905726bf-8418-4196-b2f2-a87b85f9d790 on n-h2-854121-3 Aug 24 01:52:49.483209 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-0e7efc62-0297-48e0-a52f-eb4ed274f118 req-06e26ed8-685b-441c-ba80-3668e4477fce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037125 Aug 24 01:52:49.484068 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 313/626] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:49.492218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:49.493084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:49.501173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.501864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.503141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.504090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.504698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.505324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.639151 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-998c8f77-5d92-4cd0-b6cd-1e407a6c56fd tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153601 Aug 24 01:52:49.639829 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 314/627] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 01:52:49 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:49.641443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:49.645857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:49.646509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:49.665669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.666167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.666598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.667301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.668168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.668168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.811238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:49.824700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-049a576f-b06c-4c38-a7e8-ff6195d33ca2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.700375 Aug 24 01:52:49.826425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 314/628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:49 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:49.831741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:49.832558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:49.839073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.839685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.840257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:49.841630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:49.842325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:49.842976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.176632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.179941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.183389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:50.188177 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3e90828e-ecab-4cce-b1e1-f2fd07c6c76c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1472 microversion: 2.1 time: 0.546767 Aug 24 01:52:50.190002 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 315/629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:49 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1472 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:50.204010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f557147f-554d-4339-a58a-08554c35094e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.365826 Aug 24 01:52:50.204010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 315/630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:49 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:50.206672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:50.207562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:50.213063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:50.214222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:50.222283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.222856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.223301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.224328 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.226165 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.227004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.228174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.229061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.229749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.230676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.232007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.239692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.367992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.377035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.378798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.384311 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9e0a3392-9b94-4e12-9862-85cff3fdb8d8 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.176118 Aug 24 01:52:50.385465 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 316/631] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:50 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:50.586530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.607454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.610373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:50.617883 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-757f7266-46d5-4594-99d5-5d75e77d15fa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.422677 Aug 24 01:52:50.626553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 316/632] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:50 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:50.846977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:50.847592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:50.853981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.854481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.854918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:50.855702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:50.856105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:50.857224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.217382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:51.218687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:51.225546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.226263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.226855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.242089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.242761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.243523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.501362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:51.523749 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-85f4b743-7450-4fb4-a2c1-2435f377ec93 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.678313 Aug 24 01:52:51.526517 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 317/633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:50 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:51.541917 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:51.544760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:51.556500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.557291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.558440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.560513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.561510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.562121 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.591093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:51.601394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1119605-4c3c-45d7-8bb0-a858ea646e1a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1472 microversion: 2.1 time: 0.386503 Aug 24 01:52:51.603440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 317/634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:51 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:51.612945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:51.617195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:51.633779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.634563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.635202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.636235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.640759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.641404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.806427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:51.836256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:51.846045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:51.862940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eb56cd1-7edf-4daa-b094-796e72101771 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.257866 Aug 24 01:52:51.877555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 318/635] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:51 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:51.887402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82be3418-e949-4bdd-87b2-9846743bebe5", "name": "network-vif-plugged", "status": "completed", "tag": "ed3075ef-12af-44cd-84a3-be7a53eff25a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:51.898322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.899336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.899931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.913397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] Creating event network-vif-plugged:ed3075ef-12af-44cd-84a3-be7a53eff25a for instance 82be3418-e949-4bdd-87b2-9846743bebe5 on n-h1-854121-3 Aug 24 01:52:51.923565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-86d232a3-dcfe-47b9-bfd8-704ba9c2d6fb req-dcc00aaf-465b-4f7f-b98d-1f2ff3568cd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043721 Aug 24 01:52:51.933919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 319/636] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:51.951323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:51.952022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:51.970359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.971277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.971884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:51.973514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:51.977541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:51.978275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.189976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.199239 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f6dae5bc-450c-4114-94bd-463bd28b49e1 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1321 microversion: 2.1 time: 0.670341 Aug 24 01:52:52.201808 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 318/637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:51 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1321 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:52.208641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dae3c136-7568-495f-b0af-a52d224de1ef", "name": "network-vif-unplugged", "status": "completed", "tag": "29ec5588-fd93-4bde-abed-db7b9c317973"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:52.238144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.238712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.239602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.255640 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] Creating event network-vif-unplugged:29ec5588-fd93-4bde-abed-db7b9c317973 for instance dae3c136-7568-495f-b0af-a52d224de1ef on n-h2-854121-3 Aug 24 01:52:52.266900 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-b990fced-f4f8-4cb2-ae5e-52bf0cde8335 req-82c79317-ba79-4401-a34d-c33cc347df39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059107 Aug 24 01:52:52.267939 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 319/638] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:52.331478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.343321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.346534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.349343 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a687d2a-2da6-44c6-b146-d78c520a6140 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.412250 Aug 24 01:52:52.350264 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 320/639] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:51 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:52.449232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:52.449603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:52.463777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.464288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.464748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.466060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.466536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.466967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.490211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e4fb049-ae81-41e7-abcb-53a6429c40fe", "tag": "90cdf8e5-dc39-4eb7-b233-371dd8be2b97"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:52.510821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.511310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.516559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.545732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] Creating event network-changed:90cdf8e5-dc39-4eb7-b233-371dd8be2b97 for instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe on n-h1-854121-3 Aug 24 01:52:52.557564 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e178c67e-3c2d-4d33-ba6d-87ffd191154e req-988da9f7-84eb-4b02-9d82-fcd319ffcb3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072472 Aug 24 01:52:52.561521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 321/640] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:52:52.569531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:52.573000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:52.586997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.587730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.589035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.590041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.590756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.591332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.893352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.904066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b09088c-e3a6-4226-862e-770488c68dbf tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1314 microversion: 2.1 time: 0.340520 Aug 24 01:52:52.904656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 322/641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:52 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:52.909634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:52.910238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:52.932758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.934555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.935248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.936667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:52.937288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:52.937970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:52.947829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:52.961288 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-057d6ff5-acf7-4b81-ad3f-ad1f5adf2577 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 200 len: 1583 microversion: 2.1 time: 0.519228 Aug 24 01:52:52.973495 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 320/642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:52 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 1583 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:52.992461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:52.993497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:53.001524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.002026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.002463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.003329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.003786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.004513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.101058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.109933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-530b5fb0-bd97-47c5-8b42-fc43a2b28bf5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.203709 Aug 24 01:52:53.111039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 323/643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:52 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:53.134177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.143595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.145418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.154028 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7adb74f3-0a6d-434e-beae-b6e322c808bc tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.179276 Aug 24 01:52:53.154607 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 321/644] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:52 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:53.237122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:53.237650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:53.263189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.271744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.273735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.274679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.275145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.276960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.373885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:53.374506 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:53.390432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.395061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.395626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.396581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.397033 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.402152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.594257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.605845 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.607426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.618167 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5b726ab9-bc45-4c89-8d1d-d1b722760717 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.250391 Aug 24 01:52:53.618762 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 322/645] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:53 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:52:53.712925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:53.724513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ec1464a-9156-4ac1-bb53-cb7bb5d996f4 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1470 microversion: 2.1 time: 0.499900 Aug 24 01:52:53.738172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 324/646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:53 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1470 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:53.930764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:53.931789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:53.947013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.948119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.949449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:53.951070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:53.954526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:53.955400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.266069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:54.267259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] [instance: 0994a896-a142-41a0-ae0d-423b7080a2a8] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:54.273467 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] HTTP exception thrown: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Request method failure captured: Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/0994a896-a142-41a0-ae0d-423b7080a2a8/action HTTP/1.1 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 15 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRcgHoBxPyMjOfl8H6Q0k57lsTWvoFZFiDeE46W1dnXlYnFcO2UCcXgTZXb_y54CbUpwbdPjfqNmgb0-nt4FaRkpPsCzNBqhZMra-4Kh_QhztewazKEfpO3Uw5BPWrrrADFcr2RnO7wEeUopVvjrQuZ3DNSFkqUNTj0caZQONKRFTQ Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:52:54.275542 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d0e25733354a4aa08ad17a3ec17b208e Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: {"migrate": {}} Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:52:54.276889 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '0994a896-a142-41a0-ae0d-423b7080a2a8', 'body': {'migrate': {}}} Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:52:54.277722 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. Aug 24 01:52:54.278901 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:52:54.282411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Returning 404 to user: Instance 0994a896-a142-41a0-ae0d-423b7080a2a8 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:52:54.283628 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d5e2b856-c9be-4c71-a911-5e620232d23d tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/0994a896-a142-41a0-ae0d-423b7080a2a8/action" status: 404 len: 111 microversion: 2.1 time: 0.532907 Aug 24 01:52:54.284641 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 323/647] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:52:53 2022] POST /compute/v2.1/servers/0994a896-a142-41a0-ae0d-423b7080a2a8/action => generated 111 bytes in 535 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:52:54.289946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:54.291639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:54.315875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.320025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.321107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.322116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.322839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.325430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.386286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:54.404657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-631b4b29-d4f1-4333-b0a8-b00f53b224d7 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1463 microversion: 2.1 time: 0.472240 Aug 24 01:52:54.405339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 325/648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:53 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1463 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:54.410167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:54.410784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:54.430224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.430736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.431178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.431886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.432342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.432789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.562224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:54.571133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:54.573117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:54.579191 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b166805-8949-428a-ad0f-593413137d04 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.172795 Aug 24 01:52:54.580064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 326/649] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:54 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:54.607081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:54.609194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dae3c136-7568-495f-b0af-a52d224de1ef", "tag": "29ec5588-fd93-4bde-abed-db7b9c317973"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:54.622917 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e07b24f2-343f-4f20-8336-d44c66a8b173 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.336817 Aug 24 01:52:54.623819 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 324/650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:54 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:54.624144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.624984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.625638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:54.644620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] Creating event network-changed:29ec5588-fd93-4bde-abed-db7b9c317973 for instance dae3c136-7568-495f-b0af-a52d224de1ef on n-h2-854121-3 Aug 24 01:52:54.680061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-991fc6b6-fbd8-4425-b07a-4e47e14e156c req-f4bfc3d4-1292-4954-9e3b-0c6b86b67d0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077174 Aug 24 01:52:54.680938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 327/651] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:54.693472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1962661509", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:52:54.790776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:52:54.959423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Calling method '.version_select at 0x7f6b9284e310>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:54.989067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:54.989932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:54.990601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.020799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.021772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.022597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.052643 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9822b5b4-fa09-4bb0-97da-6a11e6fc0682 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/252e5b66d64748d29ca1b14fcc1c7dd3?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150" status: 200 len: 695 microversion: 2.1 time: 0.427739 Aug 24 01:52:55.054157 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 325/652] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Aug 24 01:52:54 2022] GET /compute/v2.1/os-simple-tenant-usage/252e5b66d64748d29ca1b14fcc1c7dd3?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150 => generated 695 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:55.059450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:55.060956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:55.068630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.069573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.070635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.071580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.072357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.073017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.287913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.305295 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.308264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.311318 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2ff64628-eb8c-4bd8-bc45-1c322e72cea7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.255954 Aug 24 01:52:55.312205 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 326/653] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:55 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:55.322323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '.version_select at 0x7f6b9282e0d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:55.343626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.347974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.348657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.369813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.370685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.371418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.386102 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7dd9c7f5-44dd-4e28-a481-6c00a3d48f81 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/252e5b66d64748d29ca1b14fcc1c7dd3?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150" status: 200 len: 695 microversion: 2.1 time: 0.072105 Aug 24 01:52:55.387975 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 327/654] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Aug 24 01:52:55 2022] GET /compute/v2.1/os-simple-tenant-usage/252e5b66d64748d29ca1b14fcc1c7dd3?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150 => generated 695 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:52:55.401996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Calling method '.version_select at 0x7f6b926aa820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:55.422348 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.425073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.439754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.470943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.471438 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.471867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.560674 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-aa17b896-e8f3-4ca7-a55c-33aa19d237f4 tempest-TenantUsagesTestJSON-559744190 tempest-TenantUsagesTestJSON-559744190-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150&detailed=1" status: 200 len: 9140 microversion: 2.1 time: 0.163193 Aug 24 01:52:55.561905 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 328/655] 10.222.0.49 () {58 vars in 1335 bytes} [Wed Aug 24 01:52:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T01%3A52%3A54.418150&end=2022-08-25T01%3A52%3A54.418150&detailed=1 => generated 9140 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:55.583141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:55.583985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:55.604113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.604768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.605315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.606917 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.609410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.610047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.650181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:52:55.777195 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dcc5b582-caa7-4032-84c2-e60fe1a745e1 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "DELETE /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 204 len: 0 microversion: 2.1 time: 0.197557 Aug 24 01:52:55.778663 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 329/656] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:52:55 2022] DELETE /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 01:52:55.786031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:55.803036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:55.819783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.822188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.824014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.825238 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.826127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.828072 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.868427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:52:55.869588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:52:55.870412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:52:55.871026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:52:55.871694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:52:55.886854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.888028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.888777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.889716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:55.890412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:55.891045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:55.913482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Getting quotas for project 7c47edb9fb8f4e42836583685ee94de6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:52:55.918502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Getting quotas for user 785f8e0c4f1c4cb5ab1a1163e40ce4b7 and project 7c47edb9fb8f4e42836583685ee94de6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:52:55.937439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:52:55.941264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:52:55.959899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.972672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.976319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:55.978782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:55.988649 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bb545292-15f6-4fe0-84b3-f2b70685bd02 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.208477 Aug 24 01:52:55.989285 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 330/657] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:55 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:56.006710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:56.007336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:56.013355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.013837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.014280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.014975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.018225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.018691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.019257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5d73bc9-9214-401e-9ea2-da19f961d5cf tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.335115 Aug 24 01:52:56.021423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 328/658] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:52:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:52:56.035241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:56.037677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:56.050416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.051303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.052161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.053138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.053801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.054630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.481189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.491325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6cf73c0-eba4-4e72-8986-6b225c87f73e tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1469 microversion: 2.1 time: 0.468171 Aug 24 01:52:56.505311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 329/659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:56 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1469 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:56.511111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c91bfe54-ea35-4a37-a272-b967c36aee10 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:56.512166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c91bfe54-ea35-4a37-a272-b967c36aee10 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:56.624474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.635334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c91bfe54-ea35-4a37-a272-b967c36aee10 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.642213 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bbc391ec-681e-4dc8-b554-5d14f5d64f3b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.651872 Aug 24 01:52:56.643192 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 331/660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:55 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:56.647764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:56.648560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:56.657215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.657955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.658598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.659529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:56.660071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:56.660558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:56.661877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c91bfe54-ea35-4a37-a272-b967c36aee10 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1222 microversion: 2.1 time: 0.154701 Aug 24 01:52:56.663302 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 330/661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:56 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:56.666153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:52:56.874046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.883510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.889099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:56.890360 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3c8a96fe-1e21-4bdf-b431-7eee575387d3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.246203 Aug 24 01:52:56.893642 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 332/662] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:56 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:57.018172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:57.020141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:57.110298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.121162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.123653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:57.125351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.128030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.129716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:57.349058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:57.361070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:57.366078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:57.381961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65af708f-8972-496f-be3e-7c7dfc10551a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.369720 Aug 24 01:52:57.383618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 331/663] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:57 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:57.518546 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:57.519175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:57.528700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.540430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.540939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:57.544535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.545063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.545507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:57.664054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:57.665092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:57.680062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.694028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.694826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:57.696079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:57.697838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:57.702578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.010734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.025634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7510eaa-757d-42a3-bc37-e8ab33eb7659 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.365792 Aug 24 01:52:58.026316 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 332/664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:57 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:52:58.044483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:58.045451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:58.053463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.054343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.055016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.055967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.056643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.057334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.095957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.109565 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d0f820e4-384f-4862-ada1-63aeac5945e4 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1469 microversion: 2.1 time: 0.595150 Aug 24 01:52:58.114854 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 333/665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:57 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1469 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:58.126377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:58.133982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:58.143651 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.146594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.147240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.148084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.149145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.149692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.253895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.267694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89b82032-1bf7-4b79-8b29-4d2f781be5df tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1218 microversion: 2.1 time: 0.226904 Aug 24 01:52:58.268518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 333/666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:58 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:58.410404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:58.411029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:58.422950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.423471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.443400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.444192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:58.444677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:58.445401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:58.521505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.541089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.553818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.560537 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7bcae138-526d-4b95-85d2-c6d1e16a92fc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.441940 Aug 24 01:52:58.564331 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 334/667] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:58 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:58.797076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.814189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.819870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:58.859844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a898314b-d0cd-4105-a306-15025224a302 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.453455 Aug 24 01:52:58.863419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 334/668] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:58 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:52:59.060230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:59.061638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:59.071532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.074531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.077258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.078871 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.079638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.080330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.138767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:59.141634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:59.153144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.158996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.159700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.160646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.161314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.162134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.444988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:59.463344 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e916be86-44fa-4424-b71a-bac6e6646c69 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.416116 Aug 24 01:52:59.463955 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 335/669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:59 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:59.484694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:59.487893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:59.503819 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.504940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.505631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.506566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.507355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.508113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.687662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:59.698011 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1506afd7-ba20-4d21-a94b-6df8af5a3d3e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1292 microversion: 2.1 time: 0.232800 Aug 24 01:52:59.704490 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 336/670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:59 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1292 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:59.727115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:59.729875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:59.755250 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.755754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.756188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.756928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.757374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.760234 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.872868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:52:59.885423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-102be42d-d11d-40c8-9715-d2b68a63fade tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1469 microversion: 2.1 time: 0.751237 Aug 24 01:52:59.886314 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 335/671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:52:59 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1469 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:52:59.896758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:52:59.905472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:52:59.922940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.923742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.924353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.925354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:52:59.925971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:52:59.926548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:52:59.931393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:00.099403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.114154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.116988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.119557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-39cfd190-41a9-4332-bf4a-23987f58b1c5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.413768 Aug 24 01:53:00.122803 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 337/672] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:59 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:00.249854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.261815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.270381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:00.285566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-852fd744-f2bf-4fb0-92e2-6a11f0898e80 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.394377 Aug 24 01:53:00.288585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 336/673] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:52:59 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:00.491597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:00.492200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:00.502408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:00.503245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:00.505712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:00.506969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:00.512419 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:00.513480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:00.590872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82be3418-e949-4bdd-87b2-9846743bebe5", "name": "network-vif-deleted", "tag": "ed3075ef-12af-44cd-84a3-be7a53eff25a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:00.603013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:00.603882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:00.604541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:00.631875 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] Creating event network-vif-deleted:ed3075ef-12af-44cd-84a3-be7a53eff25a for instance 82be3418-e949-4bdd-87b2-9846743bebe5 on n-h1-854121-3 Aug 24 01:53:00.646643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a139216d-3cc6-4715-9a4a-f2c228461494 req-f9b79417-e2c1-4213-8d71-e87a1247d79f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062163 Aug 24 01:53:00.651229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 337/674] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:00.729261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:00.730105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:00.750374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:00.751897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:00.752418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:00.757839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:00.758785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:00.759312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:00.994482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.038630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a93312c8-b520-4198-8748-09a368902047 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1280 microversion: 2.1 time: 0.314302 Aug 24 01:53:01.040917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 338/675] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:00 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:01.078373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:01.087055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:01.102552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.105445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.106112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.107540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.108288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.109224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.147809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.148657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.149315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.150135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lazy-loading 'fault' on Instance uuid 82be3418-e949-4bdd-87b2-9846743bebe5 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:01.207677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.227215 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-872b5732-7771-49c5-a53e-87a6128e417d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.739316 Aug 24 01:53:01.229669 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 338/676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:00 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:01.242364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:01.244187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:01.262412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.263056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.267305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.268308 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.268924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.270094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.275055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790b3ad5def74474a13ee83ae83e534d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252e5b66d64748d29ca1b14fcc1c7dd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.292651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be5e400d-c11d-4982-ab48-98add61978c2 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 200 len: 1304 microversion: 2.1 time: 0.249685 Aug 24 01:53:01.294240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 339/677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:01 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:01.325660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:01.327130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:01.337524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.338027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.338466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.347292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:01.347842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:01.348297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:01.566224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.584994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.587050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.598198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d016073e-5688-4243-93a1-e6a5c95162ae tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.282810 Aug 24 01:53:01.598803 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 340/678] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:01 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:01.766784 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.786146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.791683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:01.793732 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4388fe79-76f0-45f2-8986-a8efeaec64f9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 0.562443 Aug 24 01:53:01.794555 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 339/679] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:01 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:02.064863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:02.065841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:02.080292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.080830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.081267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.082239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.082854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.084114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.240674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:02.252808 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:02.253705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:02.260547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b06be5d9-f093-490e-b0af-fc1207794ef9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1280 microversion: 2.1 time: 0.199713 Aug 24 01:53:02.284111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.284708 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 341/680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:02 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1280 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:02.285752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.286370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.287266 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.289561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.290185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.317927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:02.318792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] [instance: 82be3418-e949-4bdd-87b2-9846743bebe5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:02.330987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.331688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.332289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.335133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.335810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.337331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.381839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] HTTP exception thrown: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Request method failure captured: Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 HTTP/1.1 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYRdijSwM2ysJd_OCEhw618s_d84b8d7sC0GSoXhtaHVElFkS90blJjuaHCwH9TEdrkf-dn-84phSa-y0iarb3erJxGn2MCpWpidPdFvH1k8ZSbzXRzK-OYCR9jJLbPYGbtJwUWB1RfFjdyS5tiRDXxpuaHpC_9Phe3ucXVZ0aiyIjk Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 252e5b66d64748d29ca1b14fcc1c7dd3 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TenantUsagesTestJSON-1873785708 Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:53:02.383810 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/252e5b66d64748d29ca1b14fcc1c7dd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/252e5b66d64748d29ca1b14fcc1c7dd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/252e5b66d64748d29ca1b14fcc1c7dd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_252e5b66d64748d29ca1b14fcc1c7dd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TenantUsagesTestJSON-1873785708 Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 252e5b66d64748d29ca1b14fcc1c7dd3 Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1873785708 Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TenantUsagesTestJSON-1873785708-project Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 790b3ad5def74474a13ee83ae83e534d Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TenantUsagesTestJSON-1873785708-project Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. Aug 24 01:53:02.385366 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '82be3418-e949-4bdd-87b2-9846743bebe5'} Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:02.386138 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. Aug 24 01:53:02.387752 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:02.394213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] Returning 404 to user: Instance 82be3418-e949-4bdd-87b2-9846743bebe5 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:02.398988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45f11df1-99fa-4b2c-84f6-b7ce9fd4f531 tempest-TenantUsagesTestJSON-1873785708 tempest-TenantUsagesTestJSON-1873785708-project] 10.222.0.49 "GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5" status: 404 len: 111 microversion: 2.1 time: 0.087242 Aug 24 01:53:02.404025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 342/681] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:02 2022] GET /compute/v2.1/servers/82be3418-e949-4bdd-87b2-9846743bebe5 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:53:02.629118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:02.630762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:02.646818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.647635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.648905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:02.651503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:02.652186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:02.654384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:03.069140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:03.091571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:03.094501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:03.119603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7008c51c-7ece-4efd-858d-edb607cfcd38 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.499529 Aug 24 01:53:03.141790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 343/682] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:02 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:03.148645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:03.159994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:03.167142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:03.178205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:03.180969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:03.182823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:03.183789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:03.184936 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-04ad4f2b-f059-48d1-b4fa-0a63e70f475e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.935747 Aug 24 01:53:03.185638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:03.185784 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 340/683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:02 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:03.188372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:03.286126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:03.287323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:03.298292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:03.299668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:03.300113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:03.301076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:03.301314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:03.307411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:03.554840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:03.567951 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-785c4fcf-0fdc-4c75-8d99-45f443decac6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.283112 Aug 24 01:53:03.569306 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 341/684] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:03 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:04.079320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1512029042", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8d282946-c6d2-446c-a4ca-e9e99e5e112e"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:04.153909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] validate_networks() for [('8d282946-c6d2-446c-a4ca-e9e99e5e112e', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:04.177655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.187019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.188573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.189892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd554e5a-eae4-4221-b4cb-5f9508ca82b0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1567 microversion: 2.25 time: 1.043829 Aug 24 01:53:04.190820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 344/685] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:03 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1567 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:04.195865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:04.196469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:04.203037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.203527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.204190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.205130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.205861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.206509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.424509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.434395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.437391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:04.444133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11c47e40-3e6a-4d5f-b395-869c3098d126 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.252045 Aug 24 01:53:04.445456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 345/686] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:04 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:04.464162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:04.465631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:04.479025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.479794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.482552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.483514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.484796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.485393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.889653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:04.890263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:04.890897 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:04.891412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:04.891973 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:04.908203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.908963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.909681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.910896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:04.911859 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:04.912686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:04.997701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.004385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:05.008075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57c7887f-5973-4d34-81db-2464cc0ea296 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.561399 Aug 24 01:53:05.010351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 346/687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:04 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:05.020783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:05.025700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.026562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:05.036537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for user 0aa9308751b9454b8d173b034f4b040b and project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:05.040630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.045411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.046044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.046959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.047579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.048183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.074115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:05.082572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:05.187144 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6cf6be40-eef3-436d-9604-4244def158a4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414371 Aug 24 01:53:05.191536 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 342/688] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:53:05.206955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-54859fdd-0114-4a20-92a2-71895d002e41 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.212549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-54859fdd-0114-4a20-92a2-71895d002e41 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:05.313591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-54859fdd-0114-4a20-92a2-71895d002e41 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.325825 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-54859fdd-0114-4a20-92a2-71895d002e41 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1211 microversion: 2.1 time: 0.125094 Aug 24 01:53:05.328500 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 343/689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:05.336148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.337293 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:05.350074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.351978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.352515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.354328 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.356618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.357598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.594348 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.604550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.606864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.608346 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b8ea2e86-ce46-47b0-b245-568efa70fb15 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1542 microversion: 2.25 time: 0.278469 Aug 24 01:53:05.609519 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 344/690] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1542 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:05.614576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.615456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:05.622439 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.623241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.623891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.624866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.625542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.626180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.720394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.729260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.731812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.738452 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e161b827-d0b5-4bcf-8bb6-f80d2f4d262c tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.127317 Aug 24 01:53:05.739515 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 345/691] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:05.754644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-509c1dac-4180-47fa-9e7f-69ce92ef5959 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '.version_select at 0x7f6b92c1e280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.754644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-509c1dac-4180-47fa-9e7f-69ce92ef5959 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.754644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-509c1dac-4180-47fa-9e7f-69ce92ef5959 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.754644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-509c1dac-4180-47fa-9e7f-69ce92ef5959 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.760087 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-509c1dac-4180-47fa-9e7f-69ce92ef5959 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.018014 Aug 24 01:53:05.769832 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 346/692] 10.222.0.49 () {60 vars in 1184 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:05.775153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:05.775977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:05.802767 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.803094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.803531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.804236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:05.804685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:05.805128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:05.904877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:05.928404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:05.940041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a5c02e4-d224-4e3f-9c3b-4afb9ef127ad tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.927572 Aug 24 01:53:05.946671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 347/693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:06.033832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:06.034558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:06.046160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.046668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.047106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.051115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.053184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.053807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.056540 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:06.100282 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5c83be3c-bf97-4e06-bdda-dc2c24edca76 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 2034 microversion: 2.25 time: 0.328940 Aug 24 01:53:06.100905 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 347/694] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:05 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 2034 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:06.144568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6f62f30b-f98c-42b1-be35-4717c2c50a3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: .version_select at 0x7f6b92ba3700>, body: {"keypair": {"name": "tempest-keypair-110667041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjWxzMEig54pfRWr2h1C6FtAu5Mv2liRdYKdT+EImExkvGqikhxKiKPSJ0Lpi2lhyqJrluHEjdlCEeG4UikcTFYUeqywNbG1kjthi+kMM90OwJd5UqWipU5mDxp/eUN6w=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:06.193186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-6f62f30b-f98c-42b1-be35-4717c2c50a3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:06.210320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-6f62f30b-f98c-42b1-be35-4717c2c50a3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for user 6223af42e4e34d7cb4f327824ac148af and project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:06.268827 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6f62f30b-f98c-42b1-be35-4717c2c50a3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.134491 Aug 24 01:53:06.269429 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 348/695] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 01:53:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 01:53:06.349096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:06.349982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:06.360545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.363528 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.364930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.368453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.369299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.369913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.552743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:06.569198 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc79ff1c-f3dd-412c-8226-4b02db0fb61d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1207 microversion: 2.1 time: 0.225274 Aug 24 01:53:06.569812 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 349/696] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:06 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1207 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:06.616910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73aaac40-399b-4309-991a-ae8eecfe7833", "tag": "fbad97c9-2715-4462-a1d7-c03a2248ab46"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:06.640378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:06.646810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.647469 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.650921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.685419 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] Creating event network-changed:fbad97c9-2715-4462-a1d7-c03a2248ab46 for instance 73aaac40-399b-4309-991a-ae8eecfe7833 on n-h1-854121-3 Aug 24 01:53:06.717643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:06.721205 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-ad5da212-5cf6-4283-8ee4-833c9999a161 req-2cab4f23-a42c-42aa-8036-8d0f10e53a25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107954 Aug 24 01:53:06.724976 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 350/697] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:06.728286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf97bfaf-f7d0-4d11-bb3e-3f083c91b456 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.698529 Aug 24 01:53:06.728885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 348/698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:06 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:06.770915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:06.772618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:06.783563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.784487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.786217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.787376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.788213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.789225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.891171 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:06.930701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:06.939693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:06.955676 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-57df9191-d4c8-4ea9-8799-4aefc102d334 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.190167 Aug 24 01:53:06.957010 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 351/699] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:06 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:06.973617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:06.974227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:06.986268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.989043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.989539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:06.991157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:06.991854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:06.992550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:07.340559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:07.361614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b11e6a53-1ec1-4552-82fe-008ab0619995 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.390865 Aug 24 01:53:07.363518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 349/700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:06 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:07.594682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:07.595662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:07.609228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:07.609743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:07.610192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:07.614949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:07.615800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:07.618423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:07.780319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:07.797125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f1a9400-af33-48a2-9e5c-b659530c8daa tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1281 microversion: 2.1 time: 0.200441 Aug 24 01:53:07.799166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 350/701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:07 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:07.804567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:07.809507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:07.819614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a9a258db-e9ea-4eae-be17-919e3b05876e tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Action: 'create', calling method: .version_select at 0x7f6b9282e9d0>, body: {"pool": null} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:07.842589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:07.843090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:07.843717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:07.844576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:07.845201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:07.845774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:08.766144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:08.782124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e978eaf-5a3d-4592-baeb-45be81aedac9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.981716 Aug 24 01:53:08.784707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 351/702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:07 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:08.790580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:08.800233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:08.812960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:08.813796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:08.815396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:08.816478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:08.817120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:08.818003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:08.922003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:08.942035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:08.945805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:08.958786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39092d13-c727-47dd-980a-05b70ddf3a9a tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.171766 Aug 24 01:53:08.979632 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 352/703] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:08 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:08.985572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:08.986178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:09.004483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.005008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.005442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:09.006146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.006593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.007013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:09.440407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:09.445874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:09.461790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93b844bc-0976-4bc6-b182-a1177ceb3a11 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.478303 Aug 24 01:53:09.464002 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 353/704] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:08 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:09.477858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:09.480815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:09.500118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.501300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.501885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:09.511067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.513829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.514410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:09.794305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:09.809453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85fce503-c6cc-41b2-ae28-fd5d7a28ba67 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1269 microversion: 2.1 time: 0.343396 Aug 24 01:53:09.810052 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 354/705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:09 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1269 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:09.846147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:09.846782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:09.865616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.866118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.866565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:09.867315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:09.867774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:09.868642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.142023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:10.150195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1543a82c-fb3a-4d28-b1bb-dcac7d501c67 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.309233 Aug 24 01:53:10.151567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 355/706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:09 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:10.157317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:10.158247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:10.171399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.172200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.173711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.174661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.175344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.175991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.309424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:10.326158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:10.327677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:10.346657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-438cc8ee-e7fe-4773-b38e-14dc2b9f4d10 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.192288 Aug 24 01:53:10.348521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 356/707] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:10 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:10.487553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:10.488169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:10.499328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.500089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.500759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.501668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.504240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.505004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.683194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:10.691746 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-396c2a89-b957-400f-abef-b606f593e007 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.208016 Aug 24 01:53:10.692331 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 357/708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:10 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:10.832630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:10.834106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:10.841435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.842007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.842653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:10.843604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:10.844174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:10.844818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.111079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:11.120076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-959219ff-6e8a-46ad-9b8a-c62fb46ab9de tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.292211 Aug 24 01:53:11.121889 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 358/709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:10 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:11.172052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:11.173295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:11.180976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.181470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.181900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.186493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.187372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.188490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.348853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:11.358289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cd02df1-d71a-4ebc-b1e6-7bf3b6c7e519 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.190611 Aug 24 01:53:11.358964 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 359/710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:11 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:11.378419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:11.379036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:11.385188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.385924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.386646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.388082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.388525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.389145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.468064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:11.479885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:11.483038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:11.489977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-482aaf46-ef05-4a63-bff8-ce46155c9139 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1447 microversion: 2.75 time: 0.115435 Aug 24 01:53:11.491421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 360/711] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:11 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:11.620223 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a9a258db-e9ea-4eae-be17-919e3b05876e tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.074937 Aug 24 01:53:11.620932 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 352/712] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:53:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:11.633707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6934b0ec-5d4a-4f56-8383-80070f694995 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Action: 'create', calling method: .version_select at 0x7f6b9259d430>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:11.725229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:11.726124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:11.739241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.744196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.747210 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.748314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:11.751295 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:11.756978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:11.793581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:12.119502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:12.132926 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f440ba0e-1865-4e8c-a9af-9a43f76a38d2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.420879 Aug 24 01:53:12.135654 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 353/713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:11 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:12.153539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-460228445", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "0c6330be-cca7-4bf4-967a-c3f5a62fa964"}], "security_groups": [{"name": "tempest-securitygroup--763423787"}], "key_name": "tempest-keypair-110667041", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:12.355608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] validate_networks() for [('0c6330be-cca7-4bf4-967a-c3f5a62fa964', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:12.981311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:12.982579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:12.984908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:12.987926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:12.988643 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:13.002166 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.002853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.004284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.005302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.006081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.006832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.038222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:13.043674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for user 6223af42e4e34d7cb4f327824ac148af and project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:13.064816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:13.069246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:13.142635 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-84308b4c-d0b2-4730-8e2f-5cf234d73364 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.004006 Aug 24 01:53:13.152303 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 354/714] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:53:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:53:13.158180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:13.159060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:13.166568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.167317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.168611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.169484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.170342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.183640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.314630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6934b0ec-5d4a-4f56-8383-80070f694995 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.685029 Aug 24 01:53:13.324093 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 361/715] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:53:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:13.330977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:13.331586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:13.339396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.340423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.340897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.341825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.342280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.342759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.529355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.543007 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f538e155-8c5f-440a-b98d-a81d61fb9a10 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.386220 Aug 24 01:53:13.544705 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 355/716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:13 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:13.557253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:13.558806 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:13.573107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.577311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.578071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.579591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.581405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.582065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.674000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.684967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63eff48c-5b1c-4b02-89d3-b1c4cff32f97 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.359664 Aug 24 01:53:13.687183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 362/717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:13 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:13.695271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:13.697880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:13.708889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.709385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.709801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.710540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:13.710991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:13.711456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:13.726663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.743461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.747515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.763903 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-626d6fae-1e46-47c8-9551-543941e355b7 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1453 microversion: 2.75 time: 0.217820 Aug 24 01:53:13.764509 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 356/718] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:13 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:13.773705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:13.778148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:13.978983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:13.986856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc606f27-0f56-4eee-8ce0-04d38a1c52a0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.298295 Aug 24 01:53:14.001186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 363/719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:13 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:14.006528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edf93e45-3324-4c74-ba0e-d799116b71b3 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Action: 'create', calling method: .version_select at 0x7f6b926f8f70>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:14.191105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:14.210454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:14.212861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:14.215939 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b5fa12c3-abdc-492b-9030-f0075ec14a03 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1284 microversion: 2.25 time: 0.445539 Aug 24 01:53:14.217209 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 357/720] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:13 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1284 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:14.238109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e168b2-7e82-437b-864a-225d7b692ddb", "tag": "931114a1-6b6b-4881-b4e0-c622ffab2d99"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:14.250296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:14.251123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:14.252139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:14.271216 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] Creating event network-changed:931114a1-6b6b-4881-b4e0-c622ffab2d99 for instance e0e168b2-7e82-437b-864a-225d7b692ddb on n-h1-854121-3 Aug 24 01:53:14.279785 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-10c27de9-4d3d-4801-bdea-5c4782267f70 req-1782f971-2900-4d8b-b881-72198728013e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059242 Aug 24 01:53:14.280838 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 358/721] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:14.568578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:14.569354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:14.580137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:14.582239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:14.582953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:14.585195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:14.587214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:14.588421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:14.948759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:14.958655 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ab9bdc2e-7a39-4e72-ab6e-145688b91071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.394306 Aug 24 01:53:14.961791 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 359/722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:14 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:14.975530 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:14.976779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:14.989266 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:14.989886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:14.990211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:14.990941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:14.991410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:14.991840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.266187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.276068 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7e39d10e-7342-470a-8622-3c093faf353e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.313117 Aug 24 01:53:15.292412 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 360/723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:14 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:15.297769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:15.298561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:15.304860 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.305539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.306157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.307013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.307627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.308203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.396330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.411406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.413578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.419867 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-95a86443-c513-41f3-8ca5-b129ed90ae85 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1453 microversion: 2.75 time: 0.125592 Aug 24 01:53:15.421089 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 361/724] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:15 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:15.426675 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:15.427707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:15.435300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.436051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.437633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.439291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.439963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.441267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.711780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.727556 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-29babcf5-7e7e-4154-8180-9b76bfbacc7e tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.304769 Aug 24 01:53:15.728144 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 362/725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:15 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:15.733419 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:15.741571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:15.752591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.753110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.753661 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.754245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.754702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.755141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.853491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.867477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.870737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:15.873117 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-07b857d8-2a3f-4add-bbe8-0372b852b1a5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1336 microversion: 2.25 time: 0.143719 Aug 24 01:53:15.873880 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 363/726] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:15 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:15.979930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:15.981453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:15.987811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.988576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.989238 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:15.990138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:15.990816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:15.991431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.004850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edf93e45-3324-4c74-ba0e-d799116b71b3 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.002006 Aug 24 01:53:16.014363 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 364/727] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:53:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:16.019668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac35396f-16cb-4ded-af15-26c66ab5a6f7 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Action: 'create', calling method: .version_select at 0x7f6b925ae4c0>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:16.212670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:16.225927 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a04a4a32-b0d8-47ed-b90b-3a168db1d5f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.249972 Aug 24 01:53:16.226830 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 364/728] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:15 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:16.323718 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] Calling method '.version_select at 0x7f6b9294c700>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:16.370503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG neutronclient.v2_0.client [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 642129de-505c-4613-89ff-2ef8fb7127e5 could not be found", "detail": ""}} {{(pid=128566) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 01:53:16.372027 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] HTTP exception thrown: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] Request method failure captured: Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/os-floating-ips/642129de-505c-4613-89ff-2ef8fb7127e5 HTTP/1.1 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSMaiXONTGGEij3amF1UGHjcVT2pfjI5pXZ1FmwSn18iqI2f1OCkwIAY7PFGFvJToKujvExTdvs4evZezjEPo7KRGFeEJPe4UX5T7IG8LKHZB4BleSqoEfS2_9V4jmUnS3wWiuQRKJ2jE3DQ1xH0gAba_tv45i6VhO4UALy-8xL9BU Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 1c311a8daa234a44807d32fa85dc193e Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1694913377 Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:53:16.375197 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c311a8daa234a44807d32fa85dc193e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c311a8daa234a44807d32fa85dc193e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c311a8daa234a44807d32fa85dc193e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c311a8daa234a44807d32fa85dc193e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1694913377 Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 1c311a8daa234a44807d32fa85dc193e Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1694913377 Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d5d95f7103554283b8ba704149839364 Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: exception: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5 Aug 24 01:53:16.376623 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '642129de-505c-4613-89ff-2ef8fb7127e5'} Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:53:16.377428 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 642129de-505c-4613-89ff-2ef8fb7127e5 could not be found Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4dba901d-20c6-4916-83a2-295ca36809fc'] Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5. Aug 24 01:53:16.379199 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5 Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:16.382575 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5 Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] Returning 404 to user: Floating IP not found for ID 642129de-505c-4613-89ff-2ef8fb7127e5 {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d340bfba-7121-4605-8838-b4a1127d7e0c tempest-FloatingIPDetailsNegativeTestJSON-1694913377 tempest-FloatingIPDetailsNegativeTestJSON-1694913377-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/642129de-505c-4613-89ff-2ef8fb7127e5" status: 404 len: 111 microversion: 2.1 time: 0.112469 Aug 24 01:53:16.385463 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 365/729] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:53:16 2022] GET /compute/v2.1/os-floating-ips/642129de-505c-4613-89ff-2ef8fb7127e5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:53:16.389756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:16.390372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:16.399566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.400061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.400494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.401236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.401694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.402147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.622007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:16.634215 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d7c420a-2fa0-4742-a058-b61b4434deaf tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1477 microversion: 2.1 time: 0.250347 Aug 24 01:53:16.634945 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 366/730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:16 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:16.639877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:16.640550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:16.647166 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.647721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.648254 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.649175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.649850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.650500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.752926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:16.763440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:16.765140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:16.771514 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f28aa860-93f2-43f3-80e7-d2932feeb94e tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1453 microversion: 2.75 time: 0.135089 Aug 24 01:53:16.772358 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 367/731] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:16 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1453 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:16.777875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:16.779359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:16.786235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.787039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.787732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:16.788668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:16.789408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:16.790081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.032477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.042629 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-587304ef-aa6a-425a-8bd8-c122984e3ac0 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.268867 Aug 24 01:53:17.053466 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 368/732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:16 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:17.053466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.053466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:17.072086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.073086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.073697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.074775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.080148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.080813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.201396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.211740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.219669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.222269 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-693f7b6a-ca9d-4b59-9c5d-f6f96232938c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1336 microversion: 2.25 time: 0.175856 Aug 24 01:53:17.223028 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 369/733] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:17 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1336 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:17.253750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.254372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:17.260247 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:17.285365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.286366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.287642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.289514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.290633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.291278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.462225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac35396f-16cb-4ded-af15-26c66ab5a6f7 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.446549 Aug 24 01:53:17.470806 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 365/734] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:53:16 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:17.476998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5af5d11f-4096-4885-890c-a4eea1b28173 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b924c21f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.542915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.552927 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-77d71408-4faf-4a47-817e-1684b90b6c5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.305105 Aug 24 01:53:17.554773 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 370/735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:17 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:17.657359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.657965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:17.665143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.673600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.674287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.675062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.678693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.679158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.783315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5af5d11f-4096-4885-890c-a4eea1b28173 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/9098bb26-25d9-4635-8454-f19d5ddc564e" status: 200 len: 141 microversion: 2.1 time: 0.311119 Aug 24 01:53:17.783884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 366/736] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:53:17 2022] GET /compute/v2.1/os-floating-ips/9098bb26-25d9-4635-8454-f19d5ddc564e => generated 141 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:17.797666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73aaac40-399b-4309-991a-ae8eecfe7833", "name": "network-vif-plugged", "status": "completed", "tag": "fbad97c9-2715-4462-a1d7-c03a2248ab46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:17.810664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.811675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.812310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.827549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] Creating event network-vif-plugged:fbad97c9-2715-4462-a1d7-c03a2248ab46 for instance 73aaac40-399b-4309-991a-ae8eecfe7833 on n-h1-854121-3 Aug 24 01:53:17.832890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-724d5f75-6dd1-45a3-91ff-ef0d10a27483 req-0f814fb4-4d75-4614-95d2-6292da1b98b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040156 Aug 24 01:53:17.834069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 367/737] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:17.842200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9696552-d78a-42f2-aa0e-5d72643f5183 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b92561c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.913998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:17.922935 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3313f749-2365-4386-8220-bf7566dae9ed tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1476 microversion: 2.1 time: 0.271106 Aug 24 01:53:17.924078 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 371/738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:17 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:17.928806 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:17.929703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:17.936343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.940078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.940517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:17.941268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:17.941879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:17.942444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:18.109263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:18.130884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:18.136036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:18.151472 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-08c05846-7eda-41c8-a64a-47e47113c57b tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1453 microversion: 2.75 time: 0.226143 Aug 24 01:53:18.154529 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 372/739] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:17 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:18.163134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:18.169930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:18.182611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:18.185451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:18.186221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:18.191344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:18.192137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:18.192843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:18.252749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:18.920732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:18.930675 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-91f84048-e922-45b3-85a1-fc3fefb2929c tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.774130 Aug 24 01:53:18.933166 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 373/740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:18 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:18.938875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:18.939780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:18.950444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:18.951042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:18.951589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:18.952371 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:18.953122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:18.953688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.159078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.172972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.174470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.175575 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9bc4ffb3-b208-45fc-be19-96e7392cde3d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1342 microversion: 2.25 time: 0.240663 Aug 24 01:53:19.179600 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 374/741] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:18 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:19.194307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:19.195702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:19.212139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.212639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.213110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.213816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.214270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.215230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.516958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.531040 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-291d407e-9a27-4d30-95f5-62b06bc9ebe2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.349962 Aug 24 01:53:19.540039 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 375/742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:19 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:19.556001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:19.557029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:19.567307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.568261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.569025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.571326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.572524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.573586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.816343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.827333 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d78f442d-019b-437d-8b72-5e23fed6895e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1476 microversion: 2.1 time: 0.285418 Aug 24 01:53:19.828538 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 376/743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:19 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:19.833596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:19.834272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:19.841168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.841890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.842389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.843151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.843674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.844160 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:19.926207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.941998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.944073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:19.952312 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a0f69d42-4f35-4cf2-9a50-a5e624270dea tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1438 microversion: 2.75 time: 0.122321 Aug 24 01:53:19.953633 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 377/744] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:19 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:19.959792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "name": "network-vif-unplugged", "status": "completed", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:19.979738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:19.980625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:19.981379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.007125 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Creating event network-vif-unplugged:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h1-854121-3 Aug 24 01:53:20.017026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:53:20.033425 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-918b98e7-4885-4c9d-ad97-cdc74d954eba req-5d3534b4-68fc-461a-a391-ae99836ba360 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078243 Aug 24 01:53:20.035644 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 378/745] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:20.041981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:20.042830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:20.050132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.050631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.051154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.051958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.052416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.052879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.382203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:20.391344 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-54425a1b-4235-441d-b119-a851a8ce8dd7 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1322 microversion: 2.1 time: 0.354191 Aug 24 01:53:20.393208 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 379/746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:20 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:20.535047 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9696552-d78a-42f2-aa0e-5d72643f5183 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/9098bb26-25d9-4635-8454-f19d5ddc564e" status: 202 len: 0 microversion: 2.1 time: 2.699462 Aug 24 01:53:20.536158 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 368/747] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:53:17 2022] DELETE /compute/v2.1/os-floating-ips/9098bb26-25d9-4635-8454-f19d5ddc564e => generated 0 bytes in 2701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:53:20.543673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:20.544693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:20.561361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.562571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.564156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.566454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.568160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.569549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.601794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:20.604577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:20.616611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.617192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.617631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.621829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.622425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.624887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.727699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:20.727699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:20.728225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:20.728492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:20.728997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:20.729646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:20.742256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:20.743979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:20.747436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-691c5d19-2b62-414c-8ea7-a5bf46977afa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1342 microversion: 2.25 time: 0.209164 Aug 24 01:53:20.748413 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 369/748] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:20 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:20.776528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1be0e015-29b5-4bff-8890-7633ab6bae48 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b92561af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:20.858887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:20.872147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.872625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.874221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:20.874221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:20.875539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:20.876094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.101375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:21.165195 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d49ee69-33eb-453a-a7ec-700f4149f909 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52/action" status: 202 len: 1942 microversion: 2.75 time: 0.770791 Aug 24 01:53:21.165836 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 380/749] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:53:20 2022] POST /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52/action => generated 1942 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 01:53:21.175180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:21.175687 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:21.192385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.193187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.193647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.198026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.198596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.199073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.308188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1be0e015-29b5-4bff-8890-7633ab6bae48 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.558461 Aug 24 01:53:21.309830 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 370/750] 10.222.0.49 () {58 vars in 1164 bytes} [Wed Aug 24 01:53:20 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:53:21.334185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:21.334349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:21.342841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.344076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.344786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.345679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.346310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.361227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.517961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:21.528036 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-90802e0b-2d1f-4dac-baaa-71ea67d7e6e5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.360994 Aug 24 01:53:21.528920 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 381/751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:21 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:21.549783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:21.566413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.566898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.567325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.586522 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Creating event network-changed:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h1-854121-3 Aug 24 01:53:21.592695 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:53:21.616576 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-36deea43-2aa1-403a-98fa-52bddfb15390 req-10bf8558-3126-40b6-924b-8b2d1291057f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069324 Aug 24 01:53:21.617778 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 382/752] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:21.626678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:21.627498 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:21.635688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.636183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.637270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.638189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.638727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.639241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.668212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:21.679542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fed9e52-4a98-4b63-bf8a-d0e99cce6cc9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1476 microversion: 2.1 time: 0.368470 Aug 24 01:53:21.696776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 371/753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:21 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:21.703273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c81b4da-171a-4085-8656-65f85a5a9527 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b927e2790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:21.767105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:21.792364 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4de90cb4-bbc9-4da6-86d6-87288afd5b82 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.173048 Aug 24 01:53:21.793573 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 383/754] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:21 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:21.798418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:21.799026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:21.805751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.806248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.806686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:21.807391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:21.807904 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:21.808912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.036356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:22.045803 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-00567781-ac30-4975-88b6-e2da268422a9 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1471 microversion: 2.1 time: 0.250985 Aug 24 01:53:22.046446 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 384/755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:21 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:22.067522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:22.068207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:22.076188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.076947 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.077849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.078765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.079464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.080174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.168539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c81b4da-171a-4085-8656-65f85a5a9527 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.469258 Aug 24 01:53:22.169558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 372/756] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 01:53:21 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:22.174183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:22.174932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:22.187179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.187863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.188478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.189403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.190009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.190593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.297315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:22.307531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:22.309627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:22.311139 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-63588fd3-511b-4fa4-bf1f-aeaf7eaa9693 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.253012 Aug 24 01:53:22.312171 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 385/757] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:22 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:22.329600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e168b2-7e82-437b-864a-225d7b692ddb", "name": "network-vif-plugged", "status": "completed", "tag": "931114a1-6b6b-4881-b4e0-c622ffab2d99"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:22.341474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.342119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.342620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.356143 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] Creating event network-vif-plugged:931114a1-6b6b-4881-b4e0-c622ffab2d99 for instance e0e168b2-7e82-437b-864a-225d7b692ddb on n-h1-854121-3 Aug 24 01:53:22.361351 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-7ecb5dec-b929-4ce2-b867-1dd5a1d49326 req-e0182eff-8bc2-4270-86ef-9b97620dde5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Aug 24 01:53:22.362107 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 386/758] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:22.368664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-254f881f-2d81-41a3-963d-930a54293e98 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b9284e670>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:22.396821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lazy-loading 'flavor' on Instance uuid 73aaac40-399b-4309-991a-ae8eecfe7833 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:22.500802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2699d2e8-5ee7-4454-b7e8-7ba23304a61e tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833/action" status: 202 len: 0 microversion: 2.1 time: 0.329994 Aug 24 01:53:22.501633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 373/759] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:22 2022] POST /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:53:22.519313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:22.520163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:22.526707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:22.529529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.530369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.530964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:22.531681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:22.532143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:22.532750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.024606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=10 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:23.156686 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-254f881f-2d81-41a3-963d-930a54293e98 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/f3ceb8f7-503e-49c8-a0ea-b232647e4393" status: 202 len: 0 microversion: 2.1 time: 0.792880 Aug 24 01:53:23.160180 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 387/760] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:53:22 2022] DELETE /compute/v2.1/os-floating-ips/f3ceb8f7-503e-49c8-a0ea-b232647e4393 => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:53:23.164934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:23.165657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:23.171899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.172385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.172851 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.173542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.173998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.174422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.325226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:23.337679 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-66069183-fb0b-44e2-b5cf-d6012c68d69a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.175013 Aug 24 01:53:23.352993 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 388/761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:23 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:23.352993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:23.352993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:23.356228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.356757 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.357247 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.359060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.359590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.360500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.388500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:23.529666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:23.538145 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fc9dda11-889c-4411-974b-600ea5fe2218 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1476 microversion: 2.1 time: 0.197182 Aug 24 01:53:23.553163 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 389/762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:23 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:23.558136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:23.559353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:23.566399 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.567115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.567957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.568797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.569404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.570275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.660437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c158851e-20c4-4ffd-bb63-bd1eebd975b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1630 microversion: 2.1 time: 1.153295 Aug 24 01:53:23.671738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 374/763] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:22 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1630 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:23.676685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e26398bd-14f6-49e7-85ab-fc941e9f1fe4 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b92659af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:23.703592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:23.728446 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-04fd4910-3e89-45de-9d0b-53d01c50a209 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.173737 Aug 24 01:53:23.729218 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 390/764] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:23 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:23.736338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:23.737226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:23.743273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.744075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.744692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.745418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:23.746051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:23.746613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:23.900012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:23.908612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:23.910948 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:23.912406 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3238b3d8-6b42-412d-a4f7-e648efc85af5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.182056 Aug 24 01:53:23.913829 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 391/765] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:23 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:24.359539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:24.360157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:24.362618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=20 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:24.368162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.368971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.369322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.370167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.370729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.371336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.507734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:24.516645 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8ce5bf84-fec5-4190-bad2-ad2ab918f0d3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.160965 Aug 24 01:53:24.517349 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 392/766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:24 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:24.522599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:24.539471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.540026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.540524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.551237 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] Creating event network-changed:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h2-854121-3 Aug 24 01:53:24.556114 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-2d52034e-0eab-4fcb-b6fa-ee6a4f04e767 req-1329a286-82d7-42f7-bd43-ad22acb2b160 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037639 Aug 24 01:53:24.556838 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 393/767] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:24.562433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:24.563720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:24.570592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.571081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.571516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.572213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.572674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.573335 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.708044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:24.715851 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4b1b4a3e-736a-434b-b43a-cb47ac52ef42 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1474 microversion: 2.1 time: 0.157740 Aug 24 01:53:24.716417 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 394/768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:24 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:24.720697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:24.721323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:24.727316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.727810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.728236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.728958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.729416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.729837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.861896 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-49750573-8a3a-49f7-a2fd-4b7e456b1d54 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1613 microversion: 2.1 time: 0.144369 Aug 24 01:53:24.877008 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 395/769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:24 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:24.882842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:24.883678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:24.890008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.890516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.890927 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.891670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.892120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.892540 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:24.969704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:24.987156 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-06f0dc02-0f89-4685-b20b-2445899aea01 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.108997 Aug 24 01:53:24.987742 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 396/770] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:24 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:24.992235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:24.992826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:24.999070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:24.999559 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:24.999994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.000746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.001172 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.001598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.028032 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] HTTP exception thrown: Cannot 'migrate' instance 73aaac40-399b-4309-991a-ae8eecfe7833 while it is in vm_state suspended Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Request method failure captured: Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833/action HTTP/1.1 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 15 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRcgHoBxPyMjOfl8H6Q0k57lsTWvoFZFiDeE46W1dnXlYnFcO2UCcXgTZXb_y54CbUpwbdPjfqNmgb0-nt4FaRkpPsCzNBqhZMra-4Kh_QhztewazKEfpO3Uw5BPWrrrADFcr2RnO7wEeUopVvjrQuZ3DNSFkqUNTj0caZQONKRFTQ Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:53:25.029749 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d0e25733354a4aa08ad17a3ec17b208e Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: {"migrate": {}} Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:53:25.031353 n-d-854121-3 devstack@n-api.service[128566]: exception: Cannot 'migrate' instance 73aaac40-399b-4309-991a-ae8eecfe7833 while it is in vm_state suspended Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '73aaac40-399b-4309-991a-ae8eecfe7833', 'body': {'migrate': {}}} Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 in vm_state suspended. Cannot resize while the instance is in this state. Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.037487 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 73aaac40-399b-4309-991a-ae8eecfe7833 while it is in vm_state suspended Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.038729 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 73aaac40-399b-4309-991a-ae8eecfe7833 while it is in vm_state suspended Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Returning 409 to user: Cannot 'migrate' instance 73aaac40-399b-4309-991a-ae8eecfe7833 while it is in vm_state suspended {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c3cebded-5ba4-4e51-a5c1-694b55414f8c tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833/action" status: 409 len: 148 microversion: 2.1 time: 0.042473 Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 397/771] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:24 2022] POST /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833/action => generated 148 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:53:25.041000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.041902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:25.045182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.045673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.046110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.046814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.047425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.047852 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.183836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.193064 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.194626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.195986 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-309c1ba6-5d96-4b4c-b6fc-e8ac4a096f2a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.163143 Aug 24 01:53:25.196529 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 398/772] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:25 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:25.212572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6635cc35-82ca-4fac-bc3d-e685de3e39a4 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6635cc35-82ca-4fac-bc3d-e685de3e39a4 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Request method failure captured: Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action HTTP/1.1 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 39 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRcgHoBxPyMjOfl8H6Q0k57lsTWvoFZFiDeE46W1dnXlYnFcO2UCcXgTZXb_y54CbUpwbdPjfqNmgb0-nt4FaRkpPsCzNBqhZMra-4Kh_QhztewazKEfpO3Uw5BPWrrrADFcr2RnO7wEeUopVvjrQuZ3DNSFkqUNTj0caZQONKRFTQ Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:53:25.217156 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d0e25733354a4aa08ad17a3ec17b208e Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: {"os-resetState": {"state": "invalid"}} Aug 24 01:53:25.218740 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '905726bf-8418-4196-b2f2-a87b85f9d790', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.219571 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:53:25.220969 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 24 01:53:25.222132 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.222132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6635cc35-82ca-4fac-bc3d-e685de3e39a4 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:25.222132 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6635cc35-82ca-4fac-bc3d-e685de3e39a4 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action" status: 400 len: 144 microversion: 2.1 time: 0.012597 Aug 24 01:53:25.222132 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 399/773] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:25 2022] POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action => generated 144 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:53:25.228344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-61a1d36e-b786-42fb-bd89-be8f5f70d60a tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-61a1d36e-b786-42fb-bd89-be8f5f70d60a tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Request method failure captured: Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action HTTP/1.1 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 31 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRcgHoBxPyMjOfl8H6Q0k57lsTWvoFZFiDeE46W1dnXlYnFcO2UCcXgTZXb_y54CbUpwbdPjfqNmgb0-nt4FaRkpPsCzNBqhZMra-4Kh_QhztewazKEfpO3Uw5BPWrrrADFcr2RnO7wEeUopVvjrQuZ3DNSFkqUNTj0caZQONKRFTQ Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:53:25.233296 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d0e25733354a4aa08ad17a3ec17b208e Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: {"os-resetState": {"state": 1}} Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:53:25.234792 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '905726bf-8418-4196-b2f2-a87b85f9d790', 'body': {'os-resetState': {'state': 1}}} Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 1 Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:25.235617 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 24 01:53:25.237637 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.238939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-61a1d36e-b786-42fb-bd89-be8f5f70d60a tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:25.238939 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-61a1d36e-b786-42fb-bd89-be8f5f70d60a tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action" status: 400 len: 120 microversion: 2.1 time: 0.010610 Aug 24 01:53:25.238939 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 400/774] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:25 2022] POST /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790/action => generated 120 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:53:25.248425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:25.250807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Failed to fetch instance by id 999 {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:53:25.251508 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Request method failure captured: Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 37 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRcgHoBxPyMjOfl8H6Q0k57lsTWvoFZFiDeE46W1dnXlYnFcO2UCcXgTZXb_y54CbUpwbdPjfqNmgb0-nt4FaRkpPsCzNBqhZMra-4Kh_QhztewazKEfpO3Uw5BPWrrrADFcr2RnO7wEeUopVvjrQuZ3DNSFkqUNTj0caZQONKRFTQ Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:53:25.258777 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed1e4ad09d6f48c5841ef80ae357bda0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ed1e4ad09d6f48c5841ef80ae357bda0 Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-629882684 Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: d0e25733354a4aa08ad17a3ec17b208e Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-629882684-project-admin Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: {"os-resetState": {"state": "error"}} Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:53:25.260185 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 999 could not be found. Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:53:25.261220 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:25.262840 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6b82bd21-3a2f-43a8-acd9-d73dd13502b5 tempest-ServersAdminNegativeTestJSON-629882684 tempest-ServersAdminNegativeTestJSON-629882684-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.020295 Aug 24 01:53:25.267227 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 401/775] 10.222.0.49 () {60 vars in 1179 bytes} [Wed Aug 24 01:53:25 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 01:53:25.272199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.272659 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:25.279772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.280261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.280699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.281530 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.281990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.282412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.309400 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:53:25.368689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e26398bd-14f6-49e7-85ab-fc941e9f1fe4 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/cfe9abb7-e2b4-4690-956c-0846f11dd029" status: 202 len: 0 microversion: 2.1 time: 1.695781 Aug 24 01:53:25.370005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 375/776] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:53:23 2022] DELETE /compute/v2.1/os-floating-ips/cfe9abb7-e2b4-4690-956c-0846f11dd029 => generated 0 bytes in 1698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:53:25.383702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24f54c20-4031-4f51-8345-af0998abebf0 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] Calling method '.version_select at 0x7f6b9251e0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.397314 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2dcbdc19-c44d-4f64-a6ed-f650fb455812 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "DELETE /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 204 len: 0 microversion: 2.1 time: 0.128618 Aug 24 01:53:25.397985 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 402/777] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:53:25 2022] DELETE /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:53:25.406868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.407578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:25.413591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.414082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.414522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.415223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.415684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.416703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.550694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.558776 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3bd66456-f3fe-4e36-b7b5-44efb630d370 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1468 microversion: 2.1 time: 0.156562 Aug 24 01:53:25.559716 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 403/778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:25 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1468 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:25.564539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.565178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:25.571470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.572170 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.572612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.573337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.574534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.574959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.708008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.717612 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-23a3d0dd-67dc-4c64-9d1a-ced4220c9d5e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.157007 Aug 24 01:53:25.718343 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 404/779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:25 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:25.737399 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:25.738038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:25.744658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.745231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.745848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.746655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:25.747236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:25.747754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:25.880207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:25.888951 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6e81ab90-77e6-4c95-bbc5-16fddbed2b99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1474 microversion: 2.1 time: 0.155475 Aug 24 01:53:25.889636 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 405/780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:25 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1474 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:26.012215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:26.012840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:26.019130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.019628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.020057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.020776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.021231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.021652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.098555 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:26.116161 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-89fd8c69-4922-495c-a28b-43b725be6634 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.108277 Aug 24 01:53:26.116769 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 406/781] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:26 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:26.219485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:26.220764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:26.226876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.227580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.231459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.231459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.231459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.231459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.249513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:26.378729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:26.387522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:26.389092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:26.390836 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-67d60a58-2ca0-471b-b595-faa90666340f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.175483 Aug 24 01:53:26.391411 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 407/782] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:26 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:26.580517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:26.581333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:26.587955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.588470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.589139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.590168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.590930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.591638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.759315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:26.767480 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-db243872-93da-4107-a73e-c67aad94ac42 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1468 microversion: 2.1 time: 0.191725 Aug 24 01:53:26.768136 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 408/783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:26 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1468 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:26.775068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:26.775723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:26.782416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.782933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.783375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.784304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.784950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.785443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.926653 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24f54c20-4031-4f51-8345-af0998abebf0 tempest-FloatingIPDetailsTestJSON-725436967 tempest-FloatingIPDetailsTestJSON-725436967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/2e53da63-5851-42aa-8d93-27271e6abbe3" status: 202 len: 0 microversion: 2.1 time: 1.545773 Aug 24 01:53:26.929097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 376/784] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:53:25 2022] DELETE /compute/v2.1/os-floating-ips/2e53da63-5851-42aa-8d93-27271e6abbe3 => generated 0 bytes in 1549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:53:26.930448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:26.938508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:26.939322 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ad067b72-73a1-4fe9-af11-e079003af0b2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1311 microversion: 2.1 time: 0.169844 Aug 24 01:53:26.939903 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 409/785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:26 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:26.940580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:26.948425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.949117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.949808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:26.950729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:26.951304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:26.951793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.141982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:27.142825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:27.152551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.153096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.153657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.154378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.154837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.155263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.280653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:27.302484 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b8e29ed-8841-48cd-936c-3d8cb01e740f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.163957 Aug 24 01:53:27.303487 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 410/786] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:27 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:27.319116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:27.328639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6aac296b-2f5d-4414-9554-7313e7c2e253 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1474 microversion: 2.1 time: 0.397269 Aug 24 01:53:27.329254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 377/787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:26 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1474 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:27.413949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:27.414552 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:27.417199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:27.422392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.422872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.423359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.424048 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.424501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.424961 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.606265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:27.615982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:27.618257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:27.619511 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6a85f8c3-aab6-4caa-a9bf-742b4186dd6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.209834 Aug 24 01:53:27.620279 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 411/788] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:27 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:27.791519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:27.792224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:27.799258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.804935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.805499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.806725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.807310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.808571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.829726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:27.960732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:27.961346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:27.967562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.968107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.968651 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:27.969618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:27.970179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:27.970743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.127333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:28.135326 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f30af84d-b76a-44d4-a428-8e416dd8b014 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1494 microversion: 2.1 time: 0.179594 Aug 24 01:53:28.136835 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 412/789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:27 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1494 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:28.358265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:28.359133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:28.368369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.369177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.369773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.370689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.371314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.371733 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.513066 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b7e20ddd-8b5e-475a-b8e6-a349934402d9 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1645 microversion: 2.1 time: 0.358312 Aug 24 01:53:28.525630 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 413/790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:28 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1645 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:28.531398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:28.532006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:28.538275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.538776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.539209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.540267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.540762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.541201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.627128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:28.652795 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6b0c898e-535f-4e96-9230-79e7b9125523 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.124615 Aug 24 01:53:28.653801 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 414/791] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:28 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:28.658823 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:28.659488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:28.667209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.667997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.668626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.669557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.670198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.670789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.721986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:28.729979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19a7531f-83ac-4aef-a1e6-4905f5578510 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1468 microversion: 2.1 time: 0.942755 Aug 24 01:53:28.731114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 378/792] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:27 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1468 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:28.748535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:28.749560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:28.756609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.757640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.759238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.760199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.761923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.762629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.847332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:28.855476 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4ebd032e-c03c-4490-bb17-7d7209e43281 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1474 microversion: 2.1 time: 0.200615 Aug 24 01:53:28.864122 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 415/793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:28 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1474 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:28.864122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:28.864122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:28.868968 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.869579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.870160 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:28.871059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:28.871792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:28.872551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.015658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:29.024223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:29.026552 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:29.027704 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-18beea66-1cc0-470a-b51e-cfc1755d910d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.170246 Aug 24 01:53:29.030493 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 416/794] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:28 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:29.218131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44fe9b3f-3c39-48df-8234-0b80ba70780f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1645 microversion: 2.1 time: 0.485429 Aug 24 01:53:29.229348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 379/795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:28 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1645 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:29.246269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:29.249095 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:53:29.249095 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:53:29.250836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.251332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.251832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.252503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.252985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.253404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.279369 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-83789486-96b5-4adb-b69f-e23afd79b77b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042710 Aug 24 01:53:29.280291 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 417/796] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:53:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:29.293267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:29.296623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:29.303614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.304345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.305038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.306068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.306728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.307352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.342941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lazy-loading 'flavor' on Instance uuid e0e168b2-7e82-437b-864a-225d7b692ddb {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:29.356859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Going to try to live migrate instance to n-h2-854121-3 {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:53:29.678381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:29.678986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:29.686673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.687155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.687752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.688444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.689108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.689690 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.779437 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:29.813980 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-120fad23-3c51-482d-9b75-88d4dcc9cca6 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.137893 Aug 24 01:53:29.817237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 418/797] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:29 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:29.822946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:29.823848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:29.859107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.859677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.862964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:29.863949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:29.866415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:29.867748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:30.093417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:30.101901 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0c51094b-1869-49a8-a05b-72ffacdf5061 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1468 microversion: 2.1 time: 0.283341 Aug 24 01:53:30.104776 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 419/798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:29 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:30.107594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:30.108424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:30.114366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:30.114981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:30.115581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:30.116403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:30.117111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:30.117575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:30.324586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:30.333328 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2b4668c8-13f5-430f-b12b-e4717633fe10 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1471 microversion: 2.1 time: 0.229655 Aug 24 01:53:30.334339 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 420/799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:30 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:30.349689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "name": "network-vif-plugged", "status": "completed", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:30.360079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:30.360805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:30.361305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:30.377343 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Creating event network-vif-plugged:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h1-854121-3 Aug 24 01:53:30.383397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:53:30.396045 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-d5abcfa8-9ba1-4c23-9538-3a1f3f5fb4cb req-49a8c8c3-48e7-4dcb-9aa4-d2cbd0ff8a29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052358 Aug 24 01:53:30.397931 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 421/800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:30.406551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:30.407357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:30.414969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:30.415192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:30.416578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:30.417827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:30.418418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:30.419010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.086713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:31.096389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:31.103569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:31.107996 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-da16884e-cf1b-4efb-b4ba-5d5838a76f0c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.706603 Aug 24 01:53:31.108799 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 422/801] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:30 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:31.115689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:31.116395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:31.135713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.136396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.137756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.139237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.140012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.141068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.153084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57e160b1-5f61-45da-acef-aca969d14593 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb/action" status: 202 len: 0 microversion: 2.1 time: 1.863886 Aug 24 01:53:31.154795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 380/802] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:29 2022] POST /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb/action => generated 0 bytes in 1866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:53:31.163346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:31.168528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:31.195800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.197958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.198635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.200857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.204198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.205850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.274089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:31.335105 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5a57eed3-f231-4ec8-b9bc-7cc75b0728b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57/action" status: 204 len: 0 microversion: 2.1 time: 0.224897 Aug 24 01:53:31.337958 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 423/803] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:53:31 2022] POST /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:53:31.353188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:31.354306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:31.369966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.370200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.371029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.371597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.372068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.376398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.535356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:31.572319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd571f00-5029-4b12-9c33-708a46dedd43 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.416106 Aug 24 01:53:31.573118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 381/804] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:31 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:31.600996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:31.602364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:31.612693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.613621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.614616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.615560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.616741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.617506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.656992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:31.668063 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c4789f01-8035-4742-ae9f-c8f80a6e0008 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1468 microversion: 2.1 time: 0.327314 Aug 24 01:53:31.669857 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 424/805] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:31 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:31.681697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:31.682515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:31.699875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.701948 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.702621 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:31.704321 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:31.705972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:31.706636 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.077388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:32.090603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b02d9ba6-e25c-4415-a0a6-9184d0ad7fa7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.507955 Aug 24 01:53:32.104680 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 382/806] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:31 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:32.111202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73aaac40-399b-4309-991a-ae8eecfe7833", "name": "network-vif-deleted", "tag": "fbad97c9-2715-4462-a1d7-c03a2248ab46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:32.122478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.122954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.123548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.138567 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] Creating event network-vif-deleted:fbad97c9-2715-4462-a1d7-c03a2248ab46 for instance 73aaac40-399b-4309-991a-ae8eecfe7833 on n-h1-854121-3 Aug 24 01:53:32.145151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4508f8df-eb38-4f11-97aa-f4c25c0d0b48 req-dd06f76c-4462-4f94-8447-15f4257999b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039210 Aug 24 01:53:32.145803 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 383/807] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:32.150942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:32.151600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:32.158764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.160028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.160795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.161830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.162483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.163017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.431692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:32.443874 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-677b4a18-8512-4162-90ab-1f65bd3a277e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1471 microversion: 2.1 time: 0.772934 Aug 24 01:53:32.458785 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 425/808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:31 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1471 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:32.581896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "name": "network-vif-plugged", "status": "completed", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:32.601920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.602629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.605760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.653797 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] Creating event network-vif-plugged:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h2-854121-3 Aug 24 01:53:32.661166 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-298d0fc4-479b-4ed6-8c3a-5c24d3919986 req-563d5914-7395-452d-82bd-1635ad418f10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082865 Aug 24 01:53:32.662906 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 426/809] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:32.685043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:32.687688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:32.697635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.701956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.702623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.703581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.704228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.704929 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.921336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:32.930198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:32.931710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:32.933423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca1af2c7-3205-4b4d-8f1b-190e965c2eed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.785979 Aug 24 01:53:32.934303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 384/810] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:32 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:32.939289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:32.946029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:32.958516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.966024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.966685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:32.967759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:32.968583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:32.969225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.048939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.049425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.052527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.053242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lazy-loading 'fault' on Instance uuid 73aaac40-399b-4309-991a-ae8eecfe7833 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:33.165306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:33.206866 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7049dd71-d7c0-435c-a0fc-1c96072447d2 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.542501 Aug 24 01:53:33.220759 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 427/811] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:32 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:33.220759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:33.220759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:33.230068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.230669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.231276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.232049 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.232571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.233141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.261749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:33.271136 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63720bd7-eefd-4e9a-84a4-42ebe412d2fc tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 200 len: 1312 microversion: 2.1 time: 0.334777 Aug 24 01:53:33.272155 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 385/812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:32 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 1312 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:33.471247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:33.473194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:33.496555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.497475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.498148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.499244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.499886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.501733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.725049 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:33.746695 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c34b2666-7263-4624-ae3a-898eb2f2bdc4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.530981 Aug 24 01:53:33.762532 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 428/813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:33 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:33.802151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:33.819773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ca07d46-f912-4632-ab6a-387ef47cf91b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1471 microversion: 2.1 time: 0.355788 Aug 24 01:53:33.834662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 386/814] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:33 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:33.965626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:33.966734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:33.979500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.981658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.983720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:33.985365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:33.987909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:33.989337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.179049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e168b2-7e82-437b-864a-225d7b692ddb", "name": "network-vif-unplugged", "status": "completed", "tag": "931114a1-6b6b-4881-b4e0-c622ffab2d99"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:34.189244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.189731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.190160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.203733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] Creating event network-vif-unplugged:931114a1-6b6b-4881-b4e0-c622ffab2d99 for instance e0e168b2-7e82-437b-864a-225d7b692ddb on n-h1-854121-3 Aug 24 01:53:34.208790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9c71a7cc-1934-4e7e-b898-d04092dbea05 req-75073ee6-4064-4ebe-93d7-b8338e972150 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033341 Aug 24 01:53:34.209659 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 387/815] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:34.239756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.239756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.260907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.261698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.262696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.263961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.264658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.265165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.303623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:34.313255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:34.320547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:34.322510 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3a6075b8-9266-4538-b672-d4d89a77c9a8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.362718 Aug 24 01:53:34.323083 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 429/816] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:33 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:34.327994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.328829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 73aaac40-399b-4309-991a-ae8eecfe7833] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.335716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.336402 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.337195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.338077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.338538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.339505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.354321 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] HTTP exception thrown: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Request method failure captured: Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 HTTP/1.1 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRa09w-yQa8xPmHjCOUYkwdM7KXDMmF9jv3hFiTF8pSSwE9ChyW-zSQrjetkhl19FHWNGUsm079wWugmAAUgYQ4V2DmVL45rT3etNQBCi2Q-yVHJQxAed-ZFI1EU_VMO9QVXll0LxpdTevstE2ouVpqnNyU1Gi91d8mIKTHCEPpXHk Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 7c47edb9fb8f4e42836583685ee94de6 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:53:34.357073 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 7c47edb9fb8f4e42836583685ee94de6 Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminNegativeTestJSON-945034409-project Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 785f8e0c4f1c4cb5ab1a1163e40ce4b7 Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminNegativeTestJSON-945034409-project Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. Aug 24 01:53:34.358744 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '73aaac40-399b-4309-991a-ae8eecfe7833'} Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:34.359694 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. Aug 24 01:53:34.361254 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:53:34.362757 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Returning 404 to user: Instance 73aaac40-399b-4309-991a-ae8eecfe7833 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:34.362757 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fcc05fb6-ede3-45d1-b58c-4f36485f5cb6 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833" status: 404 len: 111 microversion: 2.1 time: 0.034254 Aug 24 01:53:34.362757 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 430/817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:34 2022] GET /compute/v2.1/servers/73aaac40-399b-4309-991a-ae8eecfe7833 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:53:34.368095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.368789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.398468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.399228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.400571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.404060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.404705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.405858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:34.406460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.455354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c55cb05-d2a5-4f64-a8e8-8e85f639e762 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.223607 Aug 24 01:53:34.456639 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 388/818] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:34 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:34.469024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:53:34.628569 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-42330468-6fbc-4a98-b5b3-d3a6fe42c08b tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "DELETE /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 204 len: 0 microversion: 2.1 time: 0.264567 Aug 24 01:53:34.629496 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 431/819] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:53:34 2022] DELETE /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:53:34.638813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.639432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.658226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.658782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.659237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.660136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.663773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.664418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.770038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.770965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.781972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.782737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.783398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.784483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.785217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.785750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.928100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:34.938867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ac68e60-e2ca-4243-8874-f5dc9860b180 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1476 microversion: 2.1 time: 0.304029 Aug 24 01:53:34.940853 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 389/820] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:34 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:34.949334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:34.950351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:34.972470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.973238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.973678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:34.974502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:34.974842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:34.975307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.145328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:35.155837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76234fb1-216e-42bc-b5a7-0014917d79af tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1471 microversion: 2.1 time: 0.213098 Aug 24 01:53:35.156414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 390/821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:34 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:35.344739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:35.345380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:35.352833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.353729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.355082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.364270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.365901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.368152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.388545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:35.405429 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9744c9b5-dd0a-40fa-8223-4981be1c3e39 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.640733 Aug 24 01:53:35.406380 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 432/822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:34 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:35.481648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:35.482078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:35.488207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.488699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.489159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.489870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.490320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.503864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.567812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:35.584010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:35.587043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:35.588904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1719b40-9129-495d-94a6-28bec4353ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1409 microversion: 2.25 time: 0.248249 Aug 24 01:53:35.608507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 391/823] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:35 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:35.651783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:35.673178 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-aa9370fb-d11b-4d3f-9c4d-4cf35e55b417 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.196190 Aug 24 01:53:35.674639 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 433/824] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:35 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:35.693146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8679bee-e49b-4c14-b9be-b87d2d496da5 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Action: 'create', calling method: .version_select at 0x7f6b9254e310>, body: {"keypair": {"name": "tempest-keypair-750823846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS44UOfKWO/MwXlSVkdhcTEw0UrAR4NmqSEjYZ9GCwmZcJwYDdIOVbcLZzrYPH5qvOiMCMmqJ/utctV7zyu5PwJVpPjJ8XWgrppxrRQrU+4OMMoRkVgKY0ysvl7/VcGQQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:35.728080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e8679bee-e49b-4c14-b9be-b87d2d496da5 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Getting quotas for project 3ac3b385f0f64ccf8be65447dddbaff6. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:35.732264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e8679bee-e49b-4c14-b9be-b87d2d496da5 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Getting quotas for user a9e28715348a48f5a2da996059f8d8dd and project 3ac3b385f0f64ccf8be65447dddbaff6. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:35.760643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8679bee-e49b-4c14-b9be-b87d2d496da5 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.144879 Aug 24 01:53:35.762144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 392/825] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:53:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:35.976523 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:35.978597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:35.990921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.991756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.992408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:35.994002 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:35.996244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:35.997492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.177504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:36.178121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:36.189421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.190324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.190777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.191825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.192707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.193345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.217494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:36.226137 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a78e239b-2748-42d0-8298-c697ae5adb7d tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1476 microversion: 2.1 time: 0.260338 Aug 24 01:53:36.226632 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 434/826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:35 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:36.267346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e168b2-7e82-437b-864a-225d7b692ddb", "tag": "931114a1-6b6b-4881-b4e0-c622ffab2d99"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:36.279629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.280476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.281019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.295705 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] Creating event network-changed:931114a1-6b6b-4881-b4e0-c622ffab2d99 for instance e0e168b2-7e82-437b-864a-225d7b692ddb on n-h1-854121-3 Aug 24 01:53:36.303561 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-58c5c7eb-7bf0-460f-8d51-0877d321a345 req-a337084a-5893-4cb8-ab71-48ad2944fc72 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043874 Aug 24 01:53:36.304941 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 435/827] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:36.440756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:36.442614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:36.447266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:36.452855 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.453551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.454057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.454972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.455652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.456162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.459706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45484ca6-67c8-43f1-80cf-0dd9e33f2a8e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1471 microversion: 2.1 time: 0.286309 Aug 24 01:53:36.473946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 393/828] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:36 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:36.615123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:36.616343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:36.627056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.628315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.630727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.633720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.634730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.635357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.699551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:36.866271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:36.875533 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2c23b1b4-cda4-4c7f-8bef-95ae77d96eae tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.449647 Aug 24 01:53:36.892953 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 436/829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:36 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:36.913135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:36.918488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:36.937297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.937692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.938139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:36.938870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:36.939326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:36.939754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.063058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:37.073647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:37.084260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:37.085803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:37.088242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa369e92-8253-49a1-83bc-3b805ba8f383 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1606 microversion: 2.25 time: 0.477437 Aug 24 01:53:37.094613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 394/830] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:36 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1606 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:37.112382 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c9f0092d-81d2-4211-a928-8d3ef4f1bf30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.217243 Aug 24 01:53:37.116123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:37.116627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:37.126401 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 437/831] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:36 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:37.128213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.129138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.131665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.132455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.134010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.135885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.247364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:37.248257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:37.257313 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.257735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.262180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.263128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.263762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.264370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.595891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:37.599755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:37.613513 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d2aea9b8-cdb1-459b-a62b-be7611723786 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1476 microversion: 2.1 time: 0.369927 Aug 24 01:53:37.617198 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 438/832] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:37 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:37.637122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:37.640875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:37.655355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.656061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.664937 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.666454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.667513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.668194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.862612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-862900f8-4e01-490c-bf79-3dc770ac0e42 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.750816 Aug 24 01:53:37.874699 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 395/833] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 01:53:37 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-interface => generated 285 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:53:37.904671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:37.908758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:37.914920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:37.923897 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-58172b0d-fa2f-4a65-83ec-0498498e971a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1463 microversion: 2.1 time: 0.305359 Aug 24 01:53:37.925146 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 439/834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:37 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1463 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:37.929269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.929988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.930804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.931752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.932753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.933552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.947158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:37.948764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:37.955477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.956153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.957298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:37.959318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:37.959950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:37.960556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.302809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:38.320857 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-347e356b-43ae-4ddd-a2bd-be88548bda63 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1463 microversion: 2.1 time: 0.378929 Aug 24 01:53:38.322884 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 440/835] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:37 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1463 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:38.346873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:38.347515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:38.355721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:38.356265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:38.356709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.357500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:38.357956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:38.362885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.487854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:38.497384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5765efd3-224d-4814-ad46-d3653db62ef1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.598505 Aug 24 01:53:38.498804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 396/836] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:37 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:38.506134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48d438b7-803c-4cfa-a5b6-5e9815b986b5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'create', calling method: .version_select at 0x7f6b9254e1f0>, body: {"keypair": {"name": "tempest-keypair-774357451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVXbFSHk+KyWSOjOmQaq98DslEhX4i4P0xjafYet6VkYVn0TionNWeUbzV5N+BU5W7M8h5OqibAppGhx2GrDOM+YR8rngeLHC9WuvR+YC8dt4bjhV0ZfIjBHsF6XVCCvQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:38.533328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-48d438b7-803c-4cfa-a5b6-5e9815b986b5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:38.536596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:38.542578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-48d438b7-803c-4cfa-a5b6-5e9815b986b5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:38.576490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48d438b7-803c-4cfa-a5b6-5e9815b986b5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.076084 Aug 24 01:53:38.580811 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-01f63ecf-61cf-4184-a430-c711ec403fab tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.254898 Aug 24 01:53:38.583635 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 441/837] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:38 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:38.591059 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 397/838] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:53:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:38.637459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:38.638085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:38.648312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:38.648828 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:38.649272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.649985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:38.650441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:38.650870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.815807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785f8e0c4f1c4cb5ab1a1163e40ce4b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c47edb9fb8f4e42836583685ee94de6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:38.817892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905726bf-8418-4196-b2f2-a87b85f9d790", "name": "network-vif-deleted", "tag": "097f97f7-0082-460f-b4a0-b870aa1aa2c2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:38.836575 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6410ad67-dff5-4ecb-8406-17d419999eb2 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 200 len: 1434 microversion: 2.1 time: 0.199682 Aug 24 01:53:38.837734 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 442/839] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:38 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 1434 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:38.862412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:38.871913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:38.872404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:38.893224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] Creating event network-vif-deleted:097f97f7-0082-460f-b4a0-b870aa1aa2c2 for instance 905726bf-8418-4196-b2f2-a87b85f9d790 on n-h2-854121-3 Aug 24 01:53:38.898970 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fb3931a8-7b15-4522-af02-15aac5e8c0cb req-c4c14dc5-041d-41b1-9178-047cc96b5879 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093577 Aug 24 01:53:38.900450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 398/840] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:39.047985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "93c78f63-e2da-477f-becb-2c2e700d3a1d"}], "security_groups": [{"name": "tempest-securitygroup--1878632290"}], "key_name": "tempest-keypair-750823846", "user_data": "}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:39.259517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:39.315392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] validate_networks() for [('93c78f63-e2da-477f-becb-2c2e700d3a1d', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:39.521186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:39.521955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:39.535886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.536404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.536877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:39.537724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.538176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.538816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:39.806941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:39.807377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:39.807889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:39.808696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:39.809154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:39.826231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.829026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.829685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:39.831587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.832069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.832505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:39.888783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Getting quotas for project 3ac3b385f0f64ccf8be65447dddbaff6. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:39.899368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Getting quotas for user a9e28715348a48f5a2da996059f8d8dd and project 3ac3b385f0f64ccf8be65447dddbaff6. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:39.913495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:39.915894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:39.938096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:39.963670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:39.972545 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64cdb9b0-c039-4a11-8d52-f97bf4bb1e84 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.928940 Aug 24 01:53:39.973989 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 443/841] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:53:39.980271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:39.981508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:39.989513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.991158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.991810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:39.992753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:39.994151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:39.994816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:40.007407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0545adb3-87f4-4d14-bb90-60a995be84f7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.487985 Aug 24 01:53:40.027736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 399/842] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:39 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:40.036651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:40.037765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] [instance: 905726bf-8418-4196-b2f2-a87b85f9d790] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:40.056549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:40.058511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:40.072781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:40.079632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:40.080323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:40.081258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:40.118738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:40.120487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] HTTP exception thrown: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Request method failure captured: Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 HTTP/1.1 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYRa09w-yQa8xPmHjCOUYkwdM7KXDMmF9jv3hFiTF8pSSwE9ChyW-zSQrjetkhl19FHWNGUsm079wWugmAAUgYQ4V2DmVL45rT3etNQBCi2Q-yVHJQxAed-ZFI1EU_VMO9QVXll0LxpdTevstE2ouVpqnNyU1Gi91d8mIKTHCEPpXHk Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7c47edb9fb8f4e42836583685ee94de6 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:53:40.122219 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7c47edb9fb8f4e42836583685ee94de6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7c47edb9fb8f4e42836583685ee94de6 Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-945034409 Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAdminNegativeTestJSON-945034409-project Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 785f8e0c4f1c4cb5ab1a1163e40ce4b7 Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-945034409-project Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. Aug 24 01:53:40.123770 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '905726bf-8418-4196-b2f2-a87b85f9d790'} Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:53:40.124771 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. Aug 24 01:53:40.126268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:53:40.127509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] Returning 404 to user: Instance 905726bf-8418-4196-b2f2-a87b85f9d790 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:53:40.127509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffaa1356-15d0-4c81-91d9-8ccf9d4bda00 tempest-ServersAdminNegativeTestJSON-945034409 tempest-ServersAdminNegativeTestJSON-945034409-project] 10.222.0.49 "GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790" status: 404 len: 111 microversion: 2.1 time: 0.094512 Aug 24 01:53:40.127509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 400/843] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:40 2022] GET /compute/v2.1/servers/905726bf-8418-4196-b2f2-a87b85f9d790 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:53:40.140019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97303e03-3846-48cb-bd55-441c9a78a802 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:40.140557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97303e03-3846-48cb-bd55-441c9a78a802 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:40.150886 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5c609f75-4ada-458e-91a4-b5b50a384ba4 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.174423 Aug 24 01:53:40.166032 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 444/844] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:39 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:40.325064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97303e03-3846-48cb-bd55-441c9a78a802 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:40.335604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97303e03-3846-48cb-bd55-441c9a78a802 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1225 microversion: 2.1 time: 0.200918 Aug 24 01:53:40.356862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 401/845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:40 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1225 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:41.035442 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:41.037580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:41.039336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:41.052028 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.052774 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.053183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.053889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.054338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.055024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.058717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.059211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.059647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.080764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] Creating event network-changed:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h2-854121-3 Aug 24 01:53:41.090005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-07285698-101a-44c2-8f6f-2a2500decce3 req-18d9750b-72cf-4676-9bc3-0afcd08d2153 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054636 Aug 24 01:53:41.091147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 402/846] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:41.180754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:41.181359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:41.189096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.189581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.191386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.196456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.198899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.199728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.373386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:41.393933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba6e09a7-c5dd-49c0-bf19-b096c215f0ae tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.218099 Aug 24 01:53:41.394820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 403/847] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:41 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:41.401227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:41.402620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:41.420364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.421220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.421916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.422190 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:41.425227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:41.425848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:41.428461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:41.433846 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-66af752d-e5ba-408f-847e-9036e5f2db8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.403041 Aug 24 01:53:41.450632 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 445/848] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:41 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:41.615859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:41.628349 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1aa3fed4-d7ec-49d5-9ac4-68ee3820f630 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1277 microversion: 2.1 time: 0.232291 Aug 24 01:53:41.629256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 404/849] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:41 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:42.421412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.422035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:42.459162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.460553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:42.478823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.479409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.479861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.483871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.484560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.486926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.487910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.488531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.491420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.492178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.492650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.496441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.619419 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:42.653015 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-89e2f0a6-d19b-4df2-9833-f259e8cc916c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.235952 Aug 24 01:53:42.663749 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 446/850] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:42.673110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bfc38e47-28ad-42bb-83f1-a686e9d95771 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '.version_select at 0x7f6b923ba820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.677995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bfc38e47-28ad-42bb-83f1-a686e9d95771 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.678677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bfc38e47-28ad-42bb-83f1-a686e9d95771 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.679421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bfc38e47-28ad-42bb-83f1-a686e9d95771 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.691234 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bfc38e47-28ad-42bb-83f1-a686e9d95771 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.023182 Aug 24 01:53:42.692023 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 447/851] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:42.706562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.707803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:42.716957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.720955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.721736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.723312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:42.724240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:42.725225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:42.809987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:42.818937 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fe261978-e8aa-4013-848c-7fd606e0080c tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1283 microversion: 2.1 time: 0.125699 Aug 24 01:53:42.819514 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 448/852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1283 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:42.824799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-74ce7104-2eb1-406f-8a3a-fb64ad95fcfe tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.831691 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-74ce7104-2eb1-406f-8a3a-fb64ad95fcfe tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010797 Aug 24 01:53:42.832444 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 449/853] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:42.846978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7c25e2a4-b4e8-427a-89f6-1f654818d6eb tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-387902498", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:42.850360 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:53:42.850360 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:53:42.881012 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7c25e2a4-b4e8-427a-89f6-1f654818d6eb tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.037536 Aug 24 01:53:42.891658 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 450/854] 10.222.0.49 () {60 vars in 1146 bytes} [Wed Aug 24 01:53:42 2022] POST /compute/v2.1/flavors => generated 498 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:42.898301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9c84e237-1552-41c8-ab9b-f44e0fe9d2b4 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:42.915676 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9c84e237-1552-41c8-ab9b-f44e0fe9d2b4 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022704 Aug 24 01:53:42.927466 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 451/855] 10.222.0.49 () {58 vars in 1182 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:53:43.087813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-680205027", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:43.158678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] validate_networks() for None {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:43.489205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:43.489919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:43.490500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:43.491684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:43.492217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:43.504384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:43.515045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f39ece68-1899-43e1-b981-2cc038bce171 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 1.061309 Aug 24 01:53:43.517420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 405/856] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:42 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:43.521509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.523042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.524491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.527744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.528061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.528743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.552954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:43.558769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:43.572402 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:43.576771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:43.662132 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a4e98120-e129-4447-9f26-3a628ab92ea4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581103 Aug 24 01:53:43.664320 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 452/857] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:53:43.693359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b4494698-ea18-4989-9c7b-8259c27552d2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:43.694522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b4494698-ea18-4989-9c7b-8259c27552d2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:43.805780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b4494698-ea18-4989-9c7b-8259c27552d2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:43.817996 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b4494698-ea18-4989-9c7b-8259c27552d2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1278 microversion: 2.1 time: 0.136158 Aug 24 01:53:43.818593 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 453/858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:43 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:43.832542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:43.833503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:43.842224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.843313 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.843584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.844707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.845926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.846725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.876205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6948733c-1cce-44db-8855-b5cdbe7818fe tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:43.884897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6948733c-1cce-44db-8855-b5cdbe7818fe tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.266250 Aug 24 01:53:43.886031 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 406/859] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:43.897736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:43.898612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:43.908345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.909572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.910228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.911182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:43.911857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:43.913283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:43.959977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:43.999836 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5337cdc1-a0ab-425f-8db4-5323fbe3ad8f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.174183 Aug 24 01:53:44.000924 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 454/860] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:43 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:44.006558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5883d24-014e-47fa-9853-eb2724b22619 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.039689 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d5883d24-014e-47fa-9853-eb2724b22619 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3388 microversion: 2.1 time: 0.037263 Aug 24 01:53:44.045213 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 455/861] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors => generated 3388 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.059684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e6cfd65-e142-42da-86f1-1126d2c5bbfe tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.072435 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9e6cfd65-e142-42da-86f1-1126d2c5bbfe tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020501 Aug 24 01:53:44.073111 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 456/862] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:44.085864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4fd9faae-34d9-464f-b30e-b3860e4a412b tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.096742 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4fd9faae-34d9-464f-b30e-b3860e4a412b tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014620 Aug 24 01:53:44.097651 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 457/863] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.109269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-39ddb12c-5ebc-4154-bbcd-8326849f420c tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.147100 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-39ddb12c-5ebc-4154-bbcd-8326849f420c tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.041240 Aug 24 01:53:44.148245 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 458/864] 10.222.0.49 () {58 vars in 1165 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:44.164837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c64f10b0-c41f-42d3-b1e6-5e01696941fc tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.174500 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c64f10b0-c41f-42d3-b1e6-5e01696941fc tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013291 Aug 24 01:53:44.177906 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 459/865] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:44.189346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-416e5550-7f0b-48c0-aec7-ff64b94aac14 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.199639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:44.212189 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fe8c094-93b4-4693-acfb-e1ac62c71142 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1283 microversion: 2.1 time: 0.324775 Aug 24 01:53:44.213408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 407/866] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:43 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1283 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.225386 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-416e5550-7f0b-48c0-aec7-ff64b94aac14 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.041438 Aug 24 01:53:44.237655 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 460/867] 10.222.0.49 () {58 vars in 1169 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.244175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36b7a9af-c08b-41a5-a903-3d4f5394ff66 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.260471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36b7a9af-c08b-41a5-a903-3d4f5394ff66 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.022279 Aug 24 01:53:44.261784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 408/868] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.274747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9f20afe9-4400-45f2-84c8-2a288dde24a3 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.284414 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9f20afe9-4400-45f2-84c8-2a288dde24a3 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013359 Aug 24 01:53:44.285245 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 461/869] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.298443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b1303a8-3437-4590-8fa1-35f645009e93 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.329959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:44.344095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b1303a8-3437-4590-8fa1-35f645009e93 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 3393 microversion: 2.1 time: 0.048170 Aug 24 01:53:44.345292 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 409/870] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 3393 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.362745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8d328d4-696b-4592-9d07-e29e3b5d5e46 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.372375 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a8d328d4-696b-4592-9d07-e29e3b5d5e46 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013893 Aug 24 01:53:44.376763 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 462/871] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:44.384862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca362e19-2e09-41e0-8b16-c3646529ce4a tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.422719 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca362e19-2e09-41e0-8b16-c3646529ce4a tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.041761 Aug 24 01:53:44.423816 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 410/872] 10.222.0.49 () {58 vars in 1144 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.438313 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-585d08ba-e489-4259-a9e7-a77656213629 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.448783 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-585d08ba-e489-4259-a9e7-a77656213629 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014318 Aug 24 01:53:44.449746 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 463/873] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.464514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c744372-1043-4254-ade5-8855dc7f33b6 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.491941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c744372-1043-4254-ade5-8855dc7f33b6 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.033505 Aug 24 01:53:44.492532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 411/874] 10.222.0.49 () {58 vars in 1148 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.508487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bec947fb-32ef-4e66-bb2a-caa51d8a8461 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.522970 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bec947fb-32ef-4e66-bb2a-caa51d8a8461 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018827 Aug 24 01:53:44.523947 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 464/875] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:44.538078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.538692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:44.539478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3e62d2d-70f3-4af5-9cb3-4a160c2036bb tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.545827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:44.546525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:44.546864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:44.547574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:44.548029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:44.548485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:44.553274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3e62d2d-70f3-4af5-9cb3-4a160c2036bb tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019398 Aug 24 01:53:44.560787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 412/876] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.572543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb737d03-9f52-4861-9b4a-6f8a8af6f850 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.607874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb737d03-9f52-4861-9b4a-6f8a8af6f850 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1851 microversion: 2.1 time: 0.043129 Aug 24 01:53:44.613560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 413/877] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors?marker=452 => generated 1851 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:44.627221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17030b77-322e-4891-a763-d64ad3227152 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.657864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17030b77-322e-4891-a763-d64ad3227152 tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6298 microversion: 2.1 time: 0.036681 Aug 24 01:53:44.659960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 414/878] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/detail => generated 6298 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:44.684564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e8cabbb-d0d0-469d-a7a7-14440f0d9a8b tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.696091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e8cabbb-d0d0-469d-a7a7-14440f0d9a8b tempest-FlavorsV2TestJSON-1899170685 tempest-FlavorsV2TestJSON-1899170685-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017288 Aug 24 01:53:44.704853 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 415/879] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:44.716433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:44.724903 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-66038d71-5a41-494c-9137-eedfb42a4a5f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.190764 Aug 24 01:53:44.725470 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 465/880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:44.840016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:44.840741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:44.851560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:44.852365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:44.853887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:44.855503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:44.855969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:44.856394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:44.977257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:44.989770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d22900f-1e9b-426c-bb46-a2b3a2d035ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1330 microversion: 2.1 time: 0.154248 Aug 24 01:53:44.990549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 416/881] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:44 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:45.037040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:45.038123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:45.045447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.045949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.046388 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.047125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.047755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.048349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.127133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:45.151940 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-43bfaa1a-50bf-4b8f-8239-48e7d84ecd30 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.121009 Aug 24 01:53:45.152836 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 466/882] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:45 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:45.247296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:45.247904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:45.256396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.256988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.257494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.258381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.258854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.259422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.421276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:45.432704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71537eaa-0ebf-43d9-950f-604ae913a2b3 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1283 microversion: 2.1 time: 0.191684 Aug 24 01:53:45.449541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 417/883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:45 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:45.757004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:45.757901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:45.770512 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.771083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.771852 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.772781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:45.773710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:45.774420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:45.929457 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:45.943771 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-da4c32b0-d325-4db3-b36f-005597d0396c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1504 microversion: 2.1 time: 0.200094 Aug 24 01:53:45.945225 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 467/884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:45 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:46.011524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:46.012206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:46.024529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.025144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.025797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.026543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.027012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.027443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.177902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:46.179098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:46.186865 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.187689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.188290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.189373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.190170 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.190845 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.306115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:46.317720 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a1be9ea-56bb-422d-8796-0db13e57777c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1336 microversion: 2.1 time: 0.309081 Aug 24 01:53:46.333282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 418/885] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:46 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1336 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:46.372268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:46.406179 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-983494b5-164c-42bf-8f7f-e7c87680dde5 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.232004 Aug 24 01:53:46.407394 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 468/886] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:46 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:46.453947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:46.454863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:46.461656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.466049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.466696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.467584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.468047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.468476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.809467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:46.822362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2947a67-165a-480c-84e1-46320e23db71 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.372236 Aug 24 01:53:46.825182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 419/887] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:46 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:46.966083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:46.966704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:46.979984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.980760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.984123 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:46.985218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:46.985910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:46.988168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.026749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:47.340779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:47.341989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:47.350117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.350843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.351540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.352869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.353641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.354914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.355812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:47.365335 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f090039c-f873-498f-a2b1-486f0d4761c5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1494 microversion: 2.1 time: 0.403747 Aug 24 01:53:47.381465 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 469/888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:46 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1494 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:47.389503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7c7d0ceb-d7cd-452e-8d8f-25e30e801116 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '.version_select at 0x7f6b9275c310>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:47.393681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c7d0ceb-d7cd-452e-8d8f-25e30e801116 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.394292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c7d0ceb-d7cd-452e-8d8f-25e30e801116 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.395517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7c7d0ceb-d7cd-452e-8d8f-25e30e801116 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.407063 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7c7d0ceb-d7cd-452e-8d8f-25e30e801116 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 1952 microversion: 2.1 time: 0.023583 Aug 24 01:53:47.417251 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 470/889] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:53:47 2022] GET /compute/v2.1/os-migrations => generated 1952 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:47.422612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:47.423478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:47.436472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.437678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.438394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.439361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.440040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.440685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.781220 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f5ce4826-a0a3-425a-910f-2b12f1a015ae tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1645 microversion: 2.1 time: 0.362397 Aug 24 01:53:47.783020 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 471/890] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:47 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1645 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:47.801684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:47.804387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:47.818179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.818934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.823664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:47.825545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:47.827142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:47.828230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:48.134700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:48.158954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:48.167238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7ab523c-a39d-4289-b3b7-a17f4a855b5a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.830921 Aug 24 01:53:48.167833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 420/891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:47 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:48.174165 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f64575a9-2ab1-47e6-bfcb-339fa8cad7a9 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.387090 Aug 24 01:53:48.175077 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 472/892] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:47 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:48.179342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:48.179969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:48.183930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1605915497", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8d282946-c6d2-446c-a4ca-e9e99e5e112e"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:48.204379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:48.204966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:48.205412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:48.206123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:48.213522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:48.214401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:48.352170 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] validate_networks() for [('8d282946-c6d2-446c-a4ca-e9e99e5e112e', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:49.069612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:49.070304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:49.071168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:49.071737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:49.075746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:49.087759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.089161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.089793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.090769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.091628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.092229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.118685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:49.124807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for user 0aa9308751b9454b8d173b034f4b040b and project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:49.142155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:49.164405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:49.186967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:49.217050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d228bc7-f314-458c-9673-cd30439856b4 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 1.041703 Aug 24 01:53:49.219300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 421/893] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:48 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:49.245939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=93 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:49.255044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:49.259600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:49.285388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.305992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.306633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.312989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.315517 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3e408847-45a2-4152-a4ec-692c1b8c3593 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137578 Aug 24 01:53:49.316181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.318286 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 473/894] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:53:49.327754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.330223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:49.332944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:49.354777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.355318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.355762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.356844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.359203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.359902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.599591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:49.640188 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2cfdb3f6-d354-4991-acf7-18cf712ad41c tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.320575 Aug 24 01:53:49.641392 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 474/895] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:49 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:49.655431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-03220cb8-00c2-4d61-a206-44c43aae007a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:49.656053 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-03220cb8-00c2-4d61-a206-44c43aae007a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:49.755376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-03220cb8-00c2-4d61-a206-44c43aae007a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:49.765524 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-03220cb8-00c2-4d61-a206-44c43aae007a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1211 microversion: 2.1 time: 0.122404 Aug 24 01:53:49.785658 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 475/896] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:49 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:49.802393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57827b5a-cbb0-4082-b36a-3a20d96e9f08", "tag": "87f4334a-4de3-48af-82ce-d74469da7ebd"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:49.831307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:49.831914 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:49.832921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:49.854140 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] Creating event network-changed:87f4334a-4de3-48af-82ce-d74469da7ebd for instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 on n-h1-854121-3 Aug 24 01:53:49.861244 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-f9fc7614-ff7d-4b57-a57b-153daff635b6 req-4ccd117f-b798-4dd9-ad24-212921af857b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073508 Aug 24 01:53:49.862287 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 476/897] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:49.866400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:49.874932 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-076d7c78-faea-422e-b0bf-95858fb33cbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.652854 Aug 24 01:53:49.875549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 422/898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:49 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:50.179595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1715200017", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "69483d81-db99-45e0-a482-097df32fb3f1"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:50.249708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:50.251269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:50.282321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:50.284386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:50.285078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:50.288757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:50.291384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:50.292847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:50.328668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] validate_networks() for [('69483d81-db99-45e0-a482-097df32fb3f1', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:50.355969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:51.184462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:51.219294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe123663-a1b2-451d-9cd6-a58dde707f27 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.981536 Aug 24 01:53:51.222133 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 423/899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:50 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:51.248084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:51.248745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:51.262157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.263396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.264029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.265828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.266730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.267502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.272356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:51.403336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:51.468810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae760e8f-2f23-4dd6-9c34-c6b1e7825f70 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.244747 Aug 24 01:53:51.470330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 424/900] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:51 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:51.479654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:51.480276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:51.501875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.502371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.502807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.506466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.506960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.507394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.588136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:51.596601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f423935d-b1bb-4304-bd34-fe2852d790c7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1263 microversion: 2.1 time: 0.125164 Aug 24 01:53:51.597225 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 425/901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:51 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1263 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:51.602379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:51.609054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:51.629628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.630898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.633396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.634760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.636266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.637013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.766131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:51.767378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:51.768046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:51.768611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:51.774770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:51.785002 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.785889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.786545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.787557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.788237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.788902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.808581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Getting quotas for project 081bc199caa3448fba0f8cb055db21b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:51.813369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Getting quotas for user 426849d588194cfcb5d3592370ef0ce2 and project 081bc199caa3448fba0f8cb055db21b7. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:51.828191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:51.833417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:51.834249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:51.847401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b146486f-9464-4098-a83a-0f5ae358e0f4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.248899 Aug 24 01:53:51.848539 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 426/902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:51 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:51.887914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:51.891556 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-50d0ddbf-f320-41d7-ab26-aa38fba7a5eb tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.994022 Aug 24 01:53:51.892564 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 477/903] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 01:53:51.907043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ba440865-7327-4aad-8f4c-82a63c0aec3e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:51.907925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ba440865-7327-4aad-8f4c-82a63c0aec3e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:51.908367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:51.909137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:51.909670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:51.943150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] Creating event network-changed:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:53:51.949673 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-50dd94dd-43ba-4c1d-acb7-388b735f5602 req-77ed4182-2d08-4a0c-9acd-a93425a2d1ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066284 Aug 24 01:53:51.951029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 427/904] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:52.006939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ba440865-7327-4aad-8f4c-82a63c0aec3e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:52.013980 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ba440865-7327-4aad-8f4c-82a63c0aec3e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1216 microversion: 2.1 time: 0.112023 Aug 24 01:53:52.024295 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 478/905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:51 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:52.244402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:52.245144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:52.260710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.261257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.261704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.262428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.262967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.263300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.495514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:52.496494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:52.509279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.509882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.510257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:52.512139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.513014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.515928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.517160 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.519480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a39b7da0-0f21-4c9a-9c7f-c196121976c9 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.279652 Aug 24 01:53:52.520081 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 428/906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:52 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:52.621320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:52.624401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:52.631058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.631543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.632232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.633108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.633824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.634313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.664649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:52.694626 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-354cc201-cf51-49c2-bb77-2bff14be3f6f tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1929 microversion: 2.75 time: 0.203568 Aug 24 01:53:52.696375 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 479/907] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:52 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:52.729998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:52.741873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-daf80d30-4540-463b-aec6-888b23884c02 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1263 microversion: 2.1 time: 0.126537 Aug 24 01:53:52.742833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 429/908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:52 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1263 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:52.869965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:52.871218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:52.886270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.887011 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.887520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:52.888460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:52.889158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:52.889786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.036193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:53.036756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:53.048454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.049039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.049491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.050200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.050658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.051087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.214240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:53.224040 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4aee17dc-c893-423e-993b-694ecc26c517 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.358185 Aug 24 01:53:53.238042 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 480/909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:52 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:53.302466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:53.314560 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa7c3ef5-ed6e-432d-abc3-81f8dca2c39c tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1220 microversion: 2.1 time: 0.283178 Aug 24 01:53:53.315645 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 430/910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:53 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1220 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:53.546497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:53.547221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:53.562451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.563253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.563939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.564952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.565626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.566298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.721194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:53.722085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:53.723058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:53.733048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.733892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.734550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.735823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.736387 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-583dedc0-0f0d-4d09-b2c7-24f4aa3d07cc tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.193726 Aug 24 01:53:53.736590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.737347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.738083 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 481/911] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:53 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:53.766199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:53.767467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:53.778550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.779840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.781413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.782866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:53.783518 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:53.784283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:53.897894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:53.927568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:53.940691 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-247fcc3e-0592-400d-8057-e4b6a5894647 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1263 microversion: 2.1 time: 0.181053 Aug 24 01:53:53.941771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c15f8cf-8a3c-4687-bc4c-ef4d65ed8687 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1935 microversion: 2.75 time: 0.224524 Aug 24 01:53:53.942677 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 431/912] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:53 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1935 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:53.945376 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 482/913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:53 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:54.246266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:54.247029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:54.257794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.259762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.261776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.262691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.263148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.263574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.335429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:54.336031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:54.343288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.343775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.344205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.345161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.345619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.346039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.408824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:54.418778 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d2d323e8-6345-452c-9d6c-8df8bb630151 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1268 microversion: 2.1 time: 0.087183 Aug 24 01:53:54.420073 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 483/914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:54 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1268 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:54.664417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:54.673137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cd7d868-7b15-427f-8098-6ff0eab048c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.430749 Aug 24 01:53:54.673840 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 432/915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:54 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:54.762519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:54.763133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:54.769942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.770521 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.771017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.772551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:54.773155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:54.773679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:54.941672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:54.950847 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cdc576f6-4a43-4106-b0a3-945d6b690dc1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.192320 Aug 24 01:53:54.952013 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 484/916] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:54 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:54.984875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:54.985123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:54.987206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:54.987766 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:55.004254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.004639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.005298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.005896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.007122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.007377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.008188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.009105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.009639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.010555 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.011229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.012244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.177840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:55.205006 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-71941381-71a1-4dc8-b21d-2bd22a16a289 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1935 microversion: 2.75 time: 0.227592 Aug 24 01:53:55.206462 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 485/917] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:54 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1935 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:53:55.441839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:55.443093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:55.451752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.452022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.453273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.454450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.454959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.455791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.526016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:55.539708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89fe3929-c35d-476e-8418-369e07a0cf03 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1269 microversion: 2.1 time: 0.568232 Aug 24 01:53:55.540399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 433/918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:54 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1269 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:55.559569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:55.567737 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-50d3269f-67b9-4da8-89ce-51349f3800f3 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1274 microversion: 2.1 time: 0.131081 Aug 24 01:53:55.568564 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 486/919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:55 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:55.698191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:55.698860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:55.710601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.712396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.714045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.717762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.718457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.719132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.972704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:55.973475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:55.987679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.988250 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.990289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:55.993608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:55.996443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:55.996933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.307730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:56.317370 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b6b09fb0-8077-4520-a5eb-ccdf9a3ae278 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.349313 Aug 24 01:53:56.325454 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 487/920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:55 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:56.333878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:56.334832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:56.352029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.354213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.355946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.359800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.360731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.361258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.370370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:56.383776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30fcfe3f-deb1-4bff-a694-491ec08490db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.690237 Aug 24 01:53:56.394235 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 434/921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:55 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:56.501699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:56.526919 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64e66ddc-28da-4e33-a9c5-b4fbbd3f5752 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1935 microversion: 2.75 time: 0.199754 Aug 24 01:53:56.527646 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 488/922] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:56 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1935 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:56.561110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:56.561727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:56.569405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.574087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.574662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.575512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.576504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.577211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.593574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:56.594414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:56.604865 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.605671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.606259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.611376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:56.612283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:56.612911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:56.624125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:53:56.973800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:56.988891 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f39007cf-508e-44b4-a47d-36bd5163bb42 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.398956 Aug 24 01:53:56.989488 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 489/923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:56 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:57.046003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:57.059573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e17d74de-20b2-4d4f-bf49-75d53d2b96a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.502849 Aug 24 01:53:57.068532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 435/924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:56 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:57.343988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:57.345151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:57.347027 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba61e05b-73fa-4841-816b-e23175a037ce", "tag": "ba71c7e1-a6dd-47ee-b7b5-35006f1260ae"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:57.357995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.358699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.360153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.366001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.366479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.366911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.391189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.391684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.392122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.408705 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] Creating event network-changed:ba71c7e1-a6dd-47ee-b7b5-35006f1260ae for instance ba61e05b-73fa-4841-816b-e23175a037ce on n-h1-854121-3 Aug 24 01:53:57.423881 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-1a37a19d-fee3-41c4-9f06-c2573e223ed7 req-dfa7cadc-0add-4bb9-9197-7b2655893a18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085044 Aug 24 01:53:57.428194 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 490/925] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:57.437071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:57.438301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:57.453510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.456210 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.457633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.462467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.465581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.466177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.714875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:57.722850 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5a815752-9207-481f-aef6-95c2ac73ae00 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.293037 Aug 24 01:53:57.724028 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 491/926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:57 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:57.730060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:57.730836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:57.737646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.738134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.738587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.739466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:57.740174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:57.740659 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:57.827023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:57.863683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-245dcd18-fcd0-4178-9981-b032db23f787 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.526390 Aug 24 01:53:57.864278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 436/927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:57 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:57.877349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:57.906821 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5fe2b513-9291-43bf-b397-e57643b38303 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1935 microversion: 2.75 time: 0.181577 Aug 24 01:53:57.912767 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 492/928] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:57 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1935 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:58.009296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:58.010848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:58.024884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.026327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.026988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.027971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.028643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.029314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.091089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:58.091723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:58.099762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.100274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.100737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.101595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.102060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.102491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.301804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:58.311004 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ae1793dd-5bb7-467b-9491-e604078b4714 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.226338 Aug 24 01:53:58.312344 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 493/929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:58 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:58.387228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57827b5a-cbb0-4082-b36a-3a20d96e9f08", "name": "network-vif-plugged", "status": "completed", "tag": "87f4334a-4de3-48af-82ce-d74469da7ebd"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:58.398680 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.399246 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.399762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.412805 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] Creating event network-vif-plugged:87f4334a-4de3-48af-82ce-d74469da7ebd for instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 on n-h1-854121-3 Aug 24 01:53:58.418839 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-461872c3-a25d-41c9-afec-b927316eafd3 req-5fd730d5-b3c2-4ab5-8b33-09fd0c5d6b8a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 Aug 24 01:53:58.419449 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 494/930] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:53:58.747434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:58.748149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:58.754285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.754766 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.755199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.756159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.756583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.757224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.807791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:58.816564 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-daf063c2-12d7-4578-8cd6-30d327bbd6e9 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.810997 Aug 24 01:53:58.818078 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 437/931] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:58 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:58.888478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:58.901942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:58.909720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.913870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:58.921852 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-22bfb09a-32d7-4ae5-945f-668faf295570 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.178761 Aug 24 01:53:58.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.933407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.934213 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 495/932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:58 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:58.945842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:58.946704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:58.955942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.956995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.957770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:58.959734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:58.960454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:58.961151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.088631 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:53:59.124584 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-58dfc75e-b294-4944-adf4-08dcb4f3e710 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1935 microversion: 2.75 time: 0.189080 Aug 24 01:53:59.126256 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 496/933] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:53:58 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1935 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:53:59.131275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4cb52e0-25a2-4770-80c2-be3f0f9dcb51", "tag": "75fbdc04-f6fa-4246-9bd0-5a9066a115cb"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:59.135780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:59.143844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.144551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.145036 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.153610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e75e2193-84ec-4d7e-a45e-4997504e3d2a tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.271595 Aug 24 01:53:59.155944 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] Creating event network-changed:75fbdc04-f6fa-4246-9bd0-5a9066a115cb for instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 on n-h1-854121-3 Aug 24 01:53:59.156907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 438/934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:58 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:53:59.162365 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-b05890d1-1d04-4155-8343-0a6ecf4082b0 req-18d62a01-3f32-488c-a9e0-1bc7df9edf7c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Aug 24 01:53:59.167161 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 497/935] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:53:59.277783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-567158818", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "ea5724f0-2e92-4683-9895-186daec66f98"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:53:59.334489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:59.335215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:59.343011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] validate_networks() for [('ea5724f0-2e92-4683-9895-186daec66f98', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:53:59.352960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.354486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.354935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.356451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.358724 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.359205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.524330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:53:59.532613 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a824538d-5ae6-4cf3-935d-46d5f57478f2 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.203140 Aug 24 01:53:59.533468 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 498/936] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:59 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:53:59.807852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:53:59.808328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:53:59.808825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:53:59.809235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:53:59.809672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:53:59.818525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.819239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.819680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.820677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.821163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.821595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.839663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:59.840290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:59.851283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.851783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.852406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.854484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.854957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.855392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.861238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Getting quotas for project 286485480bbf4d1a8615d338e1adfbed. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:53:59.866084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Getting quotas for user af4a3fc16bc34fb19f1621d4b065b8de and project 286485480bbf4d1a8615d338e1adfbed. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:53:59.890409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:53:59.897785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:53:59.969245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70acacfa-7303-4a09-aeec-8bb0787c621b tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778888 Aug 24 01:53:59.970156 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 439/937] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:53:59.975389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:53:59.976328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:53:59.984614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.985451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.986049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:53:59.986917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:53:59.987662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:53:59.989661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.046112 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.062612 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-35f415df-d122-4d6b-9982-b4b09225cf6d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.227181 Aug 24 01:54:00.070496 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 499/938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:59 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:00.086313 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7f6b02f2-aa01-447c-b031-071c3838cb13 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.088589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7f6b02f2-aa01-447c-b031-071c3838cb13 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.194315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7f6b02f2-aa01-447c-b031-071c3838cb13 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.206128 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7f6b02f2-aa01-447c-b031-071c3838cb13 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1223 microversion: 2.1 time: 0.133087 Aug 24 01:54:00.207403 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 500/939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:00 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:00.215101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.216705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.236953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.240673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.242005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.243015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.244987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.245614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.249186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.267805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59378a26-51ef-4071-be44-c9838e7740d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.296180 Aug 24 01:54:00.268680 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 440/940] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:53:59 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:00.281198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.281198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.307404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.307901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.308335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.312655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.313451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.314115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.333090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] Lazy-loading 'services' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:54:00.348304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:00.354450 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f6c4ce30-0d4e-434e-b8d7-a337e14e8822 tempest-ServersAdmin275Test-1775857502 tempest-ServersAdmin275Test-1775857502-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1920 microversion: 2.75 time: 0.145924 Aug 24 01:54:00.355327 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 501/941] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:00 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1920 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:54:00.397427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.397965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.405688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.406236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.406720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.407418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.407907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.408274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.434978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:54:00.555040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.565036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a26cbe27-1202-4a04-94ee-771579bd4d91 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.295177 Aug 24 01:54:00.581240 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-299ae514-d662-41d3-8707-1464dc2d83fa tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 204 len: 0 microversion: 2.75 time: 0.187307 Aug 24 01:54:00.581476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 441/942] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:00 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:00.585560 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 502/943] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:54:00 2022] DELETE /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:54:00.591813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.592688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.593472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-plugged", "status": "completed", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:00.596528 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:00.600693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.601497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.602037 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.602997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.603710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.604374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.621643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.622128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.622560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.639759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] Creating event network-vif-plugged:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:54:00.644688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c9a55a4d-6756-4041-8ece-0c717f679f45 req-91796a8d-7d3f-49ca-80ce-09e581f38156 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061762 Aug 24 01:54:00.645840 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 442/944] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:00.651700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:00.653107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:00.668332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.669107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.669697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.670596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:00.671207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:00.671784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:00.833882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.849580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.853969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.860802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7515042b-1f41-42f8-a89f-b8761691b010 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1444 microversion: 2.75 time: 0.213606 Aug 24 01:54:00.861489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:00.872045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 443/945] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:00 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1444 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:54:00.875019 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec04cfda-973f-4dc0-ae1e-486bf923407e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.287136 Aug 24 01:54:00.876795 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 503/946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:00 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:01.087274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.089043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.101531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.102911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.104379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.105697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.106240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.106886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.227792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.228473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.238946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.241302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.241935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.243595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.245661 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.246688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.598168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:01.607237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc5b3694-9e91-4e1d-adb8-ab5664b7591d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.525156 Aug 24 01:54:01.608335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 444/947] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:01.620988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.620988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.620988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.620988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.621402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.622007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.622692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.623187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.682633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:01.691562 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8e66266f-1180-4cd4-83f6-47eb88884d40 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1219 microversion: 2.1 time: 0.468025 Aug 24 01:54:01.692146 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 504/948] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1219 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:01.699677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.701154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.710003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.710736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.711367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.712079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.712536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.713930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.785897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:01.795258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9f45a8d-cc88-41e2-9ea2-26585566746d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.185463 Aug 24 01:54:01.796111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 445/949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:01.799318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:01.864472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:01.872179 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e6f9ba38-8588-4b25-bd93-3deabab7a7ad tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.178813 Aug 24 01:54:01.872784 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 505/950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:01.891675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.892278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.897599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:01.898369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:01.898748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.899242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.899670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.900961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.901598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.902053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.906115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.906442 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.906964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.907671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:01.908126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:01.908584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:01.913248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:02.008365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.018762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.020252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.026273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac955ef6-77f7-4550-93a8-72f92e374bef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1444 microversion: 2.75 time: 0.138445 Aug 24 01:54:02.027252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 446/951] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1444 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:54:02.320186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.328544 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c85f897f-ae90-42e9-8fae-b75b93357b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.434767 Aug 24 01:54:02.329205 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 506/952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:01 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:02.629745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:02.630518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:02.639527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.640088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.640577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.641339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.641805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.642239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.713921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:02.714535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:02.722141 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.723204 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.724230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.725445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.725906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.726332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.793322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.801309 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9cb92ab6-8581-4b01-a248-20be914c8335 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1275 microversion: 2.1 time: 0.091789 Aug 24 01:54:02.801876 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 507/953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:02 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:02.818362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:02.819102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:02.825761 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.826259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.826684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.827387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.828129 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.828263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.878694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.887300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11b4169c-65db-426d-9b29-3895a3d5b1c2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.261606 Aug 24 01:54:02.900740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 447/954] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:02 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:02.901392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:02.902542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:02.906097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:02.910468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.911106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.911674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.912496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:02.913188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:02.913725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:02.972041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:02.981160 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5f0cd52d-e5fc-411d-954b-27b0f1e53bbd tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.166397 Aug 24 01:54:02.984766 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 508/955] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:02 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:03.050883 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:03.052199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:03.062274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.063034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.063684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.064790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.065990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.066770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.086577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.104574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0dfbc1e-d18f-4456-98a2-66b8258b77f0 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1351 microversion: 2.1 time: 0.211297 Aug 24 01:54:03.105424 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 448/956] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:02 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:03.180321 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.188812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.190624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.196695 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f8597ce0-3068-4e6f-a75b-38315a95b3ef tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1444 microversion: 2.75 time: 0.149925 Aug 24 01:54:03.198020 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 509/957] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:03 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:54:03.349707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:03.350459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:03.357005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.357570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.358074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.358840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.359361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.359848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.505113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.513810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc73e622-65e9-4f70-b5d8-d8c849439a48 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.167864 Aug 24 01:54:03.514625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 449/958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:03 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:03.824175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:03.824832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:03.831580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.832056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.832484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.833195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.833649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.834066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.894908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:03.902501 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1f8a4014-4fc2-4157-bcf8-abebc676f439 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1275 microversion: 2.1 time: 0.083063 Aug 24 01:54:03.903315 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 510/959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:03 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:03.909696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:03.910296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:03.917433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.917912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.918348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:03.919025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:03.919479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:03.919898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.003243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.005253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.014063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.014453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.014896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.015752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.016361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.016934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.053075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.061441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25b0faad-198d-44fd-bfe4-031309ca58a2 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.155610 Aug 24 01:54:04.062018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 450/960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:03 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:04.126692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.127429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.134495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.135058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.135496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.137647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.138518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.139025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.156223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.165570 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-56cbaccc-ac61-4996-a7de-5c015f76d8c4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1378 microversion: 2.1 time: 0.166312 Aug 24 01:54:04.167055 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 511/961] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:03 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1378 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:04.224853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.225566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.242277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.242983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.243759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.245159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.245622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.246047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.277734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.286223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.286721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.287164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.287616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lazy-loading 'fault' on Instance uuid a9d091c5-fb81-49e1-8431-68cd23805a52 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:54:04.291799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff6fc3b5-8768-49ad-8c61-0c18fa7c0c61 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1542 microversion: 2.1 time: 0.167332 Aug 24 01:54:04.293407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 451/962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:04 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1542 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:04.314156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.314647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.321973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.323033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.323807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.325524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.326241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.326923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.343179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.359725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.361330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dec73c7ebbae4c44becb11c4b4f73b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f10fa11758f45f4834c17042e7fae27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.367686 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-762ee4c3-af8e-41b1-a417-36aae4a33310 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 200 len: 1449 microversion: 2.75 time: 0.146799 Aug 24 01:54:04.381446 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 512/963] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:04 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:54:04.504087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-634ae8d6-dbf8-40bf-8afa-935ae8e58392 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.193883 Aug 24 01:54:04.504689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 452/964] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 01:54:04 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:04.533841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.534455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.541966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.542458 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.542896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.543603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.544060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.544481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.564866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61e05b-73fa-4841-816b-e23175a037ce", "name": "network-vif-plugged", "status": "completed", "tag": "ba71c7e1-a6dd-47ee-b7b5-35006f1260ae"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:04.578107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.578895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.580050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.613467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] Creating event network-vif-plugged:ba71c7e1-a6dd-47ee-b7b5-35006f1260ae for instance ba61e05b-73fa-4841-816b-e23175a037ce on n-h1-854121-3 Aug 24 01:54:04.620034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8ed9979d-d658-4eb1-9443-2adab6e0ab13 req-cf343c4f-6ebe-428c-aa69-1013164080cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061259 Aug 24 01:54:04.621928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 453/965] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:04.696541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:04.704833 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8dc4a051-65d8-446d-b528-8cd3d8da73bc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.174838 Aug 24 01:54:04.705405 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 513/966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:04 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:04.923002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:04.923840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:04.930728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.931448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.931976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:04.933004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:04.933558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:04.934100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.037797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:05.045985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c22ccc0-39ad-40cf-8f06-4793668a1509 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1281 microversion: 2.1 time: 0.127281 Aug 24 01:54:05.046551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 454/967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:04 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1281 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:05.082995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:05.083614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:05.090679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.091178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.091650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.092351 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.092844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.093277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.185873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:05.186736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:05.193031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.193913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.194509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.195610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.196063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.196589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.241094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:05.250526 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a5a53200-8b80-4d17-a40a-0abd86002d4e tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.171468 Aug 24 01:54:05.251112 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 514/968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:05 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:05.393910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:05.394628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] [instance: a9d091c5-fb81-49e1-8431-68cd23805a52] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:05.400866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.401363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.401797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.402551 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.403004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.403421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.418411 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] HTTP exception thrown: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Request method failure captured: Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 HTTP/1.1 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYRhGulTbql1KhB-lNv28zBqSIfZr899MR1-HXJ23jH8dHMo4ti8jxvzifeL3DfgIH2RrovpanXgAzaoCuaCgxkp5hGRatajBmODOEt3JXR0L2LWIcMO3VUlcfQ6ttuoeHuR_T5vMDTjLriQ_ZIUz5-eQzT2N4YnxWz4Em9dVQt-dYg Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Openstack-Nova-Api-Version: 2.75 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 8f10fa11758f45f4834c17042e7fae27 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdmin275Test-765778784 Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:05.420070 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8f10fa11758f45f4834c17042e7fae27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f10fa11758f45f4834c17042e7fae27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8f10fa11758f45f4834c17042e7fae27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8f10fa11758f45f4834c17042e7fae27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdmin275Test-765778784 Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 8f10fa11758f45f4834c17042e7fae27 Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdmin275Test-765778784 Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdmin275Test-765778784-project Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: dec73c7ebbae4c44becb11c4b4f73b73 Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdmin275Test-765778784-project Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. Aug 24 01:54:05.421882 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'a9d091c5-fb81-49e1-8431-68cd23805a52'} Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:05.422672 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. Aug 24 01:54:05.423950 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:05.425503 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] Returning 404 to user: Instance a9d091c5-fb81-49e1-8431-68cd23805a52 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:05.425503 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e52c2249-c983-499c-b537-0b69ebe36367 tempest-ServersAdmin275Test-765778784 tempest-ServersAdmin275Test-765778784-project] 10.222.0.49 "GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52" status: 404 len: 111 microversion: 2.75 time: 0.031647 Aug 24 01:54:05.425503 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 515/969] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:54:05 2022] GET /compute/v2.1/servers/a9d091c5-fb81-49e1-8431-68cd23805a52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 01:54:05.728159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:05.729822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:05.736365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.736818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.737444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.738147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.738603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.739025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.781727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:05.793462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8080de8-2e54-4479-b2c6-867f58785127 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1528 microversion: 2.1 time: 0.611808 Aug 24 01:54:05.796766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 455/970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:05 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1528 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:05.814335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:05.815028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:05.821918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.822420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.822944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.823832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:05.824501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:05.825108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:05.947630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:05.964912 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c8dc35a6-3744-4917-8a83-bf2940b7f06d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.241938 Aug 24 01:54:05.965746 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 516/971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:05 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:06.069652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.071532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:06.093350 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.094131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.094813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.095624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.096660 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.097332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.132788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:06.142719 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-948c0ae0-f308-417a-b282-b36eddf0e21d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1528 microversion: 2.1 time: 0.332552 Aug 24 01:54:06.143856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 456/972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:05 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1528 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:06.169827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32e39e28-406c-43d3-ae19-6e2912461ad6 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.171155 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:54:06.171155 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:54:06.189412 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32e39e28-406c-43d3-ae19-6e2912461ad6 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a" status: 202 len: 0 microversion: 2.1 time: 0.026917 Aug 24 01:54:06.191051 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 457/973] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:06 2022] DELETE /compute/v2.1/flavors/f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:06.198603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:06.209029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9df41f4e-2352-4583-88bb-989db0fd5449 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.220947 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-857155f4-f68a-4fa7-a970-f3b9abdaae6d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1281 microversion: 2.1 time: 0.157099 Aug 24 01:54:06.236525 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 517/974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:06 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1281 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:06.246797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9df41f4e-2352-4583-88bb-989db0fd5449 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5810 microversion: 2.1 time: 0.051162 Aug 24 01:54:06.248287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 458/975] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:54:06 2022] GET /compute/v2.1/flavors/detail => generated 5810 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:06.267676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:06.270118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:06.273042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.274774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:06.278545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.279239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.279862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.280929 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.281571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.282199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.287965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.288737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.289496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.290504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.291527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.293191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.315140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:06.324059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Old instance type tempest-test_resize_flavor_-387902498, new instance type m1.heat {{(pid=128566) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 01:54:06.336323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:06.336839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:06.337379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:06.338478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:06.338957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:06.444558 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d12686e2-5568-4ea8-94bc-61562fca73eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d/action" status: 202 len: 0 microversion: 2.1 time: 0.181404 Aug 24 01:54:06.450819 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 518/976] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:06 2022] POST /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:06.458691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57827b5a-cbb0-4082-b36a-3a20d96e9f08", "tag": "87f4334a-4de3-48af-82ce-d74469da7ebd"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:06.484206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.484704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.487741 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.514572 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] Creating event network-changed:87f4334a-4de3-48af-82ce-d74469da7ebd for instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 on n-h1-854121-3 Aug 24 01:54:06.521547 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-978fd640-d75b-4334-890b-23e7a7603cf1 req-51bf4457-f840-4daa-bd69-2d3481aa59c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069106 Aug 24 01:54:06.522710 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 519/977] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:06.537491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.541054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:06.553934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.554731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.555374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.556272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:06.557893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:06.558342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:06.692248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:06.702902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05e88fae-acf2-4e05-9665-0c91950b2a7d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.435380 Aug 24 01:54:06.716507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 459/978] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:06 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:06.828535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:06.838859 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5fe12f48-3c10-4fc9-b458-a8c950b0b857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1537 microversion: 2.1 time: 0.305668 Aug 24 01:54:06.840016 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 520/979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:06 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:06.985832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:06.986747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:06.998073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.000927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.001446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.002216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.002684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.003133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.243681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:07.245164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:07.256847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.259799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.261549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.262294 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.262775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.263206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.526629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:07.532805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:07.538703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4375fd73-dcac-4f9e-9dbc-eebb1e85ac12 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.556913 Aug 24 01:54:07.540778 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9924ea58-94f0-4f56-8016-51d9f7b825f8 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.303227 Aug 24 01:54:07.541913 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 521/980] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:07 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:07.542347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 460/981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:06 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:07.735720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:07.736972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:07.746346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.746963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.747626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.748427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.749261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.749935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.776236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:07.860331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:07.860654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:07.870056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.870558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.870994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.872934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:07.875824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:07.877499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:07.942696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:07.952808 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-80b48727-f590-4277-b539-93764505fcfe tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1316 microversion: 2.1 time: 0.230308 Aug 24 01:54:07.953813 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 522/982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:07 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:08.212013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:08.216056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:08.221941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b6b5836-d1b9-4d10-b8b7-1fbd32f701eb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1537 microversion: 2.1 time: 0.365798 Aug 24 01:54:08.232552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 461/983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:07 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1537 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:08.546077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:08.559715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.560598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.561199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.567664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:08.581846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:08.594321 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] Creating event network-changed:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:08.598298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.599100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.600647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.601611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.602253 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-eed75bb1-4d9b-4c94-8acc-d3c115442440 req-bc738e6b-9d69-47d1-92a4-a6f09cf6dd18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062943 Aug 24 01:54:08.603039 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 523/984] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:08.604269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.604728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.611136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:08.612550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:08.619494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.620127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.620700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.621436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.622679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.623107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.780583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:08.783963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:08.789207 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28813cdf-8e1e-42da-b652-107c9ec2574a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.225893 Aug 24 01:54:08.792585 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cf84e49f-4d0c-45fb-a169-1f3ec466a869 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.187036 Aug 24 01:54:08.793250 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 524/985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:08 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:08.796602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 462/986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:08 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:08.798951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:08.799630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:08.805959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.806496 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.806934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.807636 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.808100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.808526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.833413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:54:08.911302 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f7cf6e8d-fddd-4c6b-9d3d-6016d6cfde7b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 204 len: 0 microversion: 2.1 time: 0.116568 Aug 24 01:54:08.921756 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 525/987] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:08 2022] DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:54:08.974252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:08.974850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:08.981776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.983396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.983838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:08.984782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:08.985397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:08.985988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.022713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1237864321", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "2042875863", "adminPass": "***", "networks": [{"uuid": "2453c4d7-ff64-4c70-a628-425538e69002"}], "security_groups": [{"name": "tempest-securitygroup--1734501880"}], "key_name": "tempest-keypair-929206611", "user_data": "}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:09.139568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:09.147759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa865d8e-1eea-4f6c-a4b5-e6d350e0c08f tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1504 microversion: 2.1 time: 0.177246 Aug 24 01:54:09.156747 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 463/988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:08 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:09.177521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:09.178720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:09.191028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.192072 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] validate_networks() for [('2453c4d7-ff64-4c70-a628-425538e69002', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:09.192433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.193680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.194605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.195633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.197930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.235498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:54:09.313216 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fd59907-8220-4aaa-8857-f595d3a31990 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 204 len: 0 microversion: 2.1 time: 0.141241 Aug 24 01:54:09.316812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 464/989] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:09 2022] DELETE /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 01:54:09.437993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-218349116", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:09.489216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:09.581943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:09.582411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:09.582843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:09.583259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:09.583671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:09.589970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=33 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:09.594443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.594946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.595380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.596307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.596794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.597227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.614876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for project 4f2880aeff3141ca85e2148b1473f471. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:09.619409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Getting quotas for user 09c8b150bd864992a5eba1af41e760ae and project 4f2880aeff3141ca85e2148b1473f471. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:09.630932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:09.633532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:09.678781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:09.679270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:09.679694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:09.680103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:09.680509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:09.684570 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-804dd18f-08a5-478a-92ac-210c586a4a2b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666527 Aug 24 01:54:09.685608 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 526/990] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 01:54:09.690179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.690661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.691094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.691819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.692274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.692697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.695376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:09.695982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:09.703584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.704070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.704502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.705281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.705733 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.706153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.726421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:09.731946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for user 00d5425074f540b8be6a17014a1eec40 and project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:09.744503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:09.747126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:09.794254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fa3aa09-9572-46ee-ba90-f4b04089edc0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476158 Aug 24 01:54:09.795460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 465/991] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:09.800894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:09.801575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:09.811212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.811803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.812452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.813242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:09.813845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:09.816893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:09.896511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:09.911213 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-502e1b8c-959f-4552-a5c3-e7dfa2d08fe8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1537 microversion: 2.1 time: 0.224572 Aug 24 01:54:09.913942 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 527/992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:09 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:09.919041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ead3a874-9831-44d6-905e-c6953160711e tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:09.919650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ead3a874-9831-44d6-905e-c6953160711e tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:10.004329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:10.007005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ead3a874-9831-44d6-905e-c6953160711e tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:10.014354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fd1dbee-0bb9-47b8-9614-0571f1979754 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1510 microversion: 2.1 time: 0.217791 Aug 24 01:54:10.015466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 466/993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:09 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:10.020103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:10.020731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:10.026768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.027342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.027843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.028617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.029178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.029671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.045732 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ead3a874-9831-44d6-905e-c6953160711e tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1264 microversion: 2.1 time: 0.130696 Aug 24 01:54:10.046332 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 528/994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:09 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1264 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:10.057656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:10.058365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:10.069464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.070846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.071982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.073087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.073748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.074389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.190544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:10.202346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d98f3855-61bd-4cff-b2c2-aa8a127483c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.185485 Aug 24 01:54:10.204046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 467/995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:10 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:10.210138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-951561636", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:10.245576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:10.258812 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1e7d2aea-3c53-4b05-b5de-b911922fd994 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.211394 Aug 24 01:54:10.260558 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 529/996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:10 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:10.278074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:10.472408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:10.472852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:10.473341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:10.473761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:10.474177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:10.483247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.483725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.484157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.484907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.485360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.485783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.502828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:10.506551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for user 00d5425074f540b8be6a17014a1eec40 and project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:10.517504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:10.519623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:10.545210 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cb52e0-25a2-4770-80c2-be3f0f9dcb51", "name": "network-vif-plugged", "status": "completed", "tag": "75fbdc04-f6fa-4246-9bd0-5a9066a115cb"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:10.557122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.557703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.558221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.565941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d507b79-c057-4632-b915-882fcb115832 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.360124 Aug 24 01:54:10.572904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 468/997] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:10.573049 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] Creating event network-vif-plugged:75fbdc04-f6fa-4246-9bd0-5a9066a115cb for instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 on n-h1-854121-3 Aug 24 01:54:10.575362 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-fb29bf78-a4f0-4f65-ba47-e6cabb769a59 req-e20ac26e-c7f5-4dea-ba29-3b9c0ba530cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034894 Aug 24 01:54:10.576403 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 530/998] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:10.579069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82489698-ddb0-4261-9ed5-c4109aac9130 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:10.579677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82489698-ddb0-4261-9ed5-c4109aac9130 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:10.635869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82489698-ddb0-4261-9ed5-c4109aac9130 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:10.643038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82489698-ddb0-4261-9ed5-c4109aac9130 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1213 microversion: 2.1 time: 0.068319 Aug 24 01:54:10.643595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 469/999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:10 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:10.934055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:10.935515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:10.961287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.966220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.966946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:10.969307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:10.970131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:10.971572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.038985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:11.038985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:11.057205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.058368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.059199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.065135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.067517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.068863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.185508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.193637 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1f1d42c4-c72e-472e-b510-e3536c94d4c1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1537 microversion: 2.1 time: 0.264612 Aug 24 01:54:11.194205 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 531/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:10 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:11.199566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:11.200173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:11.206055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.206535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.206959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.207957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.208412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.208870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.248123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.255870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a41f1595-30b9-4225-a511-30c4e8b05c0a tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1510 microversion: 2.1 time: 0.224551 Aug 24 01:54:11.264788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 470/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:11 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:11.264788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:11.264788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:11.267597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.268092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.268513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.269277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.269746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.270206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.271156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.280589 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-931437fe-a125-48ee-b636-7628646fd4a1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1260 microversion: 2.1 time: 0.084644 Aug 24 01:54:11.281195 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 532/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:11 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1260 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:11.285886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:11.286487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:11.293245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.293904 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.294497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.295363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.296150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.296665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.475173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.486739 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3c286153-ceb1-4b14-8f2a-75d650a3d8fe tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.204268 Aug 24 01:54:11.487610 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 533/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:11 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:11.513926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.527114 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1ea1cb4-9651-4d4c-9ae7-91f92903d378 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.269153 Aug 24 01:54:11.528611 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 471/1004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:11 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:11.664571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:11.665835 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:11.682143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.683008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.689217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.691414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:11.692483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:11.695702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:11.862763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:11.871315 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-28add6d2-581d-4d57-9efb-0aa0f1f8eb69 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1209 microversion: 2.1 time: 0.211037 Aug 24 01:54:11.871891 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 534/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:11 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1209 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:12.216277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:12.217038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:12.224481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.225007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.225451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.226160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.226615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.227045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.278119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:12.278735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:12.294618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.295115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.295549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.296255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.296741 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.311006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.425244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:12.439368 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f2c39892-1312-4324-8912-df950ec7d50b tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1468 microversion: 2.1 time: 0.165259 Aug 24 01:54:12.442197 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 535/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:12 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:12.448099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:12.448925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:12.470078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:12.472647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.473336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.473944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.481501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.482297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.483013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.590658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:12.607564 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5f8c289e-1141-453b-8d6a-6405253ec748 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1316 microversion: 2.1 time: 0.163985 Aug 24 01:54:12.608442 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 536/1007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:12 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:12.627958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba61e05b-73fa-4841-816b-e23175a037ce", "name": "network-vif-deleted", "tag": "ba71c7e1-a6dd-47ee-b7b5-35006f1260ae"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:12.639422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.640203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.641016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.668395 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] Creating event network-vif-deleted:ba71c7e1-a6dd-47ee-b7b5-35006f1260ae for instance ba61e05b-73fa-4841-816b-e23175a037ce on n-h1-854121-3 Aug 24 01:54:12.678477 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-880d457e-69a6-49e3-ac88-0f9996b120a0 req-7b1417bc-91db-4765-8223-a31e6e248103 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065843 Aug 24 01:54:12.679185 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 537/1008] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:12.684743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:12.692780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:12.703833 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.704600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.705242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:12.706406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:12.707039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:12.707669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.080423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.094237 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ac204514-ed23-4553-9c37-b47081d4cd59 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.413496 Aug 24 01:54:13.109305 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 538/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:12 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:13.114384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:13.115253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:13.122565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.123270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.123853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.124740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.125393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.126191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.276808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.288907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5496b31-abf8-4d9e-ae93-6c6abe9e82b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1537 microversion: 2.1 time: 1.077618 Aug 24 01:54:13.289775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 472/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:12 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1537 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:13.298031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:13.298834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:13.313961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.323228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.324089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.325260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.325903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.326478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.436296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.444489 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-963f727b-5e4d-4bd0-bbe7-d18fb6b94bda tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1311 microversion: 2.1 time: 0.339315 Aug 24 01:54:13.445603 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 539/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:13 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1311 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:13.450802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "name": "network-vif-plugged", "status": "completed", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:13.461082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.461759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.462408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.475961 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] Creating event network-vif-plugged:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:13.481541 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-be7efeac-7db1-46ae-8bfd-9398ca1fc024 req-ed85e4f1-9dde-484b-b1d1-65432166faf7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034590 Aug 24 01:54:13.482669 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 540/1012] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:13.489827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:13.490756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:13.500547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.501341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.501932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.502967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.503634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.503951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.504461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.521421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22716e27-9af9-469f-83ce-7f38b07f9fb2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1265 microversion: 2.1 time: 0.228458 Aug 24 01:54:13.533549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 473/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:13 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:13.543097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.543918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.544597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.545390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lazy-loading 'fault' on Instance uuid ba61e05b-73fa-4841-816b-e23175a037ce {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:54:13.548967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:13.629655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:13.630629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:13.638454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.639692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.641505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.646852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:13.648459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:13.648989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:13.663883 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '426849d588194cfcb5d3592370ef0ce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '081bc199caa3448fba0f8cb055db21b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.702491 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a3524180-9fe4-4950-aa37-6fa96641cc93 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 200 len: 1306 microversion: 2.1 time: 0.205645 Aug 24 01:54:13.725429 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 541/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:13 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:13.780191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:13.789083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54fc3b51-97c1-40d9-b865-b72ce41ff00b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1322 microversion: 2.1 time: 0.163517 Aug 24 01:54:13.790269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 474/1015] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:13 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:14.117107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:14.118035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:14.125701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.126622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.127060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.127761 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.128212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.128707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.310555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:14.311171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:14.317686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.318244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.318771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.319582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.320361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.320922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.359161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:14.368490 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e1e57897-ed02-4a34-9f40-af39352b4212 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.256422 Aug 24 01:54:14.377419 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 542/1016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:14 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:14.470850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:14.471482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:14.478452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.478968 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.479425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.480185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.480671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.489389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.717228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:14.754742 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc5e8cb5-fa51-4cf1-8346-18dba565e3fb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.444627 Aug 24 01:54:14.757869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 475/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:14 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:14.789279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:14.792921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:14.802066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.805919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.807094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.808964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.816376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.817086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.916562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:14.929903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7739d869-5dcc-4152-be61-630e70f3e92e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1271 microversion: 2.1 time: 0.165879 Aug 24 01:54:14.944196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 476/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:14 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:14.950403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:14.951853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:14.956630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:14.961627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.962635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.963320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.964267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:14.964971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:14.965874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:14.985730 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce HTTP/1.1 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:14.987834 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:14.989222 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ba61e05b-73fa-4841-816b-e23175a037ce'} Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:14.990631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:14.991966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:14.993104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:14.996017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4541fc9-f90f-40dd-a2c3-aa3b6abd3bb5 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 404 len: 111 microversion: 2.1 time: 0.046751 Aug 24 01:54:14.999351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 477/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:14 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:15.004041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:15.018206 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-605f817b-b1e8-4679-8590-7e6d9f8b7c4e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1493 microversion: 2.1 time: 0.551100 Aug 24 01:54:15.018756 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 543/1020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:14 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1493 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:15.023786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e4fb049-ae81-41e7-abcb-53a6429c40fe", "name": "network-vif-deleted", "tag": "90cdf8e5-dc39-4eb7-b233-371dd8be2b97"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:15.029617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:15.039466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.051672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.052149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.052575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.053936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.054556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.054988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.055705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.061543 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.062058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.084316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] Creating event network-vif-deleted:90cdf8e5-dc39-4eb7-b233-371dd8be2b97 for instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe on n-h1-854121-3 Aug 24 01:54:15.094622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5f84bd1d-62b2-41ab-9471-16c184f0f125 req-f3deb8d9-41bc-4630-90fd-5e23e5d3be1a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094234 Aug 24 01:54:15.098100 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 478/1021] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:15.109501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1129793555", "metadata": {"image_type": "test"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:15.117153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.137808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.139142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.139848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.141749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.142729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.143715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.163468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce/action HTTP/1.1 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 112 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:15.166963 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1129793555", "metadata": {"image_type": "test"}}} Aug 24 01:54:15.168793 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ba61e05b-73fa-4841-816b-e23175a037ce', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1129793555', 'metadata': {'image_type': 'test'}}}} Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.169774 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.171307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.173115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:15.174103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed86fd3a-6c8c-445c-a47f-c5937df869f7 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "POST /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce/action" status: 404 len: 111 microversion: 2.1 time: 0.072889 Aug 24 01:54:15.175247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 479/1022] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Aug 24 01:54:15 2022] POST /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:15.197033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:15.198476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.223301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.224364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.229182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.230373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.231647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.232344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.485187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14b3abce-49d4-4ba6-a68c-254cff66d381 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1644 microversion: 2.1 time: 0.308466 Aug 24 01:54:15.486904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 480/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:15 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1644 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:15.493669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-220512295", "metadata": {"image_type": "test"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:15.496447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Failed to fetch instance by id tempest-invalid-887531765 {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:54:15.497276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance tempest-invalid-887531765 could not be found. Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/tempest-invalid-887531765/action HTTP/1.1 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 111 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:15.499227 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-220512295", "metadata": {"image_type": "test"}}} Aug 24 01:54:15.500627 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance tempest-invalid-887531765 could not be found. Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'tempest-invalid-887531765', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-220512295', 'metadata': {'image_type': 'test'}}}} Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-887531765 could not be found. Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:15.501636 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-887531765 could not be found. Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-887531765 could not be found. Aug 24 01:54:15.503067 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.506665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance tempest-invalid-887531765 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:15.507538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f28231c-c7d1-4873-bfe8-c4aee8ed1cdf tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "POST /compute/v2.1/servers/tempest-invalid-887531765/action" status: 404 len: 100 microversion: 2.1 time: 0.019444 Aug 24 01:54:15.508963 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 481/1024] 10.222.0.49 () {60 vars in 1246 bytes} [Wed Aug 24 01:54:15 2022] POST /compute/v2.1/servers/tempest-invalid-887531765/action => generated 100 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:15.513735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:15.514429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.523701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.525213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.526151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.527077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.527543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.527991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.533088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:15.736879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:15.748125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6124eb97-6a05-4058-97f9-437dcebd1846 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1323 microversion: 2.1 time: 0.238111 Aug 24 01:54:15.749092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 482/1025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:15 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:15.765732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:15.766614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.776560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.779920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.783548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.784496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:15.785165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:15.785791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:15.942791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:15.960439 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1bedee54-3488-416e-9f7e-cea19859f9c9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.940608 Aug 24 01:54:15.962926 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 544/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:15 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:15.968473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1595950390"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:15.971362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:54:15.972131 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 57 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:15.974035 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: {"createImage": {"name": "tempest-test-snap-1595950390"}} Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:54:15.975351 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1595950390'}}} Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.976136 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:15.977359 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:15.981684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:15.982568 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a95b7253-2ac8-42ad-9d68-7e399e7dd7d6 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018698 Aug 24 01:54:15.983154 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 545/1027] 10.222.0.49 () {60 vars in 1275 bytes} [Wed Aug 24 01:54:15 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:15.990269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:15.991815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:15.999960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.000460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.001070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.001954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.002424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.002858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.067884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dddfb5ee-23c4-4f60-841d-664a5ccfb777 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1644 microversion: 2.1 time: 0.316942 Aug 24 01:54:16.069081 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 483/1028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:15 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1644 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:16.074859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.075660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.082189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.082899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.083660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.084554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.086892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.088199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.191704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:16.203299 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-31dea78e-4ec6-4318-a726-c1994787d1ff tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.218658 Aug 24 01:54:16.204900 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 546/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:15 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:16.254287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-222176666"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:16.264600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:54:16.265391 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 56 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:16.267131 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: {"createImage": {"name": "tempest-test-snap-222176666"}} Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:54:16.268465 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-222176666'}}} Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:16.269310 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 24 01:54:16.270494 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.284076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:16.285103 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e37a2317-841c-4eac-98c6-a91282897c55 tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.079018 Aug 24 01:54:16.286306 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 547/1030] 10.222.0.49 () {60 vars in 1281 bytes} [Wed Aug 24 01:54:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:16.293148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.296230 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:54:16.296230 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:54:16.304669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.305272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.305780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.307116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.308232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.308836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.339783 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-41d8801b-a9aa-4327-8fa5-a824ff85f4e8 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.052025 Aug 24 01:54:16.340691 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 548/1031] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:16.347190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:16.354072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47431dc9-c26a-4f44-b2d6-a20fc0fa2b9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.283773 Aug 24 01:54:16.354655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 484/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:16.355395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.356174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.361087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:16.361615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.363248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.363976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.364620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.365554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.366218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.366856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.378729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.379402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.379851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.380568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.383483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.383777 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce HTTP/1.1 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:16.386525 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.388615 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'ba61e05b-73fa-4841-816b-e23175a037ce'} Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:16.389743 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.391791 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.395737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.396892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:16.398013 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c80fb57d-c6dc-4595-b80c-635522d7b68d tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 404 len: 111 microversion: 2.1 time: 0.047998 Aug 24 01:54:16.399105 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 549/1033] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:16 2022] DELETE /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:16.407857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.408488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] [instance: ba61e05b-73fa-4841-816b-e23175a037ce] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.415579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.415990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.416431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.417188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.417653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.418085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.441278 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] HTTP exception thrown: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Request method failure captured: Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce HTTP/1.1 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSt7Bz3pHyBxBMxkVd7LwVbMQVSduy_LoPYOPIP8d8ebrLebFzKLLH2SxSxRpyZX_qTfVnpMF_gcuyBaJUxx_W7Mdoi9WQwQVB7poblOGwonYbAcjKkFFUTYzhLR7IwEBJboLPlfHwc1ixtzLZ9MrC9h9a1moEGPpK7YhaLavMl7lI Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:16.443701 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_081bc199caa3448fba0f8cb055db21b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 081bc199caa3448fba0f8cb055db21b7 Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1283373522 Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 426849d588194cfcb5d3592370ef0ce2 Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ImagesNegativeTestJSON-1283373522-project Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.445288 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'ba61e05b-73fa-4841-816b-e23175a037ce'} Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:16.446060 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. Aug 24 01:54:16.447851 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:16.450566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] Returning 404 to user: Instance ba61e05b-73fa-4841-816b-e23175a037ce could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:16.451761 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-96bd1527-5d29-4063-96e4-d53f73da55df tempest-ImagesNegativeTestJSON-1283373522 tempest-ImagesNegativeTestJSON-1283373522-project] 10.222.0.49 "GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce" status: 404 len: 111 microversion: 2.1 time: 0.048851 Aug 24 01:54:16.453015 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 550/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/servers/ba61e05b-73fa-4841-816b-e23175a037ce => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:54:16.522508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc761da4-892e-4455-b177-37739374675d tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51/action" status: 202 len: 0 microversion: 2.1 time: 0.166379 Aug 24 01:54:16.523763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 485/1035] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:16 2022] POST /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:16.532244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.533183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.546749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.547566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.548021 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.548769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.549515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.550008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.771147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.773169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:16.796250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.799854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.801630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.803185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.803908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.804700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.927800 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a4d3f0a4-1ea4-4d6d-bd92-3bd08b17bc06 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1649 microversion: 2.1 time: 0.399465 Aug 24 01:54:16.929652 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 551/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1649 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:16.945520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a368057-1352-4198-85e8-dd6cdd0cd104", "tag": "d5eb0634-e3b1-4c6b-9af2-c0560042930b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:16.960634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:16.961577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:16.962786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:16.981045 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] Creating event network-changed:d5eb0634-e3b1-4c6b-9af2-c0560042930b for instance 9a368057-1352-4198-85e8-dd6cdd0cd104 on n-h2-854121-3 Aug 24 01:54:16.986682 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-79044e81-3acd-42aa-b81a-9eb1aed73fe0 req-df5fe653-76d6-462a-bbfe-56704d0f0b4a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055000 Aug 24 01:54:16.989122 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 552/1037] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:16.995035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:16.996143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:17.002718 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.003341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.003809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.004502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.004974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.005397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.298104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:17.318220 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9e96a62c-f616-44c5-a21a-b6310cf63ea4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.327243 Aug 24 01:54:17.319672 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 553/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:17.332487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:17.333745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:17.341373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.342042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.342577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.343441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.344356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.344899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.464033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:17.474700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7563303d-c2d7-45c8-99a3-8605671bb992 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1519 microversion: 2.1 time: 0.708239 Aug 24 01:54:17.475829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 486/1039] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:16 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1519 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:17.481163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:17.482867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:17.490490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.491275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.492092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.493117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.494227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.494876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.674760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:17.683715 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-26c4c817-4f57-464e-9c41-c89c6509ab64 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.361953 Aug 24 01:54:17.697076 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 554/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:17 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:17.701253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51b2488-e3fd-4a20-ae35-172334c377a4", "tag": "30a7ccff-8bc6-4035-9010-174afac3795b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:17.713885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.715138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.715699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.729749 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] Creating event network-changed:30a7ccff-8bc6-4035-9010-174afac3795b for instance b51b2488-e3fd-4a20-ae35-172334c377a4 on n-h2-854121-3 Aug 24 01:54:17.735062 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-902b5a3b-815c-4682-95e5-1bf9d0a55eda req-eb84c126-d746-4c34-8d4e-1dc83e637bde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048900 Aug 24 01:54:17.736290 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 555/1041] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:17.744360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3e455339-f0fb-4cba-af3b-4cb5b98329b0 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'create', calling method: .version_select at 0x7f6b92333ee0>, body: {"pool": null} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:17.800367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:17.809452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcbb789c-04bd-49f1-8860-610ef5159041 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.332286 Aug 24 01:54:17.810233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 487/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:17 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:17.953642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:17.953642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:17.960126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.960921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.961342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:17.962049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:17.962691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:17.963286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:18.187472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0b5f726-602a-4a05-a650-2057da92b7bb tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1629 microversion: 2.1 time: 0.238444 Aug 24 01:54:18.188043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 488/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:17 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1629 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:18.211051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:18.213754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:18.219709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:18.220193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:18.220629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:18.221344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:18.221900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:18.222333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:18.255834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lazy-loading 'flavor' on Instance uuid b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:54:18.269594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Going to try to live migrate instance to n-h2-854121-3 {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:54:19.115114 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3e455339-f0fb-4cba-af3b-4cb5b98329b0 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.375935 Aug 24 01:54:19.116237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 556/1044] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 01:54:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:19.121070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:19.121986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:19.139565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.140467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.141099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.142026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.142782 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.143368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.301988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:19.311788 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-07782ae6-0892-4971-95b4-c9d8e53fc372 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.194283 Aug 24 01:54:19.313013 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 557/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:19 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:19.317722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:19.318459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:19.326521 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.327214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.327595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.328369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.328944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.329450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.475031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:19.482772 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-081f39b6-fdb4-4daa-a5a7-43d22f4c85a7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.168619 Aug 24 01:54:19.483343 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 558/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:19 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:19.487945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:19.488769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:19.495267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.495954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.496571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.497524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.498139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.498729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.640305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:19.648105 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-59e0597f-60f8-40df-8adf-b05cba34529d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.163581 Aug 24 01:54:19.648912 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 559/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:19 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:19.653844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:19.663047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:19.663525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:19.663952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:19.675248 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] Creating event network-changed:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:54:19.679819 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-d523205a-6e28-4f07-acfe-04d1749446d2 req-d117f54e-6db8-4586-9465-ce39a1de55ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029823 Aug 24 01:54:19.680396 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 560/1048] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:19.685898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1287854722", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "ea5724f0-2e92-4683-9895-186daec66f98"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:19.739189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] validate_networks() for [('ea5724f0-2e92-4683-9895-186daec66f98', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:20.016361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=7 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:20.494018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:20.640442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:20.647423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:20.648395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:20.649075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:20.650225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:20.653237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:20.666578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:20.667065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:20.667691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:20.668420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:20.668952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:20.669377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:20.688500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Getting quotas for project 286485480bbf4d1a8615d338e1adfbed. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:20.692669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Getting quotas for user af4a3fc16bc34fb19f1621d4b065b8de and project 286485480bbf4d1a8615d338e1adfbed. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:20.714014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:20.718067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:20.778400 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2856dfd8-26e5-4d8c-969c-1bbe7611bff4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095954 Aug 24 01:54:20.779679 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 561/1049] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:20.787396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:20.788481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:20.800371 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:20.800916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:20.801359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:20.802078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:20.802539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:20.802978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.080207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:21.090283 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-863bd300-4d5b-4abe-9d54-3d3e5c006dbb tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.308743 Aug 24 01:54:21.093106 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 562/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:20 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:21.104306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:21.107574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:21.123857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.124839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.126115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.126980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.127593 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.128363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.456095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:21.468563 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-106e5419-7492-40fa-a7bd-be792f3e85fa tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.372590 Aug 24 01:54:21.469790 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 563/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:21 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:21.476586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:21.481404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:21.492805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.493484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.494590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.495404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.496358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.496951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.635491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:21.644095 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f22f9bc2-5524-447f-9575-4d720c85310f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.171898 Aug 24 01:54:21.644663 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 564/1052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:21 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:21.650211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:21.652030 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:21.658223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.659212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.659793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.660919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:21.661211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:21.661599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:21.743043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:21.746895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:21.752332 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-25fbb165-2b34-4faf-9033-8ff1ba71dccd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1276 microversion: 2.1 time: 0.106453 Aug 24 01:54:21.753142 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 565/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:21 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:22.111389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:22.112004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:22.118199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.118689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.119126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.119826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.120279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.120698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.286983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:22.297053 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-13ed7969-1640-461c-aedc-89893aa118a9 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.189420 Aug 24 01:54:22.297699 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 566/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:22 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:22.491894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:22.492507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:22.499079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.499572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.500004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.500705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.501184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.501607 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.642481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:22.651634 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-29379310-8ebe-46ea-a8c6-00b48159bfc3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.164710 Aug 24 01:54:22.664160 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 567/1055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:22 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:22.788014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b455ee8-13ee-48a0-853b-ef3a7f607c3b tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b92264f70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPspN+mwu+sv88+LyycC/KCq3KUTtk+8nKp97aMdNIHBNTNV6N5NFsHprHWbzzQfkeyCepT9mMAgKUB9YaLH/0nunXxc6g6GXdWkhoaGce2jHsVaYzA+NzGFdCmLKMOcgg=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b455ee8-13ee-48a0-853b-ef3a7f607c3b tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 257 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:22.792824 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:22.794457 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPspN+mwu+sv88+LyycC/KCq3KUTtk+8nKp97aMdNIHBNTNV6N5NFsHprHWbzzQfkeyCepT9mMAgKUB9YaLH/0nunXxc6g6GXdWkhoaGce2jHsVaYzA+NzGFdCmLKMOcgg=="}} Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPspN+mwu+sv88+LyycC/KCq3KUTtk+8nKp97aMdNIHBNTNV6N5NFsHprHWbzzQfkeyCepT9mMAgKUB9YaLH/0nunXxc6g6GXdWkhoaGce2jHsVaYzA+NzGFdCmLKMOcgg=='}}} Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:22.800222 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:22.801771 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:54:22.804080 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b455ee8-13ee-48a0-853b-ef3a7f607c3b tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6b455ee8-13ee-48a0-853b-ef3a7f607c3b tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.128911 Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 568/1056] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:22 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:54:22.807447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:22.808571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:22.808571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.808571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.809050 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.809708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.810168 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.810596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.947521 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:22.956072 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bdc17837-35ed-4dbb-a7a2-954ade26903d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.159800 Aug 24 01:54:22.956816 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 569/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:22 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:22.962549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:22.963329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:22.969645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.970169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.970574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:22.971288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:22.971737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:22.972169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.125187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:23.132992 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-95e24378-5529-4c2b-bef1-0440b5a2f6fd tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.174978 Aug 24 01:54:23.133594 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 570/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:22 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:23.138486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b92270dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2092272452", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.154832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:23.158799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for user 644aa2c2f1854aab9c9d4e65372ab416 and project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:23.176380 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 2167 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2092272452", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.186019 n-d-854121-3 devstack@n-api.service[128566]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2092272452', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.188192 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-deecca2a-c030-44e6-b66b-0a188cfa217d tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.052982 Aug 24 01:54:23.190966 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 571/1059] 10.222.0.49 () {60 vars in 1160 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:54:23.199755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-808d56b5-4477-48ad-93aa-5638a3e68aa6 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b92261a60>, body: {"keypair": {"name": "tempest-keypair-198048267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+DjD4qJvqf7F/+thixiH8Mbs8VvYbElDZ6Ssd18MYEoo7T7ecVAHw1lPMpGYjlReGQRVnrTViGfyABc3V6tXgARUhBR+NTU9KSbqC8Q09P5P6oYEftIYqCoDGB3foduQ=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.217083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-808d56b5-4477-48ad-93aa-5638a3e68aa6 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:23.221249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-808d56b5-4477-48ad-93aa-5638a3e68aa6 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for user 644aa2c2f1854aab9c9d4e65372ab416 and project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:23.238282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:23.249048 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-808d56b5-4477-48ad-93aa-5638a3e68aa6 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053129 Aug 24 01:54:23.249651 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 572/1060] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:23.263038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b92256310>, body: {"keypair": {"name": "tempest-keypair-198048267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYWT97WjjD3B2DrLeCFIEq2Um42LB9HBDanALLBmNRJTCm4B55plSyUylowRAx6I/tsVekIvqv8xqFzpLljJ+4x+BjBtktfgn/mWdnaqwdwh6WC+sU9A1AOB0smXH4sfg=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.278527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:23.282706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for user 644aa2c2f1854aab9c9d4e65372ab416 and project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:23.302409 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] HTTP exception thrown: Key pair 'tempest-keypair-198048267' already exists. Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 272 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "tempest-keypair-198048267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYWT97WjjD3B2DrLeCFIEq2Um42LB9HBDanALLBmNRJTCm4B55plSyUylowRAx6I/tsVekIvqv8xqFzpLljJ+4x+BjBtktfgn/mWdnaqwdwh6WC+sU9A1AOB0smXH4sfg=="}} Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: exception: Key pair 'tempest-keypair-198048267' already exists. Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-198048267', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYWT97WjjD3B2DrLeCFIEq2Um42LB9HBDanALLBmNRJTCm4B55plSyUylowRAx6I/tsVekIvqv8xqFzpLljJ+4x+BjBtktfgn/mWdnaqwdwh6WC+sU9A1AOB0smXH4sfg=='}}} Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '644aa2c2f1854aab9c9d4e65372ab416-tempest-keypair-198048267' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 01:54:23.328702 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:54:23.332609 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '644aa2c2f1854aab9c9d4e65372ab416-tempest-keypair-198048267' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 1, 54, 23, 297072), 'updated_at': None, 'name': 'tempest-keypair-198048267', 'user_id': '644aa2c2f1854aab9c9d4e65372ab416', 'fingerprint': 'e3:a9:e5:72:05:7e:84:c6:e2:e6:4e:3d:9a:51:14:02', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYWT97WjjD3B2DrLeCFIEq2Um42LB9HBDanALLBmNRJTCm4B55plSyUylowRAx6I/tsVekIvqv8xqFzpLljJ+4x+BjBtktfgn/mWdnaqwdwh6WC+sU9A1AOB0smXH4sfg==', 'type': 'ssh'}] Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair.create() Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._create() Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-198048267' already exists. Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 24 01:54:23.350627 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-198048267' already exists. Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-198048267' already exists. Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 409 to user: Key pair 'tempest-keypair-198048267' already exists. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f0e6e9c0-1cd1-4aa3-8f5c-ed1ee0efda41 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.072606 Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 573/1061] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.362595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.510196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:23.518370 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-513d5889-0a6f-4153-b17a-94a6c2c41bed tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.183998 Aug 24 01:54:23.519068 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 574/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:23 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:23.523824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0ea99caa-7c31-4bbd-b717-bf7754be607a tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Calling method '.version_select at 0x7f6b922bc700>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:23.543280 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0ea99caa-7c31-4bbd-b717-bf7754be607a tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198048267" status: 202 len: 0 microversion: 2.1 time: 0.022839 Aug 24 01:54:23.544003 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 575/1063] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 01:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198048267 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:23.555522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d67682f-3465-49c4-bcca-f6c6234892bd tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b92201820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSVXLb4xBaL4fs777fSW7TVhW1hct0kihuzIYSu19LkRfahweLeD0v/x44cTD7zEptnyoJW9GbfJwq3UUntlAm/1RjxrjxXGJ4BtVrxpqutdTMoGj3b53maIykDuBzY/w=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d67682f-3465-49c4-bcca-f6c6234892bd tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 247 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSVXLb4xBaL4fs777fSW7TVhW1hct0kihuzIYSu19LkRfahweLeD0v/x44cTD7zEptnyoJW9GbfJwq3UUntlAm/1RjxrjxXGJ4BtVrxpqutdTMoGj3b53maIykDuBzY/w=="}} Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSVXLb4xBaL4fs777fSW7TVhW1hct0kihuzIYSu19LkRfahweLeD0v/x44cTD7zEptnyoJW9GbfJwq3UUntlAm/1RjxrjxXGJ4BtVrxpqutdTMoGj3b53maIykDuBzY/w=='}}} Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi '' Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:54:23.561662 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:54:23.566738 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.567822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d67682f-3465-49c4-bcca-f6c6234892bd tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.569143 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3d67682f-3465-49c4-bcca-f6c6234892bd tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.016759 Aug 24 01:54:23.575584 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 576/1064] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 01:54:23.580951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b922233a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-692169100", "public_key": " "}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.602237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:23.607809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for user 644aa2c2f1854aab9c9d4e65372ab416 and project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:23.631823 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 94 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-692169100", "public_key": " "}} Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-692169100', 'public_key': ' '}}} Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.634169 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.639391 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e404477a-4041-4618-bdd7-e7a6a63f6fda tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058697 Aug 24 01:54:23.642969 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 577/1065] 10.222.0.49 () {60 vars in 1158 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:54:23.648611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a368057-1352-4198-85e8-dd6cdd0cd104", "name": "network-vif-plugged", "status": "completed", "tag": "d5eb0634-e3b1-4c6b-9af2-c0560042930b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.659655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.660876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.661635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.673681 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] Creating event network-vif-plugged:d5eb0634-e3b1-4c6b-9af2-c0560042930b for instance 9a368057-1352-4198-85e8-dd6cdd0cd104 on n-h2-854121-3 Aug 24 01:54:23.679137 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-facf42c1-9ddf-4921-9dd7-efe23e6ab816 req-1dc38ce1-7fd3-4860-9fa3-f4307387e8d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034243 Aug 24 01:54:23.680122 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 578/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:23.686047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064fc829-3faa-4bb2-a7c0-c15583c44f54", "tag": "5d4868d9-f929-49d6-9fd7-45cb56f28d60"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.696341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.696846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.697283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.708602 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] Creating event network-changed:5d4868d9-f929-49d6-9fd7-45cb56f28d60 for instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 on n-h1-854121-3 Aug 24 01:54:23.713773 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-9e606c1e-1f55-4532-970e-198a5c573f03 req-df4c8ba7-a0bc-4cc4-81bc-8b4f8e9c21af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 Aug 24 01:54:23.714339 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 579/1067] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:23.719481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e42b6c8e-45ac-4d47-a92f-491dde6bc713 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b922bc4c0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFglqTGq1YIRezvzGlpvzFron7YjwGO6Mb+aUDqnM1LLe0KLCiCejhcjdzGGC01dF1pD6FRHjKfgDlPLymLxlb2o0u1nt4lidl3k6Pq2O2GhUyN+5ysc8HqAhzpOL22Mg=="}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e42b6c8e-45ac-4d47-a92f-491dde6bc713 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 507 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFglqTGq1YIRezvzGlpvzFron7YjwGO6Mb+aUDqnM1LLe0KLCiCejhcjdzGGC01dF1pD6FRHjKfgDlPLymLxlb2o0u1nt4lidl3k6Pq2O2GhUyN+5ysc8HqAhzpOL22Mg=="}} Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFglqTGq1YIRezvzGlpvzFron7YjwGO6Mb+aUDqnM1LLe0KLCiCejhcjdzGGC01dF1pD6FRHjKfgDlPLymLxlb2o0u1nt4lidl3k6Pq2O2GhUyN+5ysc8HqAhzpOL22Mg=='}}} Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 24 01:54:23.723264 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e42b6c8e-45ac-4d47-a92f-491dde6bc713 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e42b6c8e-45ac-4d47-a92f-491dde6bc713 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009013 Aug 24 01:54:23.726855 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 580/1068] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:54:23.734527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:23.735229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:23.741895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.742370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.742797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.743521 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.743971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.744393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.880265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:23.888069 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bdca0fe0-aeba-4461-96f7-e3aabef4bed8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.156990 Aug 24 01:54:23.888661 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 581/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:23 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:23.893192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Action: 'create', calling method: .version_select at 0x7f6b922bc430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-243296875", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:23.909371 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:23.913186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Getting quotas for user 644aa2c2f1854aab9c9d4e65372ab416 and project fc656936504744b79acc459497ba3fd4. Resources: {'key_pairs'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:23.928836 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 117 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-243296875", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: exception: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-243296875', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 24 01:54:23.930693 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ff31e3d6-02df-4a48-be7f-922f72a10ff3 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.042461 Aug 24 01:54:23.934785 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 582/1070] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:54:23.941389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e61a17f9-431e-44d6-a114-df25429936b5 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Calling method '.version_select at 0x7f6b92270820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:23.953713 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-e61a17f9-431e-44d6-a114-df25429936b5 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e61a17f9-431e-44d6-a114-df25429936b5 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Request method failure captured: Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-198141051 HTTP/1.1 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTOsxDV_L4LYwNVASNevWIChQtIicJfyyYccSqHapJ7q2jKPD7RJDLl3XiXKKR4s1IUNkEK_ucnABKDY5m6ki10RiOeLDVs1j5iDtQRQGeiDh1M7JjkMB2pU9dXxhGvUTGFpMnEEQWsItg8miJmB-xdMMs-KLbfR1c_d5iLPjwnVfA Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fc656936504744b79acc459497ba3fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fc656936504744b79acc459497ba3fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fc656936504744b79acc459497ba3fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: fc656936504744b79acc459497ba3fd4 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1591655796 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1591655796-project Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: exception: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'tempest-keypair-non-existent-198141051'} Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.955460 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e61a17f9-431e-44d6-a114-df25429936b5 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] Returning 404 to user: Keypair tempest-keypair-non-existent-198141051 not found for user 644aa2c2f1854aab9c9d4e65372ab416 {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e61a17f9-431e-44d6-a114-df25429936b5 tempest-KeyPairsNegativeTestJSON-1591655796 tempest-KeyPairsNegativeTestJSON-1591655796-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-198141051" status: 404 len: 144 microversion: 2.1 time: 0.019036 Aug 24 01:54:23.961353 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 583/1071] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 01:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-198141051 => generated 144 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:23.979756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:23.980372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:23.986540 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.987022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.987451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:23.988138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:23.988596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:23.989041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.127311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:24.135838 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec08a627-8455-46e6-b8b8-7d49ac5de886 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.161973 Aug 24 01:54:24.136561 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 584/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:23 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:24.155093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:24.155910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:24.161642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.162148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.162568 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.163257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.163902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.164329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.294769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:24.302392 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-67853dd8-4ed9-4d9d-a999-d8a84d6fafd3 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.151823 Aug 24 01:54:24.302948 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 585/1073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:24 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:24.538792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:24.539553 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:24.546069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.546679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.547124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.547822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.548280 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.548704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.699548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:24.708391 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dedebbe0-e56c-49fb-b577-0590c1b95c33 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.173687 Aug 24 01:54:24.708999 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 586/1074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:24 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:24.910821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:24.911424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:24.917375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.917866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.918303 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:24.918997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:24.919456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:24.919881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.058079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:25.065695 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8f9fa3da-1c72-42c1-8363-860ef2b1c68f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.158665 Aug 24 01:54:25.066237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 587/1075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:24 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:25.156924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:25.157527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:25.163783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.165075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.165509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.166205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.166663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.167357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.302209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:25.311857 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0154a410-9b06-4569-a962-ed59e8b554b8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.159259 Aug 24 01:54:25.313092 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 588/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:25 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:25.323720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:25.324673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:25.331024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.331773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.332430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.333316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.333950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.334534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.481268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:25.490652 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e03a3eef-3726-4630-822d-c590b788a8fc tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.170809 Aug 24 01:54:25.491923 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 589/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:25 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:25.729696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:25.730594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:25.737526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.737994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.738458 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.739571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:25.739686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:25.740025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:25.997180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:26.005416 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3fdf6e8a-e19c-40ed-9ebe-347e6a82f8fc tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.279640 Aug 24 01:54:26.006064 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 590/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:25 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:26.088297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:26.088983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:26.095157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:26.095900 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:26.096781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:26.097060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:26.097520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:26.098073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:26.253652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:26.262719 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81bb195d-fb18-4e30-87d9-2a58df0252d8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.178982 Aug 24 01:54:26.263550 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 591/1079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:26 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:26.439885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-981535983", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "14f2b6ca-293f-45ff-89be-4667604d124b"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:26.492864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] validate_networks() for [('14f2b6ca-293f-45ff-89be-4667604d124b', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:26.913807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:26.914411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:26.915486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:26.920517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:26.921031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:26.930478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:26.930973 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:26.931406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:26.932157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:26.932610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:26.933087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:26.950685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:26.954952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for user de7aeb19b75943d89f74ada589d05055 and project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:26.968945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:26.971259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:27.112703 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4fa75093-3ce8-43e2-8a6c-b2fa1571f6d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792443 Aug 24 01:54:27.113569 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 592/1080] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 01:54:27.119483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:27.120066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:27.150060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:27.150578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:27.151025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:27.153474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:27.156490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:27.157101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:27.578727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:27.588412 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-658afd6e-a51e-43a5-bb51-67758779bf8f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.473950 Aug 24 01:54:27.589046 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 593/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:27 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:27.597698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:27.598343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:27.605794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:27.606363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:27.606846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:27.607618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:27.608353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:27.609013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:27.638653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:28.040479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:28.058071 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-725fc982-029c-4a73-9cb6-48a8b9e4401f tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.467912 Aug 24 01:54:28.058785 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 594/1082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:27 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:28.069580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:28.071259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:28.080616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.082485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.083842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.085315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.085799 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.086220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.284252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:28.304213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2477087-6bea-46fb-a90b-d5b4d200110b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51/action" status: 202 len: 0 microversion: 2.1 time: 10.096471 Aug 24 01:54:28.304910 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 489/1083] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:18 2022] POST /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51/action => generated 0 bytes in 10098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:28.311493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1353377624", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "14f2b6ca-293f-45ff-89be-4667604d124b"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:28.343750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:28.388400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] validate_networks() for [('14f2b6ca-293f-45ff-89be-4667604d124b', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:28.671942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:28.683667 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2052bb98-a9da-470e-88e6-05d7e4421213 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.617768 Aug 24 01:54:28.685615 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 595/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:28 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:28.693627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:28.694436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:28.706638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.708484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.709143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.710050 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.710670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.711271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.874902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:28.885792 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cd839f22-2361-4aaa-8e56-aa3ba3304779 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.196389 Aug 24 01:54:28.886739 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 596/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:28 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:28.894678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-plugged", "status": "completed", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:28.906757 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.907240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.907663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.918663 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] Creating event network-vif-plugged:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:54:28.923833 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-401b90c4-a088-4977-93c5-de096b5d1507 req-d99aa2a5-d598-4825-9e05-7f8e40a95b8d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035825 Aug 24 01:54:28.924589 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 597/1086] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:28.929470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:28.930161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:28.936198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.936682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.937147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.937840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.938289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.938706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.957960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:28.958824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:28.959306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:28.959722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:28.960136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:28.970967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.971733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.972652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.973627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:28.974884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:28.975542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:28.995696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:28.999842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for user de7aeb19b75943d89f74ada589d05055 and project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:29.011795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:29.014289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:29.078810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35d18011-a7da-4761-a2f3-12b76fdf83e8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772260 Aug 24 01:54:29.085789 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 490/1087] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:29.094053 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:29.106116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:29.107210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:29.121167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.123096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.125263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.128080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.128839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.129582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.130776 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e9d1eb24-2cb9-48fc-9380-bb809ebb200d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.203849 Aug 24 01:54:29.134601 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 598/1088] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:28 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:29.154009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:29.157557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:29.171972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.172888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.173535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.179770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.181065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.181736 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.554364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:29.566402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75608a3b-f844-49f9-b2f5-c08abdac2937 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.479216 Aug 24 01:54:29.573074 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 491/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:29 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:29.578769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1860791100", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "451", "networks": [{"uuid": "14f2b6ca-293f-45ff-89be-4667604d124b"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:29.675010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:29.691605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] validate_networks() for [('14f2b6ca-293f-45ff-89be-4667604d124b', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:29.695484 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e3027352-e0fb-4e03-b569-ecaa90709bc5 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.559420 Aug 24 01:54:29.701621 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 599/1090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:29 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:29.708110 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:29.713539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:29.730146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.730903 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.731543 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.732418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.733093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.733523 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.925827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:29.937349 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ee152447-2d05-4291-bef6-42faa8ede8da tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1390 microversion: 2.1 time: 0.234176 Aug 24 01:54:29.939938 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 600/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:29 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1390 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:29.948181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:29.949080 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:29.955793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.956577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.957410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:29.958363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:29.959041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:29.959701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.114014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:30.123186 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4267147d-2f4f-4fbe-a5eb-8746eb626857 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.181885 Aug 24 01:54:30.124781 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 601/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:29 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:30.156018 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:30.156923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:30.163553 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.164095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.164594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.165927 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.166460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.167066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.314285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:30.322959 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ae3ad560-95c1-432d-ac56-ea52aa54eaff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.171236 Aug 24 01:54:30.323784 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 602/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:30 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:30.515887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:30.517256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:30.518242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:30.519045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:30.519499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:30.530628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.531459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.532111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.533097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.533767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.534989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.558155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:30.562253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Getting quotas for user de7aeb19b75943d89f74ada589d05055 and project 4ecd3cbcdfec4256811072c372016fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:30.573731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:30.575912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:30.591827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:30.592850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:30.596895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:DELETE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:30.601038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.601958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.603206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.604333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.605026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.605644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.631722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df56d711-d460-4411-8a5f-a81e4825e5a8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056366 Aug 24 01:54:30.633181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 492/1094] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:30.645651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67bba6bb-3800-43bd-ab97-e71cf77398a4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:30.646268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67bba6bb-3800-43bd-ab97-e71cf77398a4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:30.763688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67bba6bb-3800-43bd-ab97-e71cf77398a4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:30.773908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67bba6bb-3800-43bd-ab97-e71cf77398a4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1221 microversion: 2.1 time: 0.134228 Aug 24 01:54:30.779973 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 493/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:30 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:30.787632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:30.798691 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fe983e97-4bf9-459e-9cf0-ccd573629501 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.210321 Aug 24 01:54:30.802537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:30.805460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:30.809370 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 603/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:30 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:30.813594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.814087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.814521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.815418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.816213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.816642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:30.948030 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064fc829-3faa-4bb2-a7c0-c15583c44f54", "name": "network-vif-plugged", "status": "completed", "tag": "5d4868d9-f929-49d6-9fd7-45cb56f28d60"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:30.976417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:30.977401 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:30.978005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.018482 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] Creating event network-vif-plugged:5d4868d9-f929-49d6-9fd7-45cb56f28d60 for instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 on n-h1-854121-3 Aug 24 01:54:31.040116 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-632c5e11-5f85-45bd-9f38-203f731c4f41 req-a17f55e6-b732-49ff-9548-545d909fa399 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096641 Aug 24 01:54:31.046254 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 604/1097] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:31.053604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.054549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.062451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.063220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.064893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.065840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.067035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.067654 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.289230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:31.298203 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a0acad1-a1f2-486a-9a5b-4f836574d099 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.515952 Aug 24 01:54:31.313800 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 494/1098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:30 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:31.319698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.320909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.330643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.331576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.332456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.334130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.335289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.336291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.597302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:31.608426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91b90e4f-eca6-4306-b013-45de9cee0147 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.293006 Aug 24 01:54:31.609181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 495/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:31.617474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.618887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.631452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:31.641477 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-87bd90b4-1adb-4a0e-8317-25db9dfdbc90 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1590 microversion: 2.1 time: 0.593543 Aug 24 01:54:31.642046 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 605/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1590 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:31.654851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.655362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.655805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.656528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.657006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.660702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.673103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.673602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.684542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.687344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.689732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.694054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.694705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.695739 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.824744 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c7da5933-f286-4439-94f6-8068ac3a5563 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160976 Aug 24 01:54:31.828880 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 606/1101] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:31.834224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.834863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.841306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.842072 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.842674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.844378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.844878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.845363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.880560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:31.890526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a814ed03-eb7b-44ca-bc53-07d693b2d7f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.277516 Aug 24 01:54:31.891397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 496/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:31.896896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:31.897764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:31.907673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.908516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.909211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.910267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:31.910824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:31.911344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:31.964279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:31.976991 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0087e933-9ffa-473c-8680-2159ffd72e65 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1273 microversion: 2.1 time: 0.146768 Aug 24 01:54:31.979977 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 607/1103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:32.220788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:32.238055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb3ecfdc-003d-4abd-a390-7f422a808ce9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.343936 Aug 24 01:54:32.239182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 497/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:31 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:32.303454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f79ec99-f574-4cf9-b793-898adb636676", "tag": "d321907d-b901-4c62-8466-aeba6f443742"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:32.312899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.313387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.313818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.326397 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] Creating event network-changed:d321907d-b901-4c62-8466-aeba6f443742 for instance 5f79ec99-f574-4cf9-b793-898adb636676 on n-h1-854121-3 Aug 24 01:54:32.326701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:32.327303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:32.331037 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-816a4718-e430-445d-ac24-e0a00b7c29e4 req-af7f9376-1179-46cd-ac85-6ccef85a9c9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031221 Aug 24 01:54:32.331644 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 608/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:32.339976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.340475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.340945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.341650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.342135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.342535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.487170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:32.495072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fac205f3-7771-4819-b989-f56e8e56e698 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1324 microversion: 2.1 time: 0.172360 Aug 24 01:54:32.496343 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 498/1106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:32 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:32.633918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:32.635629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:32.643213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.643915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.644427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.645587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.646244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.646864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.918110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:32.941613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:32.950899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.951407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.951844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.952552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:32.953038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:32.953470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:32.997476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:33.006395 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7b5d7de6-b1b0-4c7a-bb59-faf2c5373fba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.378456 Aug 24 01:54:33.007344 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 609/1107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:32 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:33.014610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:33.015704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:33.027779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.028828 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.030071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.030926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.031461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.031956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.219864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:33.236605 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-29d46b49-beda-45f3-824e-fb0ee3241d44 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1281 microversion: 2.1 time: 0.224902 Aug 24 01:54:33.238049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:33.238775 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 610/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:33 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:33.249717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51b2488-e3fd-4a20-ae35-172334c377a4", "name": "network-vif-plugged", "status": "completed", "tag": "30a7ccff-8bc6-4035-9010-174afac3795b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:33.256848 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da129cc4-e0c1-4c0a-9bfc-4ac72ee31213 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.348888 Aug 24 01:54:33.258090 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 499/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:32 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:33.263025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:33.263894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:33.269986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.270704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.271395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.272304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.273001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.273640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.274920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.275420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.275918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.290331 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] Creating event network-vif-plugged:30a7ccff-8bc6-4035-9010-174afac3795b for instance b51b2488-e3fd-4a20-ae35-172334c377a4 on n-h2-854121-3 Aug 24 01:54:33.295982 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-3d64f8b5-df56-4d4b-a556-a5d963221643 req-a7f1772a-ebdf-4946-aa59-14d916f04213 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055775 Aug 24 01:54:33.297137 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 611/1110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:33.517754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:33.518871 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:33.526494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.527084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.527592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.528381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.528965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.529454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.934809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:33.935486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:33.945458 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-17290046-aabd-4996-8584-bb1c5ba315bb tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 200 len: 1519 microversion: 2.1 time: 0.431521 Aug 24 01:54:33.949860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1d6cb69-b832-4728-879f-e1271d74e7fa tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.689490 Aug 24 01:54:33.959002 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 612/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:33 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:33.967146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 500/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:33 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:33.971729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.156"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:33.974309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:33.981776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.982276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.982720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:33.983432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:33.983904 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:33.984330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.013452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:54:34.013867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquired lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:54:34.029766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:34.030167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:34.037234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.037844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.038345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.039327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.039847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.040477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.362601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:34.372933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d171a27-33ca-4719-849b-d6a9504ade71 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.347490 Aug 24 01:54:34.373940 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 501/1113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:34 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:34.380040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:34.381001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:34.389705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.390415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.391120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.392110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.392648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.393091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.474485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:34.484139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdeaf6ec-2aae-4afd-9d31-3b84c44dc7a3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1279 microversion: 2.1 time: 0.108677 Aug 24 01:54:34.484646 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 502/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:34 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:34.500844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:34.501464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:34.510897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.511676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.512343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.513401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.514131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.514834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.698865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:34.709963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e92dec37-43ec-4fb8-a921-5c622211d1c0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.223619 Aug 24 01:54:34.711271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 503/1115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:34 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:34.727735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cb52e0-25a2-4770-80c2-be3f0f9dcb51", "name": "network-vif-unplugged", "status": "completed", "tag": "75fbdc04-f6fa-4246-9bd0-5a9066a115cb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:34.737449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.738311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.739013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.752334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] Creating event network-vif-unplugged:75fbdc04-f6fa-4246-9bd0-5a9066a115cb for instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 on n-h1-854121-3 Aug 24 01:54:34.761076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d73f3874-cb19-4234-8be4-421b64827574 req-e179e234-75bc-43cb-bc93-977d8aa5db64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047818 Aug 24 01:54:34.762220 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 504/1116] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:34.768313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:34.769111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:34.776960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.777295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.777729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.778638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:34.779098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:34.779519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:34.977985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:35.018306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45701160-260c-4d57-a899-280ba9a6783c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1590 microversion: 2.1 time: 0.252594 Aug 24 01:54:35.019172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 505/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:34 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1590 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:35.028468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:35.029646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:35.039375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.040465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.041308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:35.042453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.042911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.043333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:35.223788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:35.233367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f9e7f87-b3b2-42de-9abd-0b5ce3b6cfde tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1313 microversion: 2.1 time: 0.212940 Aug 24 01:54:35.237246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 506/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:35 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:35.401343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:35.403067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:35.419325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.420871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.422301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:35.423575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.426412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.427794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:35.661703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:35.671750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-193b110e-d93e-4ef5-b5e9-40fc75b113ce tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.280069 Aug 24 01:54:35.675612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 507/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:35 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:35.680942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:35.685532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:35.696541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.697146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.707507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:35.708740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:35.710558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:35.713086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.015606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:36.027918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7d6be17-fa0b-4ac0-95dd-7abbafe8aeb2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.351210 Aug 24 01:54:36.040751 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 508/1120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:35 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:36.041052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:36.043729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:36.050700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.051201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.051641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.052357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.053324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.053441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.074460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:36.199074 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Building network info cache for instance {{(pid=128566) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:36.290888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:36.299165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a297f20a-63db-42cf-9029-05812a59c349 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.269088 Aug 24 01:54:36.299979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 509/1121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:36 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:36.304577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f5cf62-543d-4bd3-8956-134d9cf01bf4", "tag": "3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:36.315970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.316458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.316945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.329098 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] Creating event network-changed:3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c for instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 on n-h2-854121-3 Aug 24 01:54:36.335400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-da556ebd-731d-46e2-950e-90475a1d0546 req-d270ab4a-cad2-4aa8-9ccf-68e449e8ebc0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033786 Aug 24 01:54:36.336080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 510/1122] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:36.342462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:36.343357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:36.350181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.350905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.351545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.352970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.353607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.354179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.578807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:36.597206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f753f2d-9ca6-4c96-b6c6-309b8b668c27 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1463 microversion: 2.1 time: 0.259527 Aug 24 01:54:36.612818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 511/1123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:36 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:36.621400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:36.622011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:36.628133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.628620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.629082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.629771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.630221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.630638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.839414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:36.847808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c89b302-da45-4b13-bebd-7ef421a84523 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1463 microversion: 2.1 time: 0.230294 Aug 24 01:54:36.848378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 512/1124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:36 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1463 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:36.853366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:36.854182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:36.860285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.861195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.861831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.862887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.863539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.864206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.896920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Updating instance_info_cache with network_info: [{"id": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76", "address": "fa:16:3e:8b:7a:1f", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3f12ba1c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128566) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:36.913575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:36.918622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Releasing lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:54:36.921998 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7778f293-16c8-4153-ab3f-d0ec3c9e6a05 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action" status: 202 len: 0 microversion: 2.1 time: 2.954500 Aug 24 01:54:36.923676 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 613/1125] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:33 2022] POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action => generated 0 bytes in 2957 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:54:36.931345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a368057-1352-4198-85e8-dd6cdd0cd104", "tag": "d5eb0634-e3b1-4c6b-9af2-c0560042930b"}, {"name": "network-changed", "server_uuid": "b4cb52e0-25a2-4770-80c2-be3f0f9dcb51", "tag": "75fbdc04-f6fa-4246-9bd0-5a9066a115cb"}, {"name": "network-changed", "server_uuid": "f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd", "tag": "da72d336-8c09-4067-a0be-42d0db46325f"}, {"name": "network-changed", "server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:36.943134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:36.947794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:36.948512 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:36.949145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:36.964706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=32 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:36.968890 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Creating event network-changed:d5eb0634-e3b1-4c6b-9af2-c0560042930b for instance 9a368057-1352-4198-85e8-dd6cdd0cd104 on n-h2-854121-3 Aug 24 01:54:36.969471 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Creating event network-changed:75fbdc04-f6fa-4246-9bd0-5a9066a115cb for instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 on n-h1-854121-3 Aug 24 01:54:36.970051 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Creating event network-changed:da72d336-8c09-4067-a0be-42d0db46325f for instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd on n-h1-854121-3 Aug 24 01:54:36.971511 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] Creating event network-changed:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:36.988801 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-05d79c23-13cc-4748-adf6-a20026d53195 req-c19ce89b-17f6-4b3a-8adf-2289c7c4728f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.063361 Aug 24 01:54:36.994335 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 614/1126] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:37.008837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.156"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:37.011921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:37.019596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.020392 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.021100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.021818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.022298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.022731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.052317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:54:37.052750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquired lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:54:37.074755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:37.083840 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8b38406-04fe-4f87-910a-5159698cff4a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.234092 Aug 24 01:54:37.096800 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 513/1127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:36 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:37.096800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:37.096800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:37.097912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.098671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.099350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.100326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.101070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.101593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.283451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:37.292538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2245fb6b-2b44-4271-ac93-5882b5dbc151 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.206754 Aug 24 01:54:37.293202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 514/1128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:37 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:37.298175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-898814081", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:37.356096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:37.652429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:37.653067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:37.653764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:37.654271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:37.654934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:37.667255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.668348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.669117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.670078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.670902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.671538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.693891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:37.699318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Getting quotas for user 00d5425074f540b8be6a17014a1eec40 and project 17768302608445dda904cd4791e1a0ba. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:37.713743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:37.716215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:37.762366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe4e5da0-4a2b-4c25-99ba-343e6ec42bf5 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.467551 Aug 24 01:54:37.769784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 515/1129] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:37.776297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:37.777441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:37.784272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.785032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.785473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:37.786366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:37.786625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:37.787051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:38.011084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:38.024338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-936eee4b-2ed8-4191-a2f3-1a6109fcec40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.252359 Aug 24 01:54:38.038462 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 516/1130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:37 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:38.038462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a4dbb30-d8fa-4fb6-8757-dc32718fda91 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:38.038462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a4dbb30-d8fa-4fb6-8757-dc32718fda91 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:38.038462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:38.093355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a4dbb30-d8fa-4fb6-8757-dc32718fda91 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:38.101424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a4dbb30-d8fa-4fb6-8757-dc32718fda91 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1213 microversion: 2.1 time: 0.074509 Aug 24 01:54:38.112984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 517/1131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:38 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:38.112984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:38.112984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:38.117441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:38.118482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:38.118889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:38.119584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:38.120031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:38.120446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:38.257971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:38.266281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d687c1e9-844e-46b2-bc68-b00a7367c9e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.162779 Aug 24 01:54:38.266902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 518/1132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:38 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:38.312690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:38.313313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:38.318990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:38.319464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:38.320159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:38.321482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:38.321931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:38.322350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:38.451166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:38.458799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5677fa0d-842c-4f3a-a527-54c6f0faf79a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.149661 Aug 24 01:54:38.459360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 519/1133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:38 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:39.046681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:39.047300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:39.053405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.053792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.054253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.055170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.055788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.056374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.193105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:39.202645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0c4ef43-83f0-4dd1-9406-16b007f4fc0e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.159806 Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 520/1134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:39 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.216901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.217506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.217684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.218122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.286846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:39.294508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86d6513b-9bbb-4504-939e-38d1585383dd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1217 microversion: 2.1 time: 0.089916 Aug 24 01:54:39.295070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 521/1135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:39 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:39.299456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:39.300049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:39.305624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.306102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.306527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.307201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.307644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.310103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.447908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:39.458188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d955c4e9-6036-4f35-a6ac-d9d7ad1db2e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.162007 Aug 24 01:54:39.459087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 522/1136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:39 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:39.480365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:39.485362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:39.491727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.493683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.494332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.495084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:39.495541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:39.495969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:39.660257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:39.668705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-794f1e17-d1ea-4a8e-8399-d8daebd3d48a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.192738 Aug 24 01:54:39.669866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 523/1137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:39 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:40.062900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:40.073196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.074122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.074813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.101083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] Creating event network-changed:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:40.108130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-241198c4-2f3c-497d-bc14-7e256408fcce req-63a13742-c7df-4daf-a276-5c37c44d4310 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048626 Aug 24 01:54:40.109262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 524/1138] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:40.136524 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.network.neutron [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] re-assign floating IP 172.25.9.156 from instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 Aug 24 01:54:40.186306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Building network info cache for instance {{(pid=128566) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:40.227740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:40.228626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:40.235245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.236072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.236886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.237907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.238582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.239241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.399816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:40.408296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbc4c635-35d1-431a-93e8-428ebf7c2149 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.185910 Aug 24 01:54:40.409105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 525/1139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:40 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:40.413737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:40.414393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:40.422846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.423341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.424304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.425136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.425589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.426010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.524450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:40.534771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bd60e16-4d35-4e22-84c2-ad8828993aac tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1217 microversion: 2.1 time: 0.124418 Aug 24 01:54:40.536962 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 526/1140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:40 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:40.542581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:40.543190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:40.555688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.556415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.557221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.557761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.558218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.558656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.704382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:40.712583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfff3c39-5dc6-4929-9e8e-c801b3421e84 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.174458 Aug 24 01:54:40.713387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 527/1141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:40 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:40.718242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:40.719043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:40.725287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.725980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.726703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.728245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:40.728905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:40.729497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:40.772010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Updating instance_info_cache with network_info: [{"id": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76", "address": "fa:16:3e:8b:7a:1f", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3f12ba1c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128566) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:40.784847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Building network info cache for instance {{(pid=128566) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:40.884239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:40.901634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09c5b0bf-d5ea-4182-a5e7-997f6b4528c0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.186967 Aug 24 01:54:40.902768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 528/1142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:40 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:41.014613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f79ec99-f574-4cf9-b793-898adb636676", "name": "network-vif-plugged", "status": "completed", "tag": "d321907d-b901-4c62-8466-aeba6f443742"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:41.031454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.032745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.033207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.039280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:41.061585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] Creating event network-vif-plugged:d321907d-b901-4c62-8466-aeba6f443742 for instance 5f79ec99-f574-4cf9-b793-898adb636676 on n-h1-854121-3 Aug 24 01:54:41.069063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-30c9167c-c22d-4110-8259-41ff0962ad41 req-e8647841-10fd-4448-bab8-ab42ddbbc51a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058301 Aug 24 01:54:41.070521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 529/1143] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:41.434715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:41.435412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:41.442299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.442789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.443242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.443915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.444370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.445084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.532672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Updating instance_info_cache with network_info: [{"id": "5d4868d9-f929-49d6-9fd7-45cb56f28d60", "address": "fa:16:3e:ed:dc:77", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d4868d9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128566) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:41.547120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Releasing lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:54:41.548290 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2c6e4cf0-4b6d-401e-a945-d6e7be913e64 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54/action" status: 202 len: 0 microversion: 2.1 time: 4.549421 Aug 24 01:54:41.549410 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 615/1144] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:36 2022] POST /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54/action => generated 0 bytes in 4554 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:54:41.556090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:41.557064 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:41.564278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.564797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.565398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.566114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.566580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.567071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.595248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:41.603748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d83b0de0-db9c-43e2-b9ea-f27defc33147 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.173645 Aug 24 01:54:41.604611 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 530/1145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:41 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:41.609507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.156"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:41.636130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:41.645096 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-569cf9c4-beb7-4593-935a-cdab03130345 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1217 microversion: 2.1 time: 0.093076 Aug 24 01:54:41.645943 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 616/1146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:41 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:41.735417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:41.736923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:41.744177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.745119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.745719 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.746782 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.747250 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.747679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.748397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:41.758896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.760046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.760755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.761973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.762711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.764109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.907993 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:41.915984 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cec4c812-ff27-4b86-be8d-84571014bf86 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1542 microversion: 2.1 time: 0.184344 Aug 24 01:54:41.916700 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 617/1147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:41 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1542 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:41.922873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:41.923772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:41.930798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.931409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.931945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.932766 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:41.933451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:41.933978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:41.987335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] HTTP exception thrown: Floating IP 172.25.9.156 is not associated with instance 3dd2a166-0ca3-426b-be17-6637ae00ca80. Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Request method failure captured: Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action HTTP/1.1 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 49 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYS2VhfC92zkqJaZARgzIV4uhB2H9x2aDsZd5ULvRaRHVGoLwpk-jnofvX_zmsF-C7eWS6B8uteQZlMO57zoCCu6Qj_2_XpSpWtt-45oZAVSCwz9hae_aX-9dI4zvD18139VSTZ7PvBS2RlXGdkF3AiKzNmrNkVDULCmhBpjIdL5Dvc Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: af4a3fc16bc34fb19f1621d4b065b8de Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: {"removeFloatingIp": {"address": "172.25.9.156"}} Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: exception: Floating IP 172.25.9.156 is not associated with instance 3dd2a166-0ca3-426b-be17-6637ae00ca80. Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3dd2a166-0ca3-426b-be17-6637ae00ca80', 'body': {'removeFloatingIp': {'address': '172.25.9.156'}}} Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.156 is not associated with instance 3dd2a166-0ca3-426b-be17-6637ae00ca80. Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.156 is not associated with instance 3dd2a166-0ca3-426b-be17-6637ae00ca80. Aug 24 01:54:41.988873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:41.994032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Returning 409 to user: Floating IP 172.25.9.156 is not associated with instance 3dd2a166-0ca3-426b-be17-6637ae00ca80. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:41.994032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10af1161-bc5a-4c88-953e-d3d18423e80c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action" status: 409 len: 146 microversion: 2.1 time: 0.384632 Aug 24 01:54:41.994032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 531/1148] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:41 2022] POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action => generated 146 bytes in 386 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:54:41.999594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.156"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:42.083453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:42.092157 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9aa1dcdb-85aa-48fd-a156-6b4f2463f071 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.172858 Aug 24 01:54:42.093571 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 618/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:41 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:42.125435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064fc829-3faa-4bb2-a7c0-c15583c44f54", "tag": "5d4868d9-f929-49d6-9fd7-45cb56f28d60"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:42.135592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:42.136089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:42.136745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:42.144481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:42.157939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:42.158376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:42.158821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:42.159539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:42.160000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:42.160441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:42.178438 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] Creating event network-changed:5d4868d9-f929-49d6-9fd7-45cb56f28d60 for instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 on n-h1-854121-3 Aug 24 01:54:42.184229 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-b801c83b-b6fe-4210-9269-bc133ed33f14 req-869a0cf7-8cdb-4011-aae1-21c7c90f6d95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063011 Aug 24 01:54:42.185387 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 619/1150] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:42.626768 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:42.636071 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:42.643519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:42.644327 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:42.644963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:42.646004 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:42.646638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:42.647365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:42.983792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:42.991978 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e9a379d6-1271-4b61-89d8-d14c8162839c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.370128 Aug 24 01:54:42.993216 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 620/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:42 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:42.998318 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:42.999248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:43.001223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:54:43.001676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquired lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:54:43.006790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.007525 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.008747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.009700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.010394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.011091 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.139731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:43.151852 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9c15b951-ba24-4ad4-97aa-7739b14f1488 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1265 microversion: 2.1 time: 0.157228 Aug 24 01:54:43.152997 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 621/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:42 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:43.158390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:43.159130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:43.166618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.167364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.167984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.168850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.169434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.170023 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.387454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:43.395248 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cf9f4e95-c1d1-4a13-bcfa-6084d4c8d3f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1541 microversion: 2.1 time: 0.240873 Aug 24 01:54:43.395856 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 622/1153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:43 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1541 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:43.400346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:43.400979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:43.407195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.407782 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.408289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.409119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:43.409650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:43.410142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:43.822284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:43.834963 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dd6808a0-dc19-4652-bc8e-55a107815317 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.438031 Aug 24 01:54:43.835546 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 623/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:43 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:44.015550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:44.016261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:44.022535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.023096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.024311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.025241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.025789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.026464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.453045 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:44.462717 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8c2bc629-e186-4f66-af63-a84cd8b891f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.450943 Aug 24 01:54:44.476801 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 624/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:44 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:44.482621 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:44.483289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:44.490164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.490889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.491485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.492343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.492982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.493584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.643369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:44.653522 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-638171c3-0e6d-4651-9e07-31e123eae1be tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1271 microversion: 2.1 time: 0.175472 Aug 24 01:54:44.654672 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 625/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:44 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:44.676095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:44.676742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:44.683589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.683589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.683914 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.684749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:44.685113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:44.685900 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:44.990019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:45.004811 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1df9bcef-2d6e-4646-93b1-fa4a01610085 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1541 microversion: 2.1 time: 0.332504 Aug 24 01:54:45.019671 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 626/1157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:44 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1541 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:45.020882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:45.022138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:45.038817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.039893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.040334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.041111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.041541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.041971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.308038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:45.317533 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-22c2d30c-eea6-4853-9a87-bec114b31577 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.301093 Aug 24 01:54:45.344200 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 627/1158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:45 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:45.352167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f5cf62-543d-4bd3-8956-134d9cf01bf4", "name": "network-vif-plugged", "status": "completed", "tag": "3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:45.371497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.372161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.372832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.390974 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] Creating event network-vif-plugged:3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c for instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 on n-h2-854121-3 Aug 24 01:54:45.397022 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-3181e9a6-7bb7-449b-aaa1-151f72baed74 req-2d04cbb1-dc76-46d4-852f-fbb313bc8cbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049167 Aug 24 01:54:45.397733 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 628/1159] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:45.442160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Building network info cache for instance {{(pid=128567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:45.454089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064fc829-3faa-4bb2-a7c0-c15583c44f54", "tag": "5d4868d9-f929-49d6-9fd7-45cb56f28d60"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:45.464505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.465015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.465448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.493982 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] Creating event network-changed:5d4868d9-f929-49d6-9fd7-45cb56f28d60 for instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 on n-h1-854121-3 Aug 24 01:54:45.499586 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-46e1dde2-b587-44fe-911f-46bcf372a4fb req-7e79b040-bd9a-459c-b3be-189ef94c4527 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050774 Aug 24 01:54:45.502043 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 629/1160] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:45.509454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:45.510153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:45.517979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.518481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.518919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.519624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.520076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.520502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.563734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3,nova_cell1:SELECT=91 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:45.693573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:45.702727 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f7db30e0-544d-4a87-9c7f-8f369e982ced tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.199453 Aug 24 01:54:45.712743 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 630/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:45 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:45.712743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:45.712743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:45.717722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.717722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.717722 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.718145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:45.718597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:45.719024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:45.872874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:45.881561 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-68cd0adf-c583-4df3-be93-401c834585bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.177208 Aug 24 01:54:45.896949 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 631/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:45 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:46.027312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:46.028147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.035118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.035614 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.036051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.036772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.037355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.037849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.191575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:46.201407 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-23ddb00a-d37e-474a-912f-c3dc4dc50dbc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1473 microversion: 2.1 time: 0.178368 Aug 24 01:54:46.208765 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 632/1163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:46 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1473 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:46.265811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Updating instance_info_cache with network_info: [{"id": "5d4868d9-f929-49d6-9fd7-45cb56f28d60", "address": "fa:16:3e:ed:dc:77", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5d4868d9-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:46.279161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Releasing lock "refresh_cache-064fc829-3faa-4bb2-a7c0-c15583c44f54" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:54:46.280195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d233037-48e7-4647-a984-9d90cbc0ad09 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54/action" status: 202 len: 0 microversion: 2.1 time: 4.284461 Aug 24 01:54:46.281276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 532/1164] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:41 2022] POST /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54/action => generated 0 bytes in 4286 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 24 01:54:46.289059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:46.290079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.296674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.297203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.297643 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.298358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.298817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.299239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.325401 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:54:46.339808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:46.340523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.350457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.351350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.353121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.354124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.355335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.356015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.428920 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b4f3caa9-9157-4ec2-a315-f59692a8fbb4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 204 len: 0 microversion: 2.1 time: 0.143433 Aug 24 01:54:46.430322 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 633/1165] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:46 2022] DELETE /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 01:54:46.442441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.156"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:46.446217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.452262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.452803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.453244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.453944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.454388 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.455786 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.482113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:54:46.482519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquired lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:54:46.512489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:46.521415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c7601b4-956c-4523-bdcb-d037ba02a949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.185796 Aug 24 01:54:46.521997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 533/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:46 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:46.724924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:46.725531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.733749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.891993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:46.901789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ffa60cb-2212-4408-b0c3-be88f1e1a6c3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.180435 Aug 24 01:54:46.905168 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 534/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:46 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:46.909171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:46.909792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:46.920403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.921254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.921866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:46.923036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:46.923490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:46.924101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.070065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:47.079635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c78af07-dc99-48c0-bbce-c26d38745a70 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.175483 Aug 24 01:54:47.092824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 535/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:46 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:47.223477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:47.224004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:47.230180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.230674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.231738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.232455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.232942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.233371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.360619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:47.368909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b77c807-fe2c-4039-b33b-10da491a8e79 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1473 microversion: 2.1 time: 0.149380 Aug 24 01:54:47.369469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 536/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:47 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1473 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:47.419836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-unplugged", "status": "completed", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}, {"server_uuid": "f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd", "name": "network-vif-plugged", "status": "completed", "tag": "da72d336-8c09-4067-a0be-42d0db46325f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:47.430758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.431287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.431764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.445698 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Creating event network-vif-unplugged:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:54:47.446199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Creating event network-vif-plugged:da72d336-8c09-4067-a0be-42d0db46325f for instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd on n-h1-854121-3 Aug 24 01:54:47.451466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] Instance c18b9cf2-530a-4494-822a-95ede195093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:54:47.460488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ba1ffb28-041f-4670-a74b-afb903f6129b req-56185f75-8cbb-4d73-9f64-2776955674bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044209 Aug 24 01:54:47.461140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 537/1170] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:47.543443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:47.544144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:47.550333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.550824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.551267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.551969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.552427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.552897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.682690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:47.692145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:47.700031 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d60f4cde-11f8-4a48-a7b3-b6978e5d2709 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.161136 Aug 24 01:54:47.700592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 538/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:47 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:47.923711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:47.924327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:47.930362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.930846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.931285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:47.931980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:47.932434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:47.932887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.059553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:48.067198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e7a0544-f1b3-4f17-a8ea-df7f9a153cb3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.147782 Aug 24 01:54:48.067761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 539/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:47 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:48.100069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:48.100592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:48.102441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=22 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:48.107312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.107794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.108226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.108948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.109398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.109822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.245972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:48.253782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e30b7a17-1018-478c-9b78-bcfe866c2f4a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.157528 Aug 24 01:54:48.254348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 540/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:48 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:48.389888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:48.390694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:48.397821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.398414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.399500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.400254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.400798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.401287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.530651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:48.538542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35f85a72-1a09-4722-a8f9-848c1c6827ba tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1473 microversion: 2.1 time: 0.152456 Aug 24 01:54:48.552091 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 541/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:48 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1473 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:48.623641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Building network info cache for instance {{(pid=128566) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:48.631957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:48.642630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.643427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.644099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.656020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] Creating event network-changed:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:48.661528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1173ba0c-4018-4d0f-a6be-bf53b1516226 req-c0dafb59-6a0e-4e13-ba93-622ed62557f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033191 Aug 24 01:54:48.662437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 542/1175] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:48.721541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:48.722459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:48.728594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.729109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.729538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.730228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:48.730670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:48.731262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:48.883681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:48.892830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-323b818e-8e06-4544-9857-5437c65c4a8c tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.175356 Aug 24 01:54:48.893884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 543/1176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:48 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:49.091280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:49.092161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:49.100171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.101070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.102221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.103104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.103552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.104183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.438692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:49.457889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3efb4667-3c7c-4abc-a9c9-ff9e8331d6f8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.372984 Aug 24 01:54:49.464775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 544/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:49 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:49.464775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:49.464775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:49.470957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.471573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.472197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.472947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.473504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.474048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.587448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Updating instance_info_cache with network_info: [{"id": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76", "address": "fa:16:3e:8b:7a:1f", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3f12ba1c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128566) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:49.608398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Releasing lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:54:49.609488 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-22759abe-777d-4518-8273-49197daf3d90 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action" status: 202 len: 0 microversion: 2.1 time: 3.172964 Aug 24 01:54:49.611002 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 634/1178] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:46 2022] POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action => generated 0 bytes in 3175 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:54:49.618444 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:49.624706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:49.638155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.641797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.642616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.646182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.646882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.647437 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.717928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:49.730966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d9a5fb0-9ee7-41cb-bd6e-23db34b28dea tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.269986 Aug 24 01:54:49.731907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 545/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:49 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:49.740132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11ebed8d-7610-4225-880a-c678b4106893 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '.version_select at 0x7f6b92482c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:49.920264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:49.928851 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-10ebe049-8b9d-4cae-9139-b9836f4b3c8f tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1470 microversion: 2.1 time: 0.314962 Aug 24 01:54:49.930060 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 635/1180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:49 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1470 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:49.938437 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:49.939312 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:49.947650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.949033 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.949682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:49.950783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:49.951743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:49.952364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.210174 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11ebed8d-7610-4225-880a-c678b4106893 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/96ba6384-0aa5-409c-85eb-cac98b9c0e58" status: 200 len: 185 microversion: 2.1 time: 0.477232 Aug 24 01:54:50.214865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 546/1181] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:54:49 2022] GET /compute/v2.1/os-floating-ips/96ba6384-0aa5-409c-85eb-cac98b9c0e58 => generated 185 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:50.226826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:50.227875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:50.238114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.238606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.239040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.239738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.240191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.240613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.272963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:50.290237 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e9699fac-b8b9-4e16-8173-14ce666cb2cc tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.357069 Aug 24 01:54:50.291157 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 636/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:49 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:50.296827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.156"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:50.314711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.315498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.316115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.317058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.317681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.318513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.342030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:50.357733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:50.364269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:50.485668 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c806dde-f2bb-43e7-9e5a-6344ea30ff24 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d/action" status: 202 len: 0 microversion: 2.1 time: 0.268748 Aug 24 01:54:50.486441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 547/1183] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:50 2022] POST /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:50.490980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:50.494509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064fc829-3faa-4bb2-a7c0-c15583c44f54", "name": "network-vif-deleted", "tag": "5d4868d9-f929-49d6-9fd7-45cb56f28d60"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:50.499508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.500330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.501685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.503043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.504052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.504706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.507319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.508231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.508681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.526488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] Creating event network-vif-deleted:5d4868d9-f929-49d6-9fd7-45cb56f28d60 for instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 on n-h1-854121-3 Aug 24 01:54:50.533816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c2bac187-07cc-410d-aa18-108080f3f560 req-b0c674cf-4026-4e85-b9f0-94a7172056a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045787 Aug 24 01:54:50.534724 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 548/1184] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:50.543743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:50.544492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:50.552485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.552653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.553057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.553819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.554295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.555366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.706777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:50.716457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86985ad0-c79e-4498-b9af-4686538e5f7b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.177474 Aug 24 01:54:50.717359 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 549/1185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:50 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:50.722219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:50.723535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:50.735183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.735800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.736341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.737402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.737934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.738432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.759878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 01:54:50.760366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquired lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 01:54:50.887960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:50.896475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a87f495-f11a-40f5-8ceb-6a1d81a4a6f3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.177773 Aug 24 01:54:50.897104 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 550/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:50 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:50.901978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0681c016-7fbe-4d6b-8482-bb3a103eaf72", "tag": "8421e5b7-ae6d-42a4-9e88-aa13f339a133"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:50.918405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.919102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.919551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.942740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] Creating event network-changed:8421e5b7-ae6d-42a4-9e88-aa13f339a133 for instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 on n-h2-854121-3 Aug 24 01:54:50.948683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-de2db0bb-ea0b-4e2e-86e4-a200044806c7 req-6bcb9ae8-895e-40eb-9216-786b000cf3ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050128 Aug 24 01:54:50.949532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 551/1187] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:50.954606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:50.955498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:50.961566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.962045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.962473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:50.963189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:50.963637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:50.964065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.187783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:51.197545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ba5e2a8-e7f0-4379-877d-3c04cf5181de tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.246631 Aug 24 01:54:51.198294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 552/1188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:50 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:51.311766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:51.312371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:51.319261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.320012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.320608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.321203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.322469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.322894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.474392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:51.484430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-795edfac-8826-4f1a-ba9f-e9ee2e700883 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1321 microversion: 2.1 time: 0.176455 Aug 24 01:54:51.485310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 553/1189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:51 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:51.737153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:51.738143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:51.744134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.744596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.745057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.745739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.746186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.746602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.971867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:51.980645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-898529c0-d880-4546-a69e-cbea7d89cd91 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1503 microversion: 2.1 time: 0.247450 Aug 24 01:54:51.981634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 554/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:51 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:51.986612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:51.987297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:51.993185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.993872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.994575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:51.995355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:51.996016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:51.996614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.193010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:52.201833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-540ef55b-3c05-4cd8-ac4e-fea060e98c1c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.218982 Aug 24 01:54:52.216361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 555/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:51 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:52.219001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:52.219620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:52.225880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.226372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.226813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.227515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.228154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.229375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.447878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:52.456000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f397829-3318-4243-8d8f-8a246fe619cd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.241326 Aug 24 01:54:52.456905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 556/1192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:52 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:52.505027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:52.505719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:52.512801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.513287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.513716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.514408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.514861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.515278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.623942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Building network info cache for instance {{(pid=128566) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 01:54:52.690623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:52.700641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-007a1bc4-0116-4ab6-9cf1-680f0fc96791 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1512 microversion: 2.1 time: 0.199358 Aug 24 01:54:52.701873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 557/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:52 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:52.721393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:52.721998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:52.728489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.728991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.729845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.730108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.730560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.731361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.881627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:52.891970 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4e49226-9983-4bc4-b3fd-66d57534d8ff tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1512 microversion: 2.1 time: 0.174238 Aug 24 01:54:52.892981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 558/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:52 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:52.914635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:52.915544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:52.922528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.923018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.923660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:52.924812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:52.925468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:52.926094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.110342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.119732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ce62508-5e6e-449d-ad2a-cfa5c0d824c5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1513 microversion: 2.1 time: 0.210325 Aug 24 01:54:53.120317 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 559/1195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:52 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.126163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.126774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.129715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:53.137312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.138116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.138754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.139861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.140404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.140861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.283233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.291452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17db353f-d7e0-47b6-8bbf-c2f1d30d0f43 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1478 microversion: 2.1 time: 0.169924 Aug 24 01:54:53.292750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 560/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1478 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.296977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:53.307114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.307671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.308410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.319571 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] Creating event network-changed:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:54:53.325469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7f479ac2-8dee-4250-9c18-b470e09d064a req-998d4203-bd5b-41e4-a745-bd5a7362039d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031821 Aug 24 01:54:53.326229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 561/1197] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:53.333092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Updating instance_info_cache with network_info: [{"id": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76", "address": "fa:16:3e:8b:7a:1f", "network": {"id": "ea5724f0-2e92-4683-9895-186daec66f98", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-568307049-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "286485480bbf4d1a8615d338e1adfbed", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3f12ba1c-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128566) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 01:54:53.336495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-plugged", "status": "completed", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:53.341772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Releasing lock "refresh_cache-3dd2a166-0ca3-426b-be17-6637ae00ca80" {{(pid=128566) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 01:54:53.342631 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-165f74fc-dad3-468c-96c8-158ff24d4b91 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action" status: 202 len: 0 microversion: 2.1 time: 3.050536 Aug 24 01:54:53.343223 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 637/1198] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:50 2022] POST /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80/action => generated 0 bytes in 3052 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 01:54:53.347747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.348239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.348674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.352850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.357916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.358785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:53.361093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Creating event network-vif-plugged:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:54:53.366521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] Instance c18b9cf2-530a-4494-822a-95ede195093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:54:53.373270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-18d9d6e2-b090-461e-90a0-50d51304d327 req-a4ce2c6d-237a-4d63-b5c3-8bf772d793b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045757 Aug 24 01:54:53.373678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.374147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 562/1199] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:53.374287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.374581 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.375307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.375756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.376176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.378970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.379667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.385967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.386452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.386894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.387594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.388052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.388478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.472286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:53.524623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.533022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-462e68eb-315b-44d2-ba93-18b19c034dcb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.157727 Aug 24 01:54:53.533861 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 563/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.538547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5973576d-20fb-4e24-9cd0-c24acdadf65f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '.version_select at 0x7f6b9241c160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.542779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5973576d-20fb-4e24-9cd0-c24acdadf65f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.543336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5973576d-20fb-4e24-9cd0-c24acdadf65f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.543850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5973576d-20fb-4e24-9cd0-c24acdadf65f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.545774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:53.557011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5973576d-20fb-4e24-9cd0-c24acdadf65f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.022049 Aug 24 01:54:53.558103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 564/1201] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/os-migrations => generated 2729 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.563112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.563616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.571125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.571696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.572209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.573030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.573677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.574229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.588427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.591109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] HTTP exception thrown: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Request method failure captured: Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 HTTP/1.1 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYS2VhfC92zkqJaZARgzIV4uhB2H9x2aDsZd5ULvRaRHVGoLwpk-jnofvX_zmsF-C7eWS6B8uteQZlMO57zoCCu6Qj_2_XpSpWtt-45oZAVSCwz9hae_aX-9dI4zvD18139VSTZ7PvBS2RlXGdkF3AiKzNmrNkVDULCmhBpjIdL5Dvc Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: af4a3fc16bc34fb19f1621d4b065b8de Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '064fc829-3faa-4bb2-a7c0-c15583c44f54'} Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:53.592853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Returning 404 to user: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:53.597069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12df4b75-1153-496d-a046-18caf2f2ace4 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 404 len: 111 microversion: 2.1 time: 0.034998 Aug 24 01:54:53.599493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.599493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.599493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.599924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 565/1202] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:53 2022] DELETE /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:53.603570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.604190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.610449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.610927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.611631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.612329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.613367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.613818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.723853 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b106e7b-5b89-4986-a7f4-b683ca559343 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.375088 Aug 24 01:54:53.725047 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 638/1203] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.730476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.731400 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.737942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.739002 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.739788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.741428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.742155 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.742803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.770842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.779747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da8941db-f002-40ab-a140-6e7d9ba02314 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.180521 Aug 24 01:54:53.780692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 566/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.785449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.786213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 064fc829-3faa-4bb2-a7c0-c15583c44f54] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:53.793000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.793487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.793917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.795269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.795747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.796563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.812269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] HTTP exception thrown: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Request method failure captured: Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 HTTP/1.1 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYS2VhfC92zkqJaZARgzIV4uhB2H9x2aDsZd5ULvRaRHVGoLwpk-jnofvX_zmsF-C7eWS6B8uteQZlMO57zoCCu6Qj_2_XpSpWtt-45oZAVSCwz9hae_aX-9dI4zvD18139VSTZ7PvBS2RlXGdkF3AiKzNmrNkVDULCmhBpjIdL5Dvc Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: af4a3fc16bc34fb19f1621d4b065b8de Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '064fc829-3faa-4bb2-a7c0-c15583c44f54'} Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.813718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Returning 404 to user: Instance 064fc829-3faa-4bb2-a7c0-c15583c44f54 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffbb3f87-17f9-4a73-9c66-3771c1b64bca tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54" status: 404 len: 111 microversion: 2.1 time: 0.033377 Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 567/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/064fc829-3faa-4bb2-a7c0-c15583c44f54 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:54:53.822283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:53.825564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:53.826322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-981535983', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:53.832976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.833663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.834092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.834800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:53.835252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:53.836255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:53.882092 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f32fecf8-37d8-4325-b633-ac20e10ee405 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1629 microversion: 2.1 time: 0.155771 Aug 24 01:54:53.882690 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 639/1206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:53.896849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-914b9020-1807-4145-bcfc-8b1f31d584e0 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '.version_select at 0x7f6b922bc0d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.006427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:54.120745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.126552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.127025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.127459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.237783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e13684bd-3c20-41e4-876b-67c5f7536f26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-981535983" status: 200 len: 1515 microversion: 2.1 time: 0.421127 Aug 24 01:54:54.238569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 568/1207] 10.222.0.49 () {58 vars in 1261 bytes} [Wed Aug 24 01:54:53 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-981535983 => generated 1515 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:54.243540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12942c63-c701-43db-b0f1-160efe10d024 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: .version_select at 0x7f6b9241f790>, body: {"keypair": {"name": "tempest-keypair-782512612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaNAJt/0shFIDCw4IsGNcfKmFFreGdOeMJYwmv8lCX753E9AG6FjSlbtPGlmPPfU6VRaoiWvrJdGWUWYWtEMJB7HfjN9tMEz3YCFTMAdz61q6d5avF04bis6haP/cOncQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:54.260751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-12942c63-c701-43db-b0f1-160efe10d024 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for project 9b1ee336634941239acddd6889d6f2ea. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:54.264597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-12942c63-c701-43db-b0f1-160efe10d024 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for user 0aa9308751b9454b8d173b034f4b040b and project 9b1ee336634941239acddd6889d6f2ea. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:54.286699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12942c63-c701-43db-b0f1-160efe10d024 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047269 Aug 24 01:54:54.287298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 569/1208] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:54:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:54.291787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.296676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.297511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:54.302610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.303086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.303524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.304241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.304808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.305167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.410403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:54.482191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.489379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.489866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.490308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.666339 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-914b9020-1807-4145-bcfc-8b1f31d584e0 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/96ba6384-0aa5-409c-85eb-cac98b9c0e58" status: 202 len: 0 microversion: 2.1 time: 0.782201 Aug 24 01:54:54.667135 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 640/1209] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:54:53 2022] DELETE /compute/v2.1/os-floating-ips/96ba6384-0aa5-409c-85eb-cac98b9c0e58 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:54.672287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.672923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:54.678972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.680009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.680168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76a677e5-1d6e-4847-bef0-67e083543635 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 0.391144 Aug 24 01:54:54.680665 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 570/1210] 10.222.0.49 () {58 vars in 1173 bytes} [Wed Aug 24 01:54:54 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:54.681080 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.682008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.682789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.683285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.685575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.686071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:54.691977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.692460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.692939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.696881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.697374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.697807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.725774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:54:54.816036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45887b1e-56a2-4a44-b060-ecb492034d25 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 204 len: 0 microversion: 2.1 time: 0.133828 Aug 24 01:54:54.817588 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 571/1211] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:54:54 2022] DELETE /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:54:54.827316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.831950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.832400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.servers [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Removing options 'limit' from query {{(pid=128567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 01:54:54.833251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:54.838559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.838692 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.839137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.839566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.840312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.840804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.841232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.849026 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a36aeafb-c3b3-44ed-8292-e4cbb6d50f44 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.180233 Aug 24 01:54:54.849748 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 641/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:54 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:54.855336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:54.856189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:54.862446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.863173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.863861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.864749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.865214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.865838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:54.939181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:54.945349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:54.945828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:54.946256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.002027 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.009951 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-98b24926-4a56-482d-99b7-7838c4939f66 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.158915 Aug 24 01:54:55.010526 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 642/1213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:54 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.015035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.015645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:55.022896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.023436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.023954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.024667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.025156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.025586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.145910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b60be3a3-1712-4664-afb3-86c97aa34a26 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.322790 Aug 24 01:54:55.147089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 572/1214] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:54:54 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.158501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.169068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.169470 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-db2f495c-7781-483e-9247-994ca669621c tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1525 microversion: 2.1 time: 0.157850 Aug 24 01:54:55.171268 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 643/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.173797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.174487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.180340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.181138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.181404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.182398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.182881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.183922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.271492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:55.330599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6034ad16-04bc-4ebe-867b-eeeec06c2e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.165309 Aug 24 01:54:55.331178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 573/1216] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.345083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.349957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.350382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.compute.servers [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Removing options 'limit' from query {{(pid=128566) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 01:54:55.351043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.357057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.357615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.358159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.358921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.359378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.359805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.423520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:55.446144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:55.507131 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-63dae01e-1544-4489-855b-c839fcc9d38d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.166099 Aug 24 01:54:55.507748 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 644/1217] 10.222.0.49 () {58 vars in 1150 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.519271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.524312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.524989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.530553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.531033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.531471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.532189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.532646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.533100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.623207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:55.683223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e45d745-ea07-4980-b627-2dc58afedf58 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.167631 Aug 24 01:54:55.683827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 574/1218] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers => generated 1011 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:55.697489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.702220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.702890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.715514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.716005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.716441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.717202 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.717661 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.718088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.801981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:55.859880 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-515f54a9-3ebf-44a3-a0f8-74a790844958 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.166982 Aug 24 01:54:55.860577 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 645/1219] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:54:55.871463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.872410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.873074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:55.877137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.877511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.compute.servers [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Removing options 'limit' from query {{(pid=128566) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 01:54:55.878153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.879335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.879825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.880261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.880990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.881609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.882199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.883882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.884357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.884811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.885528 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.886793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.886793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.913376 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e06b86ac-4742-4029-9538-950c5337eb5b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.044522 Aug 24 01:54:55.914180 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 646/1220] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:55.925707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:55.930665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:55.931317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-981535983', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:54:55.936340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.936864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.937278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:55.937992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:55.938441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:55.938862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.020643 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:54:56.080769 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e44d7ad8-637b-4fe6-a73d-876ce4d07354 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-981535983" status: 200 len: 345 microversion: 2.1 time: 0.158550 Aug 24 01:54:56.081663 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 647/1221] 10.222.0.49 () {58 vars in 1240 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-981535983 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:54:56.087478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:56.088306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:56.091581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:56.097803 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:56.100356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd8525ad-72e6-4bfb-9648-3fb6b0f110c8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.233552 Aug 24 01:54:56.101256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 575/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:55 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:56.101863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.102358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.102815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.103983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.104435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.104898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.106446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:56.113272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.114044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.114704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.181364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 01:54:56.235010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fe03212-a40d-44db-b3f8-f67ce46ad2d3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "POST /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676/action" status: 202 len: 0 microversion: 2.1 time: 0.131812 Aug 24 01:54:56.236262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 576/1223] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:54:56 2022] POST /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:54:56.241847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:56.242834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:56.249845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.250826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.250936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.251579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.252198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.253226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.388833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:56.402707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3f3e994-68e9-4139-8cd8-9179498d1a4e tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1525 microversion: 2.1 time: 0.164550 Aug 24 01:54:56.403599 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 577/1224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:56 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:56.409611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1696359267", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8d282946-c6d2-446c-a4ca-e9e99e5e112e"}], "security_groups": [{"name": "tempest-securitygroup--257437066"}], "key_name": "tempest-keypair-782512612", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:54:56.421252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:56.430133 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6e533e8b-d7a4-4db1-8f4a-fb82a2da6f0f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.347179 Aug 24 01:54:56.430717 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 648/1225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:56 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:56.435325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:56.435933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:56.441915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.442404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.442842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.443533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.444106 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.444532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.529465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] validate_networks() for [('8d282946-c6d2-446c-a4ca-e9e99e5e112e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:54:56.575201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:56.582921 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6afe52ab-209c-4a1c-99cb-f97f47f38c6b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.151250 Aug 24 01:54:56.583498 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 649/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:56 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:56.901344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:54:56.901763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:54:56.902234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:54:56.902642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:54:56.903052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:54:56.911774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.912250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.912678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.913430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:56.913890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:56.914304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:56.930588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:54:56.934536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for user 0aa9308751b9454b8d173b034f4b040b and project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:54:56.946109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:54:56.948313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:54:56.993956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6c6a197-cdfd-4690-a901-ac042f43188d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.589341 Aug 24 01:54:56.994606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 578/1227] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:54:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:54:57.005434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-34b16fe3-0e2e-4c32-bf4f-bf20ef86254d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:57.006156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-34b16fe3-0e2e-4c32-bf4f-bf20ef86254d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:57.063062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-34b16fe3-0e2e-4c32-bf4f-bf20ef86254d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:57.070713 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-34b16fe3-0e2e-4c32-bf4f-bf20ef86254d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1234 microversion: 2.1 time: 0.068319 Aug 24 01:54:57.071282 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 650/1228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:57 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1234 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:57.123159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:57.123772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:57.130343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.130827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.131351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.131929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.133135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.133540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.269979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:57.273808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:54:57.279086 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-400c097f-e29f-43ad-8d07-8ab9f2ecda08 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.160231 Aug 24 01:54:57.279667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 579/1229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:57 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:57.423887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:57.424419 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:57.432199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.432884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.433326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.434031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.434520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.434978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.451875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:57.452749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:57.459819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.460196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.460636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.461363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.461868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.462273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.571717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:57.579706 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-875c7bd3-36d3-4753-a1fd-9dca0c1cd487 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1525 microversion: 2.1 time: 0.159911 Aug 24 01:54:57.580530 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 651/1230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:57 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:57.604271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:57.604908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:57.605315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:57.611450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.612231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.612976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:57.613655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c66119c-a431-4735-9fa9-1a217e80cbd0 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.165695 Aug 24 01:54:57.613790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:57.614478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:57.614625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 580/1231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:57 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:57.614785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.091348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:58.091957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:58.097901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.098388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.098830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.099517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.099969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.100388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.108194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:58.116335 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a14de5f8-52c2-4761-8654-f287f9bddf54 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.516728 Aug 24 01:54:58.116937 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 652/1232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:57 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:58.179805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:58.187368 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0966707a-9861-4cf3-87c4-6eaceacc0526 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1286 microversion: 2.1 time: 0.099839 Aug 24 01:54:58.187932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 581/1233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:58 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:58.300550 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:58.301290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:58.307797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.308279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.308731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.309422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.309897 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.310304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.445853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:58.453724 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-126ae481-2070-4122-b100-178d43c5b367 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.157024 Aug 24 01:54:58.454290 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 653/1234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:58 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:58.602056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:58.602674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:58.609217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.609397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.609807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.610531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.611892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.611892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.634995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:58.635617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:58.646222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.646755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.647215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.648478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:58.648982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:58.649413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:58.798215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:58.806791 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c5d3318f-c26c-4151-a30c-8929ae1fb318 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.175634 Aug 24 01:54:58.807360 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 654/1235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:58 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:54:58.833798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:58.843205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7067740-9974-4fdd-b780-68ceed6cd205 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1525 microversion: 2.1 time: 0.245689 Aug 24 01:54:58.844762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 582/1236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:58 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1525 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:59.138412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:59.139128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:59.145199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.145682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.146115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.146823 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.147254 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.147674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.209050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:59.210042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:59.217342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.218095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.218774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.219657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.221129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.221891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.289070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:59.298311 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-41e9e5d5-00ac-4141-be11-90e2641701ba tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.163799 Aug 24 01:54:59.313135 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 655/1237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:59 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:59.474738 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:59.475373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:59.482905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.483391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.483826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.484560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.485075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.485496 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.522530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:59.532822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27ab1f0a-cf1a-43aa-be74-4d938eab5a4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1292 microversion: 2.1 time: 0.325478 Aug 24 01:54:59.532822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 583/1238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:59 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:59.658259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:54:59.670864 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-01538fcb-941a-4c08-ba72-11b9d7756b6d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.199848 Aug 24 01:54:59.671794 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 656/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:59 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:54:59.827537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:59.828075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:59.835034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.835595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.836032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.836766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.837323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.837756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.864790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:54:59.865404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:54:59.872177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.872672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.873185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:54:59.873946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:54:59.874408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:54:59.874844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.165996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:00.174558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-758759fe-0751-47d8-8d6e-203db22c063e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.350606 Aug 24 01:55:00.175643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 584/1240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:59 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:00.325282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:00.327259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:00.342070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.343493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.344053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.346965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.349923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.350490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.388740 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:00.397541 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-597d1cba-2e6e-4490-afca-a74883864062 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1525 microversion: 2.1 time: 0.536670 Aug 24 01:55:00.410799 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 657/1241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:54:59 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1525 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:00.551468 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:00.552083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:00.558999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.559752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.560361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.561331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.561790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.562440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.656404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:00.665389 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2a0eaad-5183-43f2-8637-e9f5738d8b9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.349798 Aug 24 01:55:00.665961 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 585/1242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:00 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:00.691499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:00.692170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:00.699353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.699940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.700559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.701466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:00.701933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:00.702364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:00.793367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:00.803597 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-78535697-9e29-492b-a18c-8b359bab777b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.256036 Aug 24 01:55:00.804380 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 658/1243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:00 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:00.968196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:00.969793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dd2a166-0ca3-426b-be17-6637ae00ca80", "name": "network-vif-deleted", "tag": "3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:00.979205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b209338b-6fa1-4fbc-b71d-13ff1f32d7a0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1469 microversion: 2.1 time: 0.289589 Aug 24 01:55:00.979844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 586/1244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:00 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:01.002648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.003516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.004180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.024177 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] Creating event network-vif-deleted:3f12ba1c-c5bd-4e9b-bacf-6fdad53c3c76 for instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 on n-h2-854121-3 Aug 24 01:55:01.034799 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-037a9969-6c8f-46ac-acd2-26c893d556a6 req-c07fc8ef-9d0b-4ae6-9dca-a51d3860dc2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069959 Aug 24 01:55:01.036197 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 659/1245] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:01.088476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:01.103186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.103867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.104475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.119624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] Creating event network-changed:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h1-854121-3 Aug 24 01:55:01.124509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4ab12dd3-ece1-4076-a5e1-0f51b49b31cc req-59650ff5-e6ed-420f-a0ad-f931907e656b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040867 Aug 24 01:55:01.125138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 587/1246] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:01.196410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:01.197089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:01.204279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.204809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.205260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.205972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.207024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.207024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.422214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:01.423130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:01.437327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.437879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.438370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.439099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.439561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.439996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.493078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:01.501757 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5a2ca9aa-0680-468a-afe7-6b349a18006d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.309900 Aug 24 01:55:01.502341 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 660/1247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:01 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:01.532472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.533006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.533452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.533915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lazy-loading 'fault' on Instance uuid 3dd2a166-0ca3-426b-be17-6637ae00ca80 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:01.607700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681c016-7fbe-4d6b-8482-bb3a103eaf72", "name": "network-vif-plugged", "status": "completed", "tag": "8421e5b7-ae6d-42a4-9e88-aa13f339a133"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:01.617511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:01.624658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.625239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.625932 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.629887 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d8952a4-09be-4c2d-8a32-fa4361499f77 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1313 microversion: 2.1 time: 0.212325 Aug 24 01:55:01.639985 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] Creating event network-vif-plugged:8421e5b7-ae6d-42a4-9e88-aa13f339a133 for instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 on n-h2-854121-3 Aug 24 01:55:01.644565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 588/1248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:01 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:01.646363 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-2296fd5c-52cb-440e-bd16-b25c971b11ea req-0f9452a2-7da9-464c-aef4-bb91e84a0d63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045370 Aug 24 01:55:01.660299 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 661/1249] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:01.686108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:01.687154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:01.694081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.695249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.695906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.696995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.698000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.698646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.837382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:01.838451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:01.862572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.863398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.864214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.865927 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:01.866698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:01.867344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:01.951534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:01.962026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-150e923f-91ea-4e05-8563-e62214ec1807 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.279693 Aug 24 01:55:01.976979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 589/1250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:01 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:02.005003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:02.010567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:02.025155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.025759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.026573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.027910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.029760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.030780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.113762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:02.117158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:02.124008 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8c2744d6-d422-4461-a55f-246eaa5fbab3 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.302378 Aug 24 01:55:02.124870 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 662/1251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:01 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:02.167426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:02.175078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96326abb-5c3b-4ddf-9a0d-9997574308d3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.174320 Aug 24 01:55:02.175677 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 590/1252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:01 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:02.526464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:02.527078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:02.532847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.533331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.533762 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.534455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.534903 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.535322 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.651427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:02.652047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:02.654115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:02.659400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.659890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.660333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.661065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.661530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.661957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.665809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:02.673672 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7593ee69-b3ee-4faf-b7b7-1359c0569667 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.151002 Aug 24 01:55:02.674239 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 663/1253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:02 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:02.695549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.695987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.696436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.696919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lazy-loading 'fault' on Instance uuid 3dd2a166-0ca3-426b-be17-6637ae00ca80 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:02.736661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:02.745311 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-397e5edd-1867-43ab-94b1-6ad2bb00b34d tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1313 microversion: 2.1 time: 0.097921 Aug 24 01:55:02.745876 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 591/1254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:02 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:02.982934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:02.983646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:02.989897 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.990469 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.990979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:02.992428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:02.992984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:02.993481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.124611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:03.132276 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-da8e6ab6-2df9-4217-a856-15adb03d6c16 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.153405 Aug 24 01:55:03.132859 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 664/1255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:02 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:03.145657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:03.146342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:03.153268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.153750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.154190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.154877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.155333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.155758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.195778 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:03.196380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:03.202709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.203133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.203567 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.204264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.204779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.205239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.286249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:03.294548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b61f86bb-3376-4aa9-a295-0554ac642d33 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.152773 Aug 24 01:55:03.295116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 592/1256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:03 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:03.334759 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:03.343028 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-119146f0-f719-47af-a6b7-965e8e873382 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.151394 Aug 24 01:55:03.343589 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 665/1257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:03 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:03.695470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:03.696356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:03.703125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.704993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.705601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.706486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.707223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.707663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.767177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:03.767965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:03.776252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.777054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.777645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.778645 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.779026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.779450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.816288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:03.819024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:03.820212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:03.820856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lazy-loading 'fault' on Instance uuid 3dd2a166-0ca3-426b-be17-6637ae00ca80 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:03.873277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:03.874978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af4a3fc16bc34fb19f1621d4b065b8de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286485480bbf4d1a8615d338e1adfbed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:03.883832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-408d4ea2-e1c9-4dab-825f-0a61f2405673 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1313 microversion: 2.1 time: 0.192905 Aug 24 01:55:03.888450 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-32d35c8c-fd75-47f3-8555-24f3c5f3bfed tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 200 len: 1313 microversion: 2.1 time: 0.126206 Aug 24 01:55:03.889255 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 666/1258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:03 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 1313 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:03.893101 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 593/1259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:03 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:04.154926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:04.155548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:04.168220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.168776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.169242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.170605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.171061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.171488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.316132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:04.316816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:04.316946 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:04.324312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.324829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.325267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.325574 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-202cfd18-3482-4879-8f90-69e1c78139be tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.175785 Aug 24 01:55:04.325970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.326487 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 667/1260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:04 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:04.329058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.329589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.365948 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:04.366725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:04.372853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.373428 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.373934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.376783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.376783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.376783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.469557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:04.477631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7786aa4-58d9-469e-be85-b298315d101f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.166049 Aug 24 01:55:04.478282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 594/1261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:04 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:04.545777 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:04.553468 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-18492962-81c6-46ad-814e-e2c4fafdddf3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.191532 Aug 24 01:55:04.554058 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 668/1262] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:04 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:04.908914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:04.909658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] [instance: 3dd2a166-0ca3-426b-be17-6637ae00ca80] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:04.911833 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:04.912480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:04.915798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.916283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.916741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.917447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.917910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.918339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.919373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.919867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.920307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.921027 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:04.921489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:04.921916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:04.932197 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] HTTP exception thrown: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Request method failure captured: Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 HTTP/1.1 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYS2VhfC92zkqJaZARgzIV4uhB2H9x2aDsZd5ULvRaRHVGoLwpk-jnofvX_zmsF-C7eWS6B8uteQZlMO57zoCCu6Qj_2_XpSpWtt-45oZAVSCwz9hae_aX-9dI4zvD18139VSTZ7PvBS2RlXGdkF3AiKzNmrNkVDULCmhBpjIdL5Dvc Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_286485480bbf4d1a8615d338e1adfbed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 286485480bbf4d1a8615d338e1adfbed Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-365419873 Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: af4a3fc16bc34fb19f1621d4b065b8de Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-365419873-project Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3dd2a166-0ca3-426b-be17-6637ae00ca80'} Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:04.933878 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] Returning 404 to user: Instance 3dd2a166-0ca3-426b-be17-6637ae00ca80 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d429d2b-e13f-4a34-8556-c4ead7cd7e88 tempest-FloatingIPsAssociationTestJSON-365419873 tempest-FloatingIPsAssociationTestJSON-365419873-project] 10.222.0.49 "GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80" status: 404 len: 111 microversion: 2.1 time: 0.030361 Aug 24 01:55:04.938160 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 595/1263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:04 2022] GET /compute/v2.1/servers/3dd2a166-0ca3-426b-be17-6637ae00ca80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:55:05.054813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:05.062515 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4884267a-f81a-4be4-acdd-81cc474a4c1a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1462 microversion: 2.1 time: 0.154451 Aug 24 01:55:05.063168 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 669/1264] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:04 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1462 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:05.201840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:05.207132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'deleted': False, 'project_id': '4ee9f0798b4e4c2fb4dd13de82cf66da'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:05.213365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.213949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.214458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.215282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.215975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.216479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.259361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-490d41f8-f6b0-48e3-ae37-09b1bf6d533e tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.178567 Aug 24 01:55:05.259933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 596/1265] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:55:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:55:05.278712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:05.285678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'deleted': False} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:05.292401 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.292994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.293500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.294509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.295180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.295779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.318911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-unplugged", "status": "completed", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:05.337652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.338442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.339045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.355358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Creating event network-vif-unplugged:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:55:05.364131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] Instance c18b9cf2-530a-4494-822a-95ede195093d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:55:05.371876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9c07bdce-a84b-4aca-8cf2-d2e9722df3d9 req-f629a8c7-8f26-4d97-ba7d-96e09e391370 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059161 Aug 24 01:55:05.373365 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 597/1266] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:05.379404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:05.380393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:05.387882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.388899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.389526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.390409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.391028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.391811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.405623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:05.433035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:05.517513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.518009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.518446 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.806891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:05.815753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f806f854-0e91-45b9-8109-04a3df6c426e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.441009 Aug 24 01:55:05.816676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 598/1267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:05 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:05.821559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:05.822237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:05.828318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.829099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.829609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.830382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.830910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.831405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.876911 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fad8da7f-b12f-4ccb-b535-096f20bf1f89 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 28216 microversion: 2.1 time: 0.601653 Aug 24 01:55:05.877576 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 670/1268] 10.222.0.49 () {58 vars in 1171 bytes} [Wed Aug 24 01:55:05 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 28216 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:55:05.882132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:05.882783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:05.897824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.898320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.898826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:05.900098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:05.900098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:05.900500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.031359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:06.040137 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8d396872-c5bb-47d2-974b-5d7bcaf80364 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.161556 Aug 24 01:55:06.040828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:06.040973 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 671/1269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:05 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:06.045310 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.050855 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'deleted': False, 'project_id': '4ee9f0798b4e4c2fb4dd13de82cf66da'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:06.056452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.056639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2c0b642-d03b-4926-9398-dbc500cfe5a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.238911 Aug 24 01:55:06.057438 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.057587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.057757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 599/1270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:05 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:06.058429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.058945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.059436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.150634 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-12d85884-2269-4520-849f-51bb995db3a8 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?tenant_id=17768302608445dda904cd4791e1a0ba" status: 200 len: 15 microversion: 2.1 time: 0.108628 Aug 24 01:55:06.151238 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 672/1271] 10.222.0.49 () {58 vars in 1231 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/detail?tenant_id=17768302608445dda904cd4791e1a0ba => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:55:06.170121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.176536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'tenant_id': '17768302608445dda904cd4791e1a0ba', 'deleted': False} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:06.181630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.182218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.182756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.183957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.184504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.185089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.216229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:06.301554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.302073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.302519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.320384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.321026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:06.327476 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.327970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.328422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.329142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.329779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.330378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.471888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:06.485211 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-968f8762-a3c3-4d00-ae18-c5829e8bb355 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 2343 microversion: 2.25 time: 0.168793 Aug 24 01:55:06.485786 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 673/1272] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 2343 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:06.506611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-486e5e35-d300-49d7-9d9c-f4d4c9552810 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=17768302608445dda904cd4791e1a0ba" status: 200 len: 4824 microversion: 2.1 time: 0.340070 Aug 24 01:55:06.507632 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.508178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 600/1273] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=17768302608445dda904cd4791e1a0ba => generated 4824 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:06.510934 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:55:06.510934 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:55:06.512255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.512844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.513289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.515192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.515192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.515192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.531269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.537425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'tenant_id': '4ee9f0798b4e4c2fb4dd13de82cf66da', 'deleted': False} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:06.539679 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cc825668-1319-4c49-8fc3-1f1f5a38f686 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036471 Aug 24 01:55:06.540282 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 674/1274] 10.222.0.49 () {60 vars in 1217 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 01:55:06.542617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.543096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.543535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.544252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.544727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.545154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.574012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-453a3488-17c0-4a41-9f89-c0b95dbf7020 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ee9f0798b4e4c2fb4dd13de82cf66da" status: 200 len: 15 microversion: 2.1 time: 0.046388 Aug 24 01:55:06.574592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 601/1275] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4ee9f0798b4e4c2fb4dd13de82cf66da => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 01:55:06.595564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64cc244e-b5c1-4d78-9e22-abda4d0eed26 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.601447 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64cc244e-b5c1-4d78-9e22-abda4d0eed26 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009928 Aug 24 01:55:06.601978 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 675/1276] 10.222.0.49 () {58 vars in 1189 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:55:06.621305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:06.623476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:06.629581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.630064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.630501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.631203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.631623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.632656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.707529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-118b7053-71cb-4175-aad5-9c703bd202d9 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.089738 Aug 24 01:55:06.712200 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 602/1277] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:06 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:06.717669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.722594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:06.723515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '17768302608445dda904cd4791e1a0ba'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:06.728676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.729197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.729610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.730343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.730796 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.731218 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.820890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:06.838435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:06.839188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:06.851325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.851828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.852269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.852999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.853462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.853866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.915792 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-67a159e9-c338-42a7-adaa-33fc4f23b4e4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.201721 Aug 24 01:55:06.917063 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 676/1278] 10.222.0.49 () {58 vars in 1150 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:06.928517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:06.933633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:06.942026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.943175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.944140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:06.947888 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:06.948598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:06.949285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.054656 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0d603801-f8a1-4b04-9c39-b6804cf417e4 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.129802 Aug 24 01:55:07.057197 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 677/1279] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:06 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:07.064075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:07.064742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:07.071674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.072176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.072618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.073381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.073836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.074261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.119774 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:07.148106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:07.158617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0589222-9dd2-4975-b9a5-75f4827eb738 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.324096 Aug 24 01:55:07.159557 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 603/1280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:06 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:07.166504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:07.167137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:07.182630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.184967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.185420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.188031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.202301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.202830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.319959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:07.331504 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0869531f-878d-4cae-a09e-4edb20155d26 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.272941 Aug 24 01:55:07.332446 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 678/1281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:07 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:07.338410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:07.339007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:07.346326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.346894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.347454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.348470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.349210 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.349682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.514413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0788248-f570-48a6-83d5-b70330602023 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1614 microversion: 2.1 time: 0.350488 Aug 24 01:55:07.521123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 604/1282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:07 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1614 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:07.543999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:07.544950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:07.548366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:07.551674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.555723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.557472 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2497100d-92a9-4ebc-b825-12ba9941854f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.223886 Aug 24 01:55:07.558055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.558450 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 679/1283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:07 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:07.559244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.560516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.561798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.821375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0472be5-207c-41e9-917e-88964d4401b6 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1614 microversion: 2.1 time: 0.281130 Aug 24 01:55:07.822671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 605/1284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:07 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1614 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:07.842300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:07.849554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'host': 'n-h2-854121-3', 'deleted': False} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:07.855157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.855721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.856228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.857073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:07.857596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:07.859263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:07.972619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:08.056492 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-718863f3-13b3-4bb2-8198-7ca22bfbab60 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=n-h2-854121-3&all_tenants=1" status: 200 len: 2965 microversion: 2.1 time: 0.217977 Aug 24 01:55:08.057462 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 680/1285] 10.222.0.49 () {58 vars in 1190 bytes} [Wed Aug 24 01:55:07 2022] GET /compute/v2.1/servers?host=n-h2-854121-3&all_tenants=1 => generated 2965 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:08.070938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:08.077122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:08.082035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.082718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.083340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.084509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.085984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.086635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.179366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a041e288-6aa5-4029-b626-c56169d4eed5 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.112674 Aug 24 01:55:08.180338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 606/1286] 10.222.0.49 () {58 vars in 1196 bytes} [Wed Aug 24 01:55:08 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:55:08.182511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:08.183186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.190176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.190952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.191153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.191906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.192215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:08.192384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.192844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.196595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.204944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.205540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.206054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.206907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.207441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.207963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.293689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84d52402-f90d-4068-8483-46ef99e5da74 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.105554 Aug 24 01:55:08.294333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 607/1287] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:08 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:08.302790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:08.307202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.317213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.317910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.318346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.319057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.319529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.320366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.403202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:55:08.403865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:55:08.404542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:55:08.405232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:55:08.405871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:55:08.412365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:08.423171 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-253b61a4-7c45-4a38-bcce-85ee405e152e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.244646 Aug 24 01:55:08.439857 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 681/1288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:08 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:08.451205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:08.451912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.462194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.462763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.467421 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.468201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.468753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.476939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.560929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.570614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.571465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.574083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.575383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.576103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.576834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.674552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8dd31ad0-7128-45ec-a288-8cadb84ac05f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 1067 microversion: 2.1 time: 0.374639 Aug 24 01:55:08.677776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 608/1289] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:08 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 1067 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 01:55:08.688110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:08.688746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.706366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.708197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.712783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.712783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.712783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.715660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.811980 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:08.834850 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fd050cdd-cb47-45b3-a381-86d137564917 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1535 microversion: 2.1 time: 0.393828 Aug 24 01:55:08.836614 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 682/1290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:08 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1535 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:08.844258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:08.845726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:08.859402 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.861181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.864124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.865061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:08.865680 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:08.866314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:08.899156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:08.906695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b11f2308-ae7f-473e-992a-15194a2fe8fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.227808 Aug 24 01:55:08.911670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 609/1291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:08 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:09.143303 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:09.155331 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d97278af-02b4-49bc-97ae-ea0d689b5b7b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.314474 Aug 24 01:55:09.156517 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 683/1292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:08 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:09.443521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:09.445224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:09.458044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.458758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.462891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:09.463835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.464528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.465145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:09.514203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:09.605600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61d9bc83-fe5d-4829-8797-49b07f7f0bb6", "device": "/dev/xvdb"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:09.608852 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:09.624243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.626534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.626992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:09.629950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.630439 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.631785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:09.771542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:09.781974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d4288b8-a079-4126-978b-4dddab6738f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.342291 Aug 24 01:55:09.783333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 610/1293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:09 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:09.860822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:09.861465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:09.867705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.868199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.868633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:09.869352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:09.869805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:09.870347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.007272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:10.015242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dc53037-b75a-40e9-8beb-1ffab3305656 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1528 microversion: 2.1 time: 0.158252 Aug 24 01:55:10.015825 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 611/1294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:09 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1528 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:10.020513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:10.021230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:10.041277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.042587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.043033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.043752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.044210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.044636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.247307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:10.256817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43f6eab4-d80e-4a63-845d-1b43d464da69 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.239689 Aug 24 01:55:10.257959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 612/1295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:10 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:10.277744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:10.278548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:10.291402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.292820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.293501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.294258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.294735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.295170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.309327 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-08291d97-e86f-4240-88d4-0402b2cf97ba tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.708465 Aug 24 01:55:10.310066 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 684/1296] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 24 01:55:09 2022] POST /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:55:10.315816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:10.316585 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:10.324381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.325090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.325623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.326589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.328603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.329385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.481429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:10.485907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:10.490705 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dd2b0418-eada-4743-b5d2-ffe5cee46121 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.179423 Aug 24 01:55:10.492156 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 685/1297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:10 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:10.496190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a428f68-00d7-43d6-a4a0-386802c88213 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1528 microversion: 2.1 time: 0.237183 Aug 24 01:55:10.496954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "name": "network-vif-plugged", "status": "completed", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:10.507406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.507982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.508507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.512499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 613/1298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:10 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1528 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:10.518869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a8bf46e-a0f3-4044-92a8-3e2f4a13bf58 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:10.519723 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:55:10.519723 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:55:10.521800 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] Creating event network-vif-plugged:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h1-854121-3 Aug 24 01:55:10.526822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1a8bf46e-a0f3-4044-92a8-3e2f4a13bf58 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] HTTP exception thrown: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a8bf46e-a0f3-4044-92a8-3e2f4a13bf58 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Request method failure captured: Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/flavors/f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a HTTP/1.1 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQGpOmY5ObA1EX0Y9dKrRb0hMe8WJFxr-KAD_nvcJ5sePtnMfuVwNZXBb6Ao7WnMHNkmS4Vjb9yX2eH_ESNdb69HpNIJIOsjakd7ZPOYUAoiD3uD-T__wD9n6ZNqOB7TtHvBKzu8l6Em-9Fe-xAbNTIURXlk3VIcqXE_DGWPCczmuU Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 24eff4cc6b584b03a5964b39852a8214 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MigrationsAdminTest-1800917752 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/24eff4cc6b584b03a5964b39852a8214"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/24eff4cc6b584b03a5964b39852a8214"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/24eff4cc6b584b03a5964b39852a8214"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_24eff4cc6b584b03a5964b39852a8214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MigrationsAdminTest-1800917752 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 24eff4cc6b584b03a5964b39852a8214 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MigrationsAdminTest-1800917752 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MigrationsAdminTest-1800917752-project-admin Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 714604146ea24ed6a1be55a4c1ef50a2 Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MigrationsAdminTest-1800917752-project-admin Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: exception: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a'} Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:10.528131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a8bf46e-a0f3-4044-92a8-3e2f4a13bf58 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Returning 404 to user: Flavor f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:10.533488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a8bf46e-a0f3-4044-92a8-3e2f4a13bf58 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a" status: 404 len: 109 microversion: 2.1 time: 0.015616 Aug 24 01:55:10.534127 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-6d99dc31-e1af-4247-b276-549a5a9f8302 req-a6a5be59-013b-40ec-bda2-f20ea4b0c64b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036291 Aug 24 01:55:10.534210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 614/1299] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:10 2022] DELETE /compute/v2.1/flavors/f09cc7e5-dd42-4797-aa96-ca7fbd7dd45a => generated 109 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:55:10.537786 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 686/1300] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:10.644497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1468058687", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:10.703694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:55:10.805604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:10.806316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:10.813207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.813813 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.814252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.814953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:10.815409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:10.815831 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:10.974515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:10.983079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:55:10.983604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:55:10.983706 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-51dfd872-9dbd-4697-805e-10300dcbae81 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.183783 Aug 24 01:55:10.983964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:55:10.984185 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 687/1301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:10 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:10.995051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:55:10.995676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:55:11.008193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.008862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.009241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.010227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.010723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.011264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.030166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:55:11.035285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Getting quotas for user 665536bfd6424ee3a0afc0fc92572319 and project 340bc32a8aa54ad98abc20aa8d137da2. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:55:11.048215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:55:11.050561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:55:11.098913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d543c3ae-6ed3-4966-b73d-730ab940cd04 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458480 Aug 24 01:55:11.105526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 615/1302] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:55:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:55:11.112142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e0b1487-3e1e-4886-8957-2658990d5ede tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.112972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e0b1487-3e1e-4886-8957-2658990d5ede tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:11.165957 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64e37abf-529b-47e1-8687-409b1fdd9e13 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.161614 Aug 24 01:55:11.166264 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 688/1303] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 01:55:11.175296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbf3fd02-3baf-4d76-83d8-ffde85592012 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Calling method '.version_select at 0x7f6b91aa13a0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.192389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e0b1487-3e1e-4886-8957-2658990d5ede tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:11.200503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e0b1487-3e1e-4886-8957-2658990d5ede tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1213 microversion: 2.1 time: 0.092906 Aug 24 01:55:11.201242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 616/1304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:11 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:11.246710 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-bbf3fd02-3baf-4d76-83d8-ffde85592012 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] HTTP exception thrown: Image not found. Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbf3fd02-3baf-4d76-83d8-ffde85592012 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Request method failure captured: Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYT-Eq7hnnncA7wi2cDbHkvhWY5ma4rFg6C5pTIIxhe4r0JUF0q6gcHucZqgyxc1RK7Uc5p2C-OuvFBT5Guu94gUu3GcIakyEEdeKWbsr-Xj0WgfGoA8xTzHxWxCfR4ohjqlfb5Qo7x4rmGVPetmkRZ-K9hWMCPnWMXGwmlg04P-sXo Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: e21f2b843346441bbaaa21484c7ca2c0 Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: exception: Image not found. Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '-1'} Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.258753 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbf3fd02-3baf-4d76-83d8-ffde85592012 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Returning 404 to user: Image not found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bbf3fd02-3baf-4d76-83d8-ffde85592012 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.089208 Aug 24 01:55:11.264167 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 689/1305] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 01:55:11.270100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7188278-9c3e-4366-95fa-f50a0257d6e4 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Calling method '.version_select at 0x7f6b924bac10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.279442 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.280171 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:11.288621 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.289386 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.290416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.291494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.292169 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.292805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.300281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f7188278-9c3e-4366-95fa-f50a0257d6e4 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] HTTP exception thrown: Image not found. Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7188278-9c3e-4366-95fa-f50a0257d6e4 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Request method failure captured: Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/759d3a58-9f1b-497e-b12d-f1d07e3062aj HTTP/1.1 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYT-Eq7hnnncA7wi2cDbHkvhWY5ma4rFg6C5pTIIxhe4r0JUF0q6gcHucZqgyxc1RK7Uc5p2C-OuvFBT5Guu94gUu3GcIakyEEdeKWbsr-Xj0WgfGoA8xTzHxWxCfR4ohjqlfb5Qo7x4rmGVPetmkRZ-K9hWMCPnWMXGwmlg04P-sXo Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e21f2b843346441bbaaa21484c7ca2c0 Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '759d3a58-9f1b-497e-b12d-f1d07e3062aj'} Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 759d3a58-9f1b-497e-b12d-f1d07e3062aj to delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 759d3a58-9f1b-497e-b12d-f1d07e3062aj could not be found. Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.303964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7188278-9c3e-4366-95fa-f50a0257d6e4 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7188278-9c3e-4366-95fa-f50a0257d6e4 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/759d3a58-9f1b-497e-b12d-f1d07e3062aj" status: 404 len: 62 microversion: 2.1 time: 0.039237 Aug 24 01:55:11.310495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 617/1306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/759d3a58-9f1b-497e-b12d-f1d07e3062aj => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:55:11.317172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c326b30-8c88-44f0-8a22-67138c48a857 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Calling method '.version_select at 0x7f6b9249e3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.336675 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2c326b30-8c88-44f0-8a22-67138c48a857 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] HTTP exception thrown: Image not found. Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c326b30-8c88-44f0-8a22-67138c48a857 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Request method failure captured: Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/d020b62f-88b1-4fe6-ae1d-059961d9f0f41 HTTP/1.1 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYT-Eq7hnnncA7wi2cDbHkvhWY5ma4rFg6C5pTIIxhe4r0JUF0q6gcHucZqgyxc1RK7Uc5p2C-OuvFBT5Guu94gUu3GcIakyEEdeKWbsr-Xj0WgfGoA8xTzHxWxCfR4ohjqlfb5Qo7x4rmGVPetmkRZ-K9hWMCPnWMXGwmlg04P-sXo Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e21f2b843346441bbaaa21484c7ca2c0 Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd020b62f-88b1-4fe6-ae1d-059961d9f0f41'} Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d020b62f-88b1-4fe6-ae1d-059961d9f0f41 to delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d020b62f-88b1-4fe6-ae1d-059961d9f0f41 could not be found. Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.338449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c326b30-8c88-44f0-8a22-67138c48a857 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:11.342742 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c326b30-8c88-44f0-8a22-67138c48a857 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/d020b62f-88b1-4fe6-ae1d-059961d9f0f41" status: 404 len: 62 microversion: 2.1 time: 0.031162 Aug 24 01:55:11.344569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 618/1307] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/d020b62f-88b1-4fe6-ae1d-059961d9f0f41 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:55:11.353062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-740b569f-add0-4e9d-82fd-a0942a082662 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Calling method '.version_select at 0x7f6b924ba310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.384736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-740b569f-add0-4e9d-82fd-a0942a082662 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] HTTP exception thrown: Image not found. Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-740b569f-add0-4e9d-82fd-a0942a082662 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Request method failure captured: Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/tempest-invalid-2059469691 HTTP/1.1 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYT-Eq7hnnncA7wi2cDbHkvhWY5ma4rFg6C5pTIIxhe4r0JUF0q6gcHucZqgyxc1RK7Uc5p2C-OuvFBT5Guu94gUu3GcIakyEEdeKWbsr-Xj0WgfGoA8xTzHxWxCfR4ohjqlfb5Qo7x4rmGVPetmkRZ-K9hWMCPnWMXGwmlg04P-sXo Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e21f2b843346441bbaaa21484c7ca2c0 Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'tempest-invalid-2059469691'} Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2059469691 to delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2059469691 could not be found. Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.386515 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-740b569f-add0-4e9d-82fd-a0942a082662 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-740b569f-add0-4e9d-82fd-a0942a082662 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/tempest-invalid-2059469691" status: 404 len: 62 microversion: 2.1 time: 0.039573 Aug 24 01:55:11.391426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 619/1308] 10.222.0.49 () {58 vars in 1206 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/tempest-invalid-2059469691 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 01:55:11.400056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b196bc8-154e-45a0-85b2-c94faed6c167 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Calling method '.version_select at 0x7f6b929dc9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.460226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4b196bc8-154e-45a0-85b2-c94faed6c167 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] HTTP exception thrown: Image not found. Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b196bc8-154e-45a0-85b2-c94faed6c167 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Request method failure captured: Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/160992fd-e8de-4ee3-932d-b17a9d7bfa71 HTTP/1.1 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYT-Eq7hnnncA7wi2cDbHkvhWY5ma4rFg6C5pTIIxhe4r0JUF0q6gcHucZqgyxc1RK7Uc5p2C-OuvFBT5Guu94gUu3GcIakyEEdeKWbsr-Xj0WgfGoA8xTzHxWxCfR4ohjqlfb5Qo7x4rmGVPetmkRZ-K9hWMCPnWMXGwmlg04P-sXo Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3cf1350308094b6b928b4e8113733cd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 3cf1350308094b6b928b4e8113733cd3 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e21f2b843346441bbaaa21484c7ca2c0 Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1700490593-project Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '160992fd-e8de-4ee3-932d-b17a9d7bfa71'} Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 160992fd-e8de-4ee3-932d-b17a9d7bfa71 to delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 160992fd-e8de-4ee3-932d-b17a9d7bfa71 could not be found. Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.462059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b196bc8-154e-45a0-85b2-c94faed6c167 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b196bc8-154e-45a0-85b2-c94faed6c167 tempest-ImagesDeleteNegativeTestJSON-1700490593 tempest-ImagesDeleteNegativeTestJSON-1700490593-project] 10.222.0.49 "DELETE /compute/v2.1/images/160992fd-e8de-4ee3-932d-b17a9d7bfa71" status: 404 len: 62 microversion: 2.1 time: 0.067365 Aug 24 01:55:11.466450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 620/1309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:11 2022] DELETE /compute/v2.1/images/160992fd-e8de-4ee3-932d-b17a9d7bfa71 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:55:11.515187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:11.516135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:11.526268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.527135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.527836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.529520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:11.530153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:11.530761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:11.555984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:11.565975 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a8f28980-5c93-4e6e-92a1-72e17504f43e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1359 microversion: 2.1 time: 0.290683 Aug 24 01:55:11.583287 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 690/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:11 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:11.692248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:11.702017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba00e2c3-833e-4d02-bcaf-a040ec0494cb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.193254 Aug 24 01:55:11.703238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 621/1311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:11 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:12.006410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:12.007337 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:12.024347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.024870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.025304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.026005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.026522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.026858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.223406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:12.224146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:12.255072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.257114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.257607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.259898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.260385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.261586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.286896 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:12.299339 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-02417931-020b-4d61-b88f-ce9c325da6f2 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1522 microversion: 2.1 time: 0.297914 Aug 24 01:55:12.299872 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 691/1312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:12 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:12.346775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:12.362910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-462a9925-d5c1-48da-82b6-dbcaec96ae72 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1209 microversion: 2.1 time: 0.144469 Aug 24 01:55:12.363951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 622/1313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:12 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:12.551953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-plugged", "status": "completed", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:12.572427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.573212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.573683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.589349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:12.590320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:12.603006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.603921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.604609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.605114 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] Creating event network-vif-plugged:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:55:12.607723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.608256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.608810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.615346 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c5f75e57-414a-4caf-8fb8-b9fda3ffd8b3 req-bd0c80b9-0045-495a-9483-a6b454c1d93d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066892 Aug 24 01:55:12.620849 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 692/1314] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:12.726939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:12.727665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:12.735211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.735705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.736210 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.742272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.742797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.743360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.820463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:12.841598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2322c49e-d02b-4d02-9b63-a90cba535b2b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1542 microversion: 2.1 time: 0.256871 Aug 24 01:55:12.858732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 623/1315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:12 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1542 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:12.865102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:12.865439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:12.885767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.886643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.887137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.888056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:12.893018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:12.893838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:12.941770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:12.951664 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-90983498-8ebd-4375-bfe4-0bc63768b005 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.231840 Aug 24 01:55:12.952238 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 693/1316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:12 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:13.008406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99c19c84-480d-4092-93eb-2af34782401c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147405 Aug 24 01:55:13.009508 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 624/1317] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 01:55:12 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:13.322120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:13.324026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:13.332396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.333421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.334411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.335517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.336341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.337012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.463201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-34b77f92-1b99-4245-826f-2fc98ae130ad tempest-ListImageFiltersNegativeTestJSON-716804811 tempest-ListImageFiltersNegativeTestJSON-716804811-project] Calling method '.version_select at 0x7f6b9261df70>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:13.490162 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-34b77f92-1b99-4245-826f-2fc98ae130ad tempest-ListImageFiltersNegativeTestJSON-716804811 tempest-ListImageFiltersNegativeTestJSON-716804811-project] HTTP exception thrown: Image not found. Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-34b77f92-1b99-4245-826f-2fc98ae130ad tempest-ListImageFiltersNegativeTestJSON-716804811 tempest-ListImageFiltersNegativeTestJSON-716804811-project] Request method failure captured: Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/images/84b3b735-d619-4c9c-a959-a235170bab83 HTTP/1.1 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYUBiEilvHbYiLurDkoeQ2PFedyzuF2HV2Pvf_1zc2Fzi6O2DqHxpqyCuNRNaqMYfFUnQ0Sl_bfAf2OEHQlT3e1VZzBJgJOtz2SZqgm5X9mWgR8BF3CzXcUvQ2IfPEl-kDYW8FhdqbWfOmdWTxjB8XNKnOWneHW4x0skuBxiEnG2gw8 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: e9ff31c78387453d8360a11824d29652 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-716804811 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9ff31c78387453d8360a11824d29652"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9ff31c78387453d8360a11824d29652"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9ff31c78387453d8360a11824d29652"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9ff31c78387453d8360a11824d29652"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-716804811 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: e9ff31c78387453d8360a11824d29652 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-716804811 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ListImageFiltersNegativeTestJSON-716804811-project Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 3e2e43ae5fe44fe19f1ec9af507e1ef1 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-716804811-project Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: method: Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: exception: Image not found. Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '84b3b735-d619-4c9c-a959-a235170bab83'} Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 84b3b735-d619-4c9c-a959-a235170bab83 Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 01:55:13.494102 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84b3b735-d619-4c9c-a959-a235170bab83 could not be found. Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 01:55:13.498068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:13.503472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-34b77f92-1b99-4245-826f-2fc98ae130ad tempest-ListImageFiltersNegativeTestJSON-716804811 tempest-ListImageFiltersNegativeTestJSON-716804811-project] Returning 404 to user: Image not found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:13.504678 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-34b77f92-1b99-4245-826f-2fc98ae130ad tempest-ListImageFiltersNegativeTestJSON-716804811 tempest-ListImageFiltersNegativeTestJSON-716804811-project] 10.222.0.49 "GET /compute/v2.1/images/84b3b735-d619-4c9c-a959-a235170bab83" status: 404 len: 62 microversion: 2.1 time: 0.210868 Aug 24 01:55:13.505741 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 694/1318] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:55:13 2022] GET /compute/v2.1/images/84b3b735-d619-4c9c-a959-a235170bab83 => generated 62 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:55:13.520478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:13.523754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:13.536959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.542485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.544765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.545782 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.546483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.548571 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.669326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:13.707916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:13.709656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4362d6f-a6c9-4a95-8abf-e76efc4be229 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1499 microversion: 2.1 time: 0.392548 Aug 24 01:55:13.716004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 625/1319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:13 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1499 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:13.731202 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a1701955-f245-466c-bcad-447ae1852b6e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1273 microversion: 2.1 time: 0.223270 Aug 24 01:55:13.741156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:13.748778 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 695/1320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:13 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:13.750407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:13.751354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:13.765449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.766214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.766619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.767811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.767940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.768301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.801969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:13.836519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90a18cda-a729-4d8c-85b5-55b609b71b9a tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.100636 Aug 24 01:55:13.837718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 626/1321] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Aug 24 01:55:13 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:13.848850 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:13.857045 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.857750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.858985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.939957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Going to try to start instance {{(pid=128566) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 01:55:13.972527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:13.973705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:13.983024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.983839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.988393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:13.991859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:13.992662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:13.993142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:14.001670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:14.026370 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-83d03198-f434-49e9-b9fa-6c6d75ab0e55 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "POST /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676/action" status: 202 len: 0 microversion: 2.1 time: 0.180928 Aug 24 01:55:14.030167 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 696/1322] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:13 2022] POST /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:55:14.041367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:14.043798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:14.048454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:14.062936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:14.065861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:14.066278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:14.067145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:14.067613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:14.076743 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:14.298259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:14.315710 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-266b9e38-d2b3-4212-a3da-5ad6caeb05f4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1508 microversion: 2.1 time: 0.284087 Aug 24 01:55:14.328743 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 697/1323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:14 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:14.755868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:14.756524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:14.765913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:14.770372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:14.771183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:14.772242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:14.774656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:14.775565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:14.785564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:14.794092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7a42ed7-b506-4380-b796-137eee6a71a9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.826522 Aug 24 01:55:14.800219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 627/1324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:13 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:14.857983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:14.887097 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6f53f56e-ed97-4c04-95bd-08dd60b4c78e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1271 microversion: 2.1 time: 0.128630 Aug 24 01:55:14.887097 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 698/1325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:14 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1271 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:15.339570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:15.340202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:15.346388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.347084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.347706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.348569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.349203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.349785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.405666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:15.425368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.426106 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.429895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.453958 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] Creating event network-changed:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h1-854121-3 Aug 24 01:55:15.467270 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-72ed3878-21a7-447f-803a-86bfb1e73b09 req-371e1375-6699-4723-be19-35c7fab18bc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065485 Aug 24 01:55:15.468629 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 699/1326] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:15.501213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=6 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:15.731895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Calling method '.version_select at 0x7f6b91a044c0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:15.757974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.758638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.759078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.759844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.760306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.760755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.783932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:15.793006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dce0f7e7-c0f7-479a-b2a4-0e1884d6f872 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1508 microversion: 2.1 time: 0.458764 Aug 24 01:55:15.809089 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d2b59986-a3ab-49a4-8946-a6f1d4a6c551 tempest-AbsoluteLimitsTestJSON-1486464440 tempest-AbsoluteLimitsTestJSON-1486464440-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.335269 Aug 24 01:55:15.809640 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 628/1327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:15 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:15.816822 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 700/1328] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 01:55:15 2022] GET /compute/v2.1/limits => generated 511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:15.823305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:15.825177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:15.831607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.842529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.843400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.844319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.845007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.845602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.902573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:15.903301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:15.916389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.921086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.921593 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:15.922333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:15.922802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:15.923227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:16.339776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:16.353168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-342883ef-c4da-4e75-8b8c-c6d33690a4fb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.538198 Aug 24 01:55:16.353939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 629/1329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:15 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:16.782913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:16.793327 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-60cc1ebe-4d27-46a1-bf13-76562858ef12 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.896313 Aug 24 01:55:16.794020 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 701/1330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:15 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:16.821983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:16.822626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:16.840245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:16.840838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:16.841289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:16.841999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:16.842459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:16.842889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.229888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:17.240327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-817b4c01-e3d4-4d22-a503-f7984bc16b60 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1512 microversion: 2.1 time: 0.423008 Aug 24 01:55:17.243229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 630/1331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:16 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1512 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:17.265347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.270045 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:17.270488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.compute.servers [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Removing options 'limit' from query {{(pid=128566) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 01:55:17.271243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:17.272329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.273413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.273862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.274619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.275060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.275480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.276918 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0ed7c65e-8c74-4a69-a807-95ac6d7bc097 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.015380 Aug 24 01:55:17.277622 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 702/1332] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:55:17.289995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.290845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:17.293047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:17.298903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.299710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.300210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.301180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.301799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.302415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.373978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.374877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:17.381583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.382340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.382960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.383808 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.384996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.385584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.556370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:17.566675 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cd1e385-6a87-45e9-b79b-5cc318373b94 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1512 microversion: 2.1 time: 0.280974 Aug 24 01:55:17.568496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 631/1333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:17.588248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:17.591745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.592364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:17.598652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.599333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.599935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.602073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.602840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.603602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.608357 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9fa0981d-09b0-41ae-be2f-7d85717b616c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.233287 Aug 24 01:55:17.610493 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 703/1334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:17.680846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:17.690895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.691611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.692237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.704468 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] Creating event network-changed:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h1-854121-3 Aug 24 01:55:17.710468 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-a750e226-fd39-45b4-8af8-8a8b959968db req-70268959-438c-499d-a7da-1133f4c150e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034812 Aug 24 01:55:17.711070 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 704/1335] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:17.817121 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.818537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:17.825056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:17.830235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.830810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.831360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.832178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.832708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.833226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.835988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34b1faea-7ac6-4222-9599-22bc4331b762 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1513 microversion: 2.1 time: 0.248788 Aug 24 01:55:17.836580 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 632/1336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:17.862986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:17.863869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:17.871810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.872529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.873192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.874111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:17.874766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:17.875394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:17.998003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:18.010793 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8763725a-8d67-4396-ba51-a65ed452206b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.199181 Aug 24 01:55:18.012640 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 705/1337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:18.097698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:18.105330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:18.107819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9eb1ac7d-62fb-44a3-bf2c-25429a79e5d0 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1512 microversion: 2.1 time: 0.253868 Aug 24 01:55:18.109513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 633/1338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:17 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:18.130221 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:18.136637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:18.137617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:18.251679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.252425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.252894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.253963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.254594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.255016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.281526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=23 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:18.340367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:18.611192 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bdd45754-9066-4446-a190-3e8805e372d8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.486102 Aug 24 01:55:18.611763 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 706/1339] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Aug 24 01:55:18 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:18.625300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:18.626431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:18.630648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:18.631267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:18.633929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.634612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.635244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.636440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.637283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.637980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.639059 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.639554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.639926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.640668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.641186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.641575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.780296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:18.789929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c88f3d21-6af7-454a-b955-5463393ff94e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1512 microversion: 2.1 time: 0.169152 Aug 24 01:55:18.790558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 634/1340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:18 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:18.810706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:18.811373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:18.817555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.818054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.818491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.819191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:18.820138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:18.820786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:18.858754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:18.868214 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4cdd6d30-e873-4f7c-a0f6-f90543bda88a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.241604 Aug 24 01:55:18.869079 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 707/1341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:18 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:19.030537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.033824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:19.034703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:19.039305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e5d626d-995b-4315-b8ff-e95a7ace628e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1513 microversion: 2.1 time: 0.232889 Aug 24 01:55:19.039881 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 635/1342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:18 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.050289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.062540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:19.064255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:19.071163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.072480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.073323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.074383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.075718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.076310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.176261 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.184256 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c0f7ede6-0cde-436d-b558-faf948b136c7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.155338 Aug 24 01:55:19.184994 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 708/1343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:19 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:19.299226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.306828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24a0e66d-811b-4cf0-b5ef-27c6d93c5455 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1512 microversion: 2.1 time: 0.251383 Aug 24 01:55:19.308089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 636/1344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:19 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:19.330022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:19.335696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.337282 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:19.342908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.343515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.344185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.345149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.345664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.346093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.383443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:19.465377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.473754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.474245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.474688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.623400 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a3bd3bd6-af5f-426b-b121-e427c831fc42 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 0.297388 Aug 24 01:55:19.624011 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 709/1345] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:55:19 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:19.647787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:19.652669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:19.653355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:19.891675 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:19.893018 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:19.900116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.900610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.901075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:19.901972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:19.902434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:19.902868 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.056347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.064477 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b68cb2e9-cef2-4b18-914a-3e169cbc3362 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.177521 Aug 24 01:55:20.065105 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 710/1346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:19 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:20.179202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.179690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.180129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.180902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.181424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.181849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.212489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:20.213002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=28 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:20.213420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:20.222338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.222837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.223273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.223986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.224440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.224941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.325110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:20.391761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92d580f6-3944-4943-b2c7-891d4e9d7b03 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.748553 Aug 24 01:55:20.392282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 637/1347] 10.222.0.49 () {58 vars in 1150 bytes} [Wed Aug 24 01:55:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:20.407869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:20.414579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.415538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:20.422892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.423649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.424255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.425003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.425460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.425941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.434830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.442926 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6c6e813c-b638-4c4b-83c4-a75a8bdf56cb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.241158 Aug 24 01:55:20.443679 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 711/1348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:20 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:20.519501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:20.581660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36967726-7497-4613-b0be-cc065348c822 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.179069 Aug 24 01:55:20.588827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 638/1349] 10.222.0.49 () {58 vars in 1212 bytes} [Wed Aug 24 01:55:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:20.594443 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:20.599474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.600175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:20.605512 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.606001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.606442 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.607176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.607638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.608070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.695893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:20.759815 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f96260cb-25cf-4dd8-9ee9-7e924f06f2f3 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.169334 Aug 24 01:55:20.760407 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 712/1350] 10.222.0.49 () {58 vars in 1196 bytes} [Wed Aug 24 01:55:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:20.773222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:20.778513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.779376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': '-981535983', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:20.784746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.785273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.785879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.786592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.787039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.787457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.887274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:20.952208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8080f04d-c6e1-49e2-8aa0-7cd960a54464 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-981535983" status: 200 len: 345 microversion: 2.1 time: 0.183296 Aug 24 01:55:20.952894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 639/1351] 10.222.0.49 () {58 vars in 1156 bytes} [Wed Aug 24 01:55:20 2022] GET /compute/v2.1/servers?name=-981535983 => generated 345 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:20.966846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:20.971988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:20.972763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:20.980198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.980895 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.981471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:20.982411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:20.982925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:20.983456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.080814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:21.087931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:21.090471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:21.113540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.113973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.114421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.115151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.115615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.122387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.146230 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2f75f5de-9006-4d9f-bc6c-c1b61d518c00 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.183255 Aug 24 01:55:21.147886 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 713/1352] 10.222.0.49 () {58 vars in 1154 bytes} [Wed Aug 24 01:55:20 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:21.162135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:21.182543 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:21.183224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-98153598', 'deleted': False, 'project_id': '4ecd3cbcdfec4256811072c372016fb5'} {{(pid=128566) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:55:21.190366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.190858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.191309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.192375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.192589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.193044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.200353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=26 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:21.300385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.multi_cell_list [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128566) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:55:21.315673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:21.365575 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-acbd0fb3-36b9-47f0-99c5-4ef528bff949 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-98153598" status: 200 len: 345 microversion: 2.1 time: 0.209637 Aug 24 01:55:21.366828 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 714/1353] 10.222.0.49 () {58 vars in 1226 bytes} [Wed Aug 24 01:55:21 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-98153598 => generated 345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:21.380658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:21.381536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:21.391798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.392497 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.393152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.394084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.394849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.395465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.432179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:55:21.490457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:21.499478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8a0b53e-f599-4904-9aa6-0634f12869c8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1471 microversion: 2.1 time: 0.416873 Aug 24 01:55:21.500416 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 640/1354] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:21 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1471 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:21.522805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:21.523631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:21.535753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.544016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.544773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.546019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.553417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.554196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.591134 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b18f8bf4-bf7f-4b39-933a-c500a871a185 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 204 len: 0 microversion: 2.1 time: 0.215016 Aug 24 01:55:21.592114 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 715/1355] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:21 2022] DELETE /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:55:21.601561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:21.602362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:21.608514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.609042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.609484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.610236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:21.610814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:21.611098 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:21.783283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:21.791700 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a37b0568-f813-4825-aa5b-d1053bac1cc6 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1518 microversion: 2.1 time: 0.195188 Aug 24 01:55:21.799638 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 716/1356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:21 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:21.896142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:21.904063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32ed3611-51cb-47df-a814-b97b0414b5b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.401982 Aug 24 01:55:21.905019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 641/1357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:21 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:22.524903 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:22.526157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:22.533846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.534413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.534900 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:22.535617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.536069 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.536748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:22.762237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:22.774661 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2a1a3a19-2cb4-457d-aeeb-5926b1d480db tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1489 microversion: 2.1 time: 0.253524 Aug 24 01:55:22.776004 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 717/1358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:22 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1489 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:22.812587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:22.814104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:22.821944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.823757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.824435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:22.825415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.826085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.826722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:22.925644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:22.926167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:22.933790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.937460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.937978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:22.938708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:22.939176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:22.939603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.054599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:23.063631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fcd14823-c32c-4f26-8d82-0c3ca141490d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1518 microversion: 2.1 time: 0.254469 Aug 24 01:55:23.064865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 642/1359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:22 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:23.087573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:23.088080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:23.094416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.096014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.096866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.098056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.098671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.099240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.128372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:55:23.191835 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:23.200625 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f6e38b66-c18d-44d7-8a17-9f9ea0f4a0ad tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.278907 Aug 24 01:55:23.209079 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 718/1360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:22 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:23.258969 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36a7e9ea-0cc3-478a-b801-1de47a0122f8 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "DELETE /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 204 len: 0 microversion: 2.1 time: 0.182110 Aug 24 01:55:23.259952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 643/1361] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:23 2022] DELETE /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:55:23.267894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:23.268510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:23.279501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.280005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.280451 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.281429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.281660 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.282092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.541893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:23.554039 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-26ac6796-04aa-4bd1-806e-d3a57eb5476b tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1666 microversion: 2.1 time: 0.289217 Aug 24 01:55:23.555231 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 719/1362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:23 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1666 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:23.800310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:23.801531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:23.809558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.810280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.811074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.811996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:23.812647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:23.813740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:23.989484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:23.998993 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d60993bc-56be-405b-9dac-ac0053e5485b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.203348 Aug 24 01:55:24.002192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 644/1363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:23 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:24.075891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-unplugged", "status": "completed", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:24.091790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.092492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.092965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.105618 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] Creating event network-vif-unplugged:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:55:24.110686 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d6e2a5cb-53c4-432b-a8c9-42afbfb1065d req-ef690dde-d6d8-47e3-9a39-f7b4211adc44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041086 Aug 24 01:55:24.112035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 645/1364] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:24.117860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:24.118773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:24.126569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.127260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.127871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.128774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.129410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.130194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.148806 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-542bc27e-efc9-4302-938c-fba745f8d7eb tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b929881f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-965273884", "description": "tempest-description-1614094026"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:24.284845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:24.294569 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cba2491-d0ea-45c0-be50-038239f9dfc5 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1518 microversion: 2.1 time: 0.180758 Aug 24 01:55:24.301176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 646/1365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:24 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:24.312937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:24.313483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:24.316650 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-542bc27e-efc9-4302-938c-fba745f8d7eb tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.302508 Aug 24 01:55:24.325197 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 720/1366] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:24.325397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.325397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.325397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.325397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.325785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.326120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.332368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1a633aac-b89f-4c63-ae28-ae7d61023c2f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92988a60>, body: {"security_group_rule": {"parent_group_id": "c0d6c9cc-10b4-4710-9e7c-8a3aa4bb0bb0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:24.481127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:24.489126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-feaa81f6-f89c-4970-84a0-3c3cba193827 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.184611 Aug 24 01:55:24.489697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 647/1367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:24 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:24.542381 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1a633aac-b89f-4c63-ae28-ae7d61023c2f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.215720 Aug 24 01:55:24.548295 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 721/1368] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:24.555577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e458b8c3-8a44-4af7-9f32-d0d20c2125c8 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b9262e3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1825761725", "description": "tempest-description-411612644"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:24.575399 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:24.576012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:24.583536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.584165 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.584837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.585708 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:24.586194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:24.586670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:24.735488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e458b8c3-8a44-4af7-9f32-d0d20c2125c8 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.184135 Aug 24 01:55:24.736126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 648/1369] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:24.749549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5967fd7-1bff-469b-9b56-72f6b77c3a46 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b924990d0>, body: {"security_group_rule": {"parent_group_id": "d4880a99-5ee2-4272-b9b7-6d4ad46d894a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:24.759361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:24.768170 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4ab5f9e4-6f1a-4934-a902-9260cce541da tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1666 microversion: 2.1 time: 0.196500 Aug 24 01:55:24.770175 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 722/1370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:24 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1666 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:24.942649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5967fd7-1bff-469b-9b56-72f6b77c3a46 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.196814 Aug 24 01:55:24.943257 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 649/1371] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:24.955856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e8e9ec24-2040-464c-b5f7-3026ae96e5b7 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92923550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-637586550", "description": "tempest-description-883882994"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:25.023602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:25.024211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:25.031321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.031819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.032347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.033170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.033611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.034217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.053646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:25.116892 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e8e9ec24-2040-464c-b5f7-3026ae96e5b7 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.163949 Aug 24 01:55:25.119192 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 723/1372] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:24 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:25.130060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5a1d3e30-0191-4485-b1bc-2ccb4472d47f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92852790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1547509777", "description": "tempest-description-1060750902"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:25.199845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:25.208919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4ad1bab-dbe5-48da-8921-e1a7f157eccd tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.190020 Aug 24 01:55:25.219670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 650/1373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:25 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:25.315750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:25.316887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:25.326241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.330534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.331297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.332264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.332972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.333614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.338270 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5a1d3e30-0191-4485-b1bc-2ccb4472d47f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.212291 Aug 24 01:55:25.339483 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 724/1374] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:25.351905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d29ecc48-ae47-4ab4-8c92-2feb90d20756 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b9298aa60>, body: {"security_group_rule": {"parent_group_id": "99737496-f252-4355-adbd-5ae613c920ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bbb8de19-f03b-43c5-a365-379f2abec161"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:25.583446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:25.596441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cc83702-5487-472b-a462-17ee68377ba4 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1518 microversion: 2.1 time: 0.284514 Aug 24 01:55:25.607304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 651/1375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:25 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:25.617877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:25.618906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:25.626148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.626927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.627511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.628653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.629279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.630128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.924641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:25.934228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cfa4148-4a85-40e1-8131-79fc853fd56a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.332115 Aug 24 01:55:25.941604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 652/1376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:25 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:25.946677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:25.947257 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d29ecc48-ae47-4ab4-8c92-2feb90d20756 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.599249 Aug 24 01:55:25.947640 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 725/1377] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:25 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:25.952153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:25.966939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.967437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.967879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.968589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:25.969079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:25.969505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:25.977279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81742358-fb65-403c-a694-a8e3b1117c3a tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92368430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1713189978", "description": "tempest-description-1280709186"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:26.202576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:26.212965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f92d4a9-4e1e-4435-882c-9efba0f05013 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1666 microversion: 2.1 time: 0.270020 Aug 24 01:55:26.214548 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 653/1378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:25 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1666 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:26.224436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:26.225670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:26.251202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.252059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.252749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.253700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.254379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.255047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.317628 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81742358-fb65-403c-a694-a8e3b1117c3a tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.350808 Aug 24 01:55:26.318505 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 726/1379] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:26.332422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f5cf62-543d-4bd3-8956-134d9cf01bf4", "name": "network-vif-deleted", "tag": "3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:26.348703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.349519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.350167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.364873 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] Creating event network-vif-deleted:3a52ac95-5b49-4b74-9bd8-2f3a054a8e5c for instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 on n-h2-854121-3 Aug 24 01:55:26.371758 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-5c2f1d68-a5ff-454d-a918-ebca5ebc57be req-2b91d5f4-9124-49e1-8a9f-29627f190a40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050907 Aug 24 01:55:26.372937 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 727/1380] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:26.381951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "name": "network-vif-plugged", "status": "completed", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:26.395383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.396275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.397186 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.413066 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] Creating event network-vif-plugged:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h1-854121-3 Aug 24 01:55:26.419046 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c12ef23d-6d1c-49b3-b60c-d8084def7492 req-3c2cc7e4-7914-47a2-ba64-d2493562778e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044601 Aug 24 01:55:26.420208 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 728/1381] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:26.430201 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:26.430945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:26.439259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.439754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.440189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.440962 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.441414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.441843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.510616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:26.529046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a2cc682-1d8a-406a-9a19-fbf7bccc75e3 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 2421 microversion: 2.25 time: 0.312833 Aug 24 01:55:26.530371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 654/1382] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:26 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 2421 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:26.538800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84a51560-8998-451b-8843-c1a3abda5e29 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92576430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-977033278", "description": "tempest-description-477556404"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:26.673601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:26.684761 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7b9548e7-1fbd-4f2f-9107-610426decdc9 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.262008 Aug 24 01:55:26.686005 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 729/1383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:26 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:26.691877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-3", "block_migration": "auto"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:26.695176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:26.702950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.703934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.704676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.705665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.706094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.706745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.736639 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'flavor' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:26.773450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Going to try to live migrate instance to n-h1-854121-3 {{(pid=128566) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:55:26.889241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84a51560-8998-451b-8843-c1a3abda5e29 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.357583 Aug 24 01:55:26.890116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 655/1384] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:26 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:26.895354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:26.898239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:26.913199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.914132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.914876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:26.916830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:26.917591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:26.936222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.038192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:27.057977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14ef2fea-b25c-4aa9-b503-18efe0d19630 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1476 microversion: 2.1 time: 0.166184 Aug 24 01:55:27.061719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 656/1385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:26 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:27.075339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57827b5a-cbb0-4082-b36a-3a20d96e9f08", "name": "network-vif-deleted", "tag": "87f4334a-4de3-48af-82ce-d74469da7ebd"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:27.090379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:27.091225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:27.095355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.126851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] Creating event network-vif-deleted:87f4334a-4de3-48af-82ce-d74469da7ebd for instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 on n-h1-854121-3 Aug 24 01:55:27.139601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bdbb4e8c-814d-4023-b547-1c6ce99b8aac req-24c154ea-5720-4bf6-9f20-c8f87b63d5fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076614 Aug 24 01:55:27.145944 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 657/1386] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:27.160879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2066ad50-a5a2-4703-a826-228085f74b9f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b926ceaf0>, body: {"security_group_rule": {"parent_group_id": "6205b560-d7aa-4e73-9f80-3da9862535e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "62db16cf-495e-4a03-8389-7a0c70bc9c38"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:27.574252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2066ad50-a5a2-4703-a826-228085f74b9f tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.426430 Aug 24 01:55:27.574890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 658/1387] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:27 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:27.579726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:27.580467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:27.589204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:27.589707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:27.590160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.590876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:27.591336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:27.591765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.734184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:27.742296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-202c9c46-be2e-44d3-af2b-5c8b8d7b4709 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1313 microversion: 2.1 time: 0.166380 Aug 24 01:55:27.742981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 659/1388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:27 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:27.749526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:27.750303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:27.757344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:27.757912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:27.758424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.759195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:27.759731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:27.760259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:27.833940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:27.846120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93495685-119e-456a-bc14-8fb581b1c369 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1310 microversion: 2.1 time: 0.100964 Aug 24 01:55:27.847154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 660/1389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:27 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1310 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:27.852419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfbcd229-1edb-43d5-88a5-7e18c4e87337 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b92576ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:28.124909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfbcd229-1edb-43d5-88a5-7e18c4e87337 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/62db16cf-495e-4a03-8389-7a0c70bc9c38" status: 202 len: 0 microversion: 2.1 time: 0.275634 Aug 24 01:55:28.126992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 661/1390] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:27 2022] DELETE /compute/v2.1/os-security-groups/62db16cf-495e-4a03-8389-7a0c70bc9c38 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:28.137046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:28.137862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:28.144887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.145603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.146207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:28.147128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.147626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.148057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:28.303661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:28.311929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0843ca44-d28a-4fd3-9039-c6b2c0f8bd34 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.181391 Aug 24 01:55:28.312527 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 662/1391] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:28 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:28.326316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:28.326975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:28.333148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.333635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.334122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:28.334907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.335296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.335716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:28.401360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:28.409459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-141a515a-83d2-45da-966d-9e1f480dd169 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1476 microversion: 2.1 time: 0.087535 Aug 24 01:55:28.410041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 663/1392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:28 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1476 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:28.415722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53f849f4-733a-4fa0-a5f4-d3b77170e178 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b9269b430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:28.462859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53f849f4-733a-4fa0-a5f4-d3b77170e178 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/6205b560-d7aa-4e73-9f80-3da9862535e4" status: 200 len: 248 microversion: 2.1 time: 0.051121 Aug 24 01:55:28.463902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 664/1393] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 01:55:28 2022] GET /compute/v2.1/os-security-groups/6205b560-d7aa-4e73-9f80-3da9862535e4 => generated 248 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:28.484005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba04b9b6-0909-46f6-a54f-8eec925d1b29 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92659f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-645709675", "description": "tempest-description-1118950284"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:28.655055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba04b9b6-0909-46f6-a54f-8eec925d1b29 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.181887 Aug 24 01:55:28.655697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 665/1394] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 01:55:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:28.668280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9a83603-79c9-401a-810e-babbbe72b096 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b9249e550>, body: {"security_group_rule": {"parent_group_id": "43193ddd-7192-4415-bdb2-2028c955e2b2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:28.856758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9a83603-79c9-401a-810e-babbbe72b096 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.192083 Aug 24 01:55:28.857784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 666/1395] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:28.862659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:28.863352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:28.870372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.870945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.871380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:28.872070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:28.872521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:28.872975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.008897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:29.017757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9f780b5-3857-470f-b64d-09f6a9a1d9e8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1463 microversion: 2.1 time: 0.158762 Aug 24 01:55:29.018314 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 667/1396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:28 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:29.023439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.024047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.030068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.030558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.030989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.031946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.032403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.032855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.069073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.069979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.070601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.071481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lazy-loading 'fault' on Instance uuid 57827b5a-cbb0-4082-b36a-3a20d96e9f08 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:29.130024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9e28715348a48f5a2da996059f8d8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac3b385f0f64ccf8be65447dddbaff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:29.139252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac7b4efe-1bfd-4287-879a-482d4523c7e6 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 200 len: 1315 microversion: 2.1 time: 0.119918 Aug 24 01:55:29.140023 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 668/1397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 1315 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:29.145707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f41d0af-0eef-47aa-a6d6-9008f6b63077 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Action: 'create', calling method: .version_select at 0x7f6b92482160>, body: {"security_group_rule": {"parent_group_id": "43193ddd-7192-4415-bdb2-2028c955e2b2", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:29.462618 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=4 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:29.473231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f41d0af-0eef-47aa-a6d6-9008f6b63077 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.331795 Aug 24 01:55:29.475977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 669/1398] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 01:55:29 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:29.481216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.482116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.488699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.489219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.489645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.490894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.491451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.491873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.610264 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-344e1f56-607e-4494-b1aa-d3eaf3902b8e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/action" status: 202 len: 0 microversion: 2.25 time: 2.922837 Aug 24 01:55:29.610876 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 730/1399] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:55:26 2022] POST /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/action => generated 0 bytes in 2924 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:55:29.616605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.617565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.626191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.626800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.627192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.627967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.628484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.628936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.646025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e5e27a5-2bf3-4f92-8b55-62bff7b3fdc5 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1614 microversion: 2.1 time: 0.168623 Aug 24 01:55:29.646638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 670/1400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:29.652452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.653084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.659996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.660481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.661038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.661991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.662953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.663597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.708591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.709195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.709735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.710353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lazy-loading 'fault' on Instance uuid c5f5cf62-543d-4bd3-8956-134d9cf01bf4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:29.762770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:29.772258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-beeeaeb2-e1d3-4466-816d-a08bab7fd10b tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 200 len: 1311 microversion: 2.1 time: 0.124586 Aug 24 01:55:29.773658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 671/1401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:29.778556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c22b3cb-d0b7-49df-acd4-23a06f481a35 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b9269be50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.798678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:29.809541 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ab12605f-6ca7-47d6-a667-74a27c632340 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.197320 Aug 24 01:55:29.810415 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 731/1402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:29.815396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:29.816220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.825771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.826769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.827635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.828864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.830132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.830877 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.838898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c22b3cb-d0b7-49df-acd4-23a06f481a35 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/43193ddd-7192-4415-bdb2-2028c955e2b2" status: 200 len: 664 microversion: 2.1 time: 0.063815 Aug 24 01:55:29.839752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 672/1403] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/os-security-groups/43193ddd-7192-4415-bdb2-2028c955e2b2 => generated 664 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:29.844948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:29.845780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:29.852632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.853218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.853717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.854513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:29.855029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:29.855596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:29.931479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '714604146ea24ed6a1be55a4c1ef50a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24eff4cc6b584b03a5964b39852a8214', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:29.932057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] flavor_id is None. Assuming migration. {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 01:55:29.932495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 01:55:29.989467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:30.002881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:30.005702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:30.007135 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6f110406-478b-49d3-8b70-9c2bf9a372a1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.195561 Aug 24 01:55:30.008431 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 732/1404] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:29 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:30.013769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-123b35bb-6eb0-4f40-8168-cf872916b8e6 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b923e8670>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.076221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:30.124312 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-244c3b37-814a-4bb8-9c46-4bd3b0ece160 tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479/action" status: 202 len: 0 microversion: 2.1 time: 0.282907 Aug 24 01:55:30.125956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 673/1405] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:29 2022] POST /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:30.136006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.136630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:30.143967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.144624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.145685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.146476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.148302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.148951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.205957 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-123b35bb-6eb0-4f40-8168-cf872916b8e6 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/2da4c4bd-cbbd-4583-afba-179d225c3f90" status: 202 len: 0 microversion: 2.1 time: 0.196117 Aug 24 01:55:30.206993 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 733/1406] 10.222.0.49 () {58 vars in 1287 bytes} [Wed Aug 24 01:55:30 2022] DELETE /compute/v2.1/os-security-group-rules/2da4c4bd-cbbd-4583-afba-179d225c3f90 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:30.216017 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.216837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] [instance: 57827b5a-cbb0-4082-b36a-3a20d96e9f08] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:30.226788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.232042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.232509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.233292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.233752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.234217 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.255013 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] HTTP exception thrown: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Request method failure captured: Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 HTTP/1.1 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYSfNSSDmnfFWk6M8PnDr5F2zZGjhinZfPjiEGYKn6LFC4vJrFsxMYsk4hSTNaIOVdbVYLIpGqYf1VEU0cXd3LkMOFTCma49FDrPKdbS5zRqZV5xnHWcf_V6G3Bqdtm4PlMWyUnIbnD2IRkhbjM84cyXUqttd9mjxgjY6rkVUXq8izA Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 3ac3b385f0f64ccf8be65447dddbaff6 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersTestFqdnHostnames-768578348 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3ac3b385f0f64ccf8be65447dddbaff6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ac3b385f0f64ccf8be65447dddbaff6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ac3b385f0f64ccf8be65447dddbaff6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3ac3b385f0f64ccf8be65447dddbaff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersTestFqdnHostnames-768578348 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 3ac3b385f0f64ccf8be65447dddbaff6 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-768578348 Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersTestFqdnHostnames-768578348-project Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a9e28715348a48f5a2da996059f8d8dd Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersTestFqdnHostnames-768578348-project Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '57827b5a-cbb0-4082-b36a-3a20d96e9f08'} Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.257092 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. Aug 24 01:55:30.261560 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.267787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Returning 404 to user: Instance 57827b5a-cbb0-4082-b36a-3a20d96e9f08 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:30.272557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4e6d7cce-6236-4a5a-8d62-5b4ee851087d tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08" status: 404 len: 111 microversion: 2.1 time: 0.063682 Aug 24 01:55:30.274735 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 734/1407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:30 2022] GET /compute/v2.1/servers/57827b5a-cbb0-4082-b36a-3a20d96e9f08 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:55:30.289248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ee67a926-0d7b-4541-a0e9-6fd300c6cbaa tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b923e8820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.407428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:30.416662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aeef730c-8c18-4b50-91eb-4d43a287d184 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1472 microversion: 2.1 time: 0.286730 Aug 24 01:55:30.418327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 674/1408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:30 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:30.423198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0806bee-2af0-4c63-a49b-2ead45f9d0b1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] Calling method '.version_select at 0x7f6b92659940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.450136 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0806bee-2af0-4c63-a49b-2ead45f9d0b1 tempest-ServersTestFqdnHostnames-768578348 tempest-ServersTestFqdnHostnames-768578348-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750823846" status: 202 len: 0 microversion: 2.1 time: 0.030557 Aug 24 01:55:30.451183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 675/1409] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 01:55:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750823846 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:30.580053 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ee67a926-0d7b-4541-a0e9-6fd300c6cbaa tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/43193ddd-7192-4415-bdb2-2028c955e2b2" status: 202 len: 0 microversion: 2.1 time: 0.299698 Aug 24 01:55:30.585472 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 735/1410] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:30 2022] DELETE /compute/v2.1/os-security-groups/43193ddd-7192-4415-bdb2-2028c955e2b2 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:30.590780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b91f94940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.795174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.795986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: c5f5cf62-543d-4bd3-8956-134d9cf01bf4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:30.804609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.805288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.805838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.806669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.807454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.807986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.816507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:30.826767 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] HTTP exception thrown: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Request method failure captured: Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 HTTP/1.1 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTSSQF0WK64lW7ChR-sZITSrUcs9GWfthwXMTNcVbg6vT8k6d0wmbaeWlqVT7ZEqH3TXIIsV7wbdvRbxYM76S3vEWAAUQAcjBKfOsE5yPp6YJ8-CE-c6-T87jpQKwnd63c4unQrjDc2yT6gjynDxAT1OPDlELX8vh9o7G1viH6vucg Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: de7aeb19b75943d89f74ada589d05055 Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'c5f5cf62-543d-4bd3-8956-134d9cf01bf4'} Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.828899 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. Aug 24 01:55:30.833068 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.835793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Returning 404 to user: Instance c5f5cf62-543d-4bd3-8956-134d9cf01bf4 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:30.836966 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d5a86828-ed39-480e-825b-4e42659d42f1 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4" status: 404 len: 111 microversion: 2.1 time: 0.046433 Aug 24 01:55:30.841083 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 736/1411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:30 2022] GET /compute/v2.1/servers/c5f5cf62-543d-4bd3-8956-134d9cf01bf4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:55:30.846938 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.847935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:30.855702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.856690 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.857716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.858842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.859565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.860689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.922388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 01:55:30.923005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Neutron security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 01:55:30.923531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] HTTP exception thrown: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.923531 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Request method failure captured: Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/62db16cf-495e-4a03-8389-7a0c70bc9c38 HTTP/1.1 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYULWDYm6T2Y0_CHhY6rxSseWmiuRLXNVzrx11rvTVU3HjiVjeQ6LPf2lwI1zY-nbNQ5IYcfQRFjvOwOdcmpHqNBZe9B1ZBf1rP9h9sLlr6nUMPviU4UIZyGZfhZXNl4KMZNv8kzSs_OCx5jaosNqvcWu4H9tNbK6w2MSbNjf07OrVE Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5425d05bfe3c43c1b02bf8dff060efa5 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-36943848 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5425d05bfe3c43c1b02bf8dff060efa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5425d05bfe3c43c1b02bf8dff060efa5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5425d05bfe3c43c1b02bf8dff060efa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5425d05bfe3c43c1b02bf8dff060efa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesTestJSON-36943848 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5425d05bfe3c43c1b02bf8dff060efa5 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-36943848 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesTestJSON-36943848-project Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 853b21d9805741cf8f112e91fd0394df Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesTestJSON-36943848-project Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '62db16cf-495e-4a03-8389-7a0c70bc9c38'} Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 01:55:30.926194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Returning 404 to user: Security group 62db16cf-495e-4a03-8389-7a0c70bc9c38 does not exist Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-09d9a007-185f-4425-bd3e-dbdaa3c7b551'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-632b3734-bded-491e-b115-652f0b9f6417 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/62db16cf-495e-4a03-8389-7a0c70bc9c38" status: 404 len: 194 microversion: 2.1 time: 0.341293 Aug 24 01:55:30.932371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 676/1412] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:30 2022] DELETE /compute/v2.1/os-security-groups/62db16cf-495e-4a03-8389-7a0c70bc9c38 => generated 194 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 01:55:30.947329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:30.947899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:30.958422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.959020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.960117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.960887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:30.961347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:30.961772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:30.994715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:55:31.094068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1fa3352-6feb-4400-b427-33c591bab7ac tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 204 len: 0 microversion: 2.1 time: 0.163532 Aug 24 01:55:31.094810 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 677/1413] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:30 2022] DELETE /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:55:31.100112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e849ed2-60b7-4561-8cdd-5537476e7b0b tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b9249ed30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.224460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=9 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:31.360478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e849ed2-60b7-4561-8cdd-5537476e7b0b tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/6205b560-d7aa-4e73-9f80-3da9862535e4" status: 202 len: 0 microversion: 2.1 time: 0.264582 Aug 24 01:55:31.361809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 678/1414] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:31 2022] DELETE /compute/v2.1/os-security-groups/6205b560-d7aa-4e73-9f80-3da9862535e4 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:31.371150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.372050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:31.384560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.385293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.385751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.387031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.388255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.388759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.408547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.418455 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9fe3c05c-8d55-4209-94ac-7836c67207e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.575798 Aug 24 01:55:31.419413 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 737/1415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:30 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:31.429672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.430873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:31.440323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.441088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.441704 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.442608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.444126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.444860 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.450335 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:31.564039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.574308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.576016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.577255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d4b139d-8155-4619-ad8a-1042160116d7 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.213715 Aug 24 01:55:31.592397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 679/1416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:31 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:31.592397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c1afb9b-87b4-4731-9fcf-d359f0899718 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b925aef70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.658667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.671181 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b4123229-738f-4118-835c-86d5fc461537 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1519 microversion: 2.1 time: 0.250587 Aug 24 01:55:31.671761 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 738/1417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:31 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:31.681938 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.682557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:31.692325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.693115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.693584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.694317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:31.695283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:31.695836 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:31.832725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c1afb9b-87b4-4731-9fcf-d359f0899718 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/bbb8de19-f03b-43c5-a365-379f2abec161" status: 202 len: 0 microversion: 2.1 time: 0.253415 Aug 24 01:55:31.836799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 680/1418] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:31 2022] DELETE /compute/v2.1/os-security-groups/bbb8de19-f03b-43c5-a365-379f2abec161 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:31.841706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01946f7f-98a5-4759-81c7-987e0ae6d6e8 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b926ce550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:31.913453 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:31.921311 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e0548a91-7551-4bcf-b147-b89d4da94c9c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1472 microversion: 2.1 time: 0.248579 Aug 24 01:55:31.921887 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 739/1419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:31 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:32.208483 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01946f7f-98a5-4759-81c7-987e0ae6d6e8 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/99737496-f252-4355-adbd-5ae613c920ba" status: 202 len: 0 microversion: 2.1 time: 0.370291 Aug 24 01:55:32.209146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 681/1420] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:31 2022] DELETE /compute/v2.1/os-security-groups/99737496-f252-4355-adbd-5ae613c920ba => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:32.217865 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d8321cf5-ee23-4bd0-9c0b-acd2ee45a064 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b92b8f940>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.424416 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d8321cf5-ee23-4bd0-9c0b-acd2ee45a064 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d4880a99-5ee2-4272-b9b7-6d4ad46d894a" status: 202 len: 0 microversion: 2.1 time: 0.210885 Aug 24 01:55:32.425283 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 740/1421] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:32 2022] DELETE /compute/v2.1/os-security-groups/d4880a99-5ee2-4272-b9b7-6d4ad46d894a => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:32.435584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b114bfdc-6ce5-4a1d-bacd-61e980f04800 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] Calling method '.version_select at 0x7f6b92052700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.442456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.443198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:32.451641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.454939 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.455719 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.457742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.458447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.460244 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.634516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:32.642416 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b258733b-c1d2-46b6-bfc7-b5dac8cbd754 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.203929 Aug 24 01:55:32.642987 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 741/1422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:32 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:32.648405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.649226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:32.656189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.657027 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.657807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.658714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.659273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.659696 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.802693 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:32.811689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:32.813344 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:32.814592 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3e3a93a8-7f68-4d5d-b2d3-8651cf8d3b5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.170432 Aug 24 01:55:32.815240 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 742/1423] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:32 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:32.820689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-plugged", "status": "completed", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:32.830227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.830780 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.831415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.844112 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] Creating event network-vif-plugged:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:55:32.849747 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-e76c5733-1b72-4f6a-a7c5-b62bcf70a23f req-f64f03d3-58bf-45b5-84b2-31447d50cde2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Aug 24 01:55:32.850759 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 743/1424] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:32.856331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b114bfdc-6ce5-4a1d-bacd-61e980f04800 tempest-SecurityGroupRulesTestJSON-36943848 tempest-SecurityGroupRulesTestJSON-36943848-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/c0d6c9cc-10b4-4710-9e7c-8a3aa4bb0bb0" status: 202 len: 0 microversion: 2.1 time: 0.426140 Aug 24 01:55:32.856788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.857089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 682/1425] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 01:55:32 2022] DELETE /compute/v2.1/os-security-groups/c0d6c9cc-10b4-4710-9e7c-8a3aa4bb0bb0 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:55:32.860998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:32.868385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.870380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.870380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.870671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.871131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.871648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.944369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:32.945558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:32.953892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.955220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.955768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:32.956491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:32.956984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:32.957424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:33.074545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:33.083084 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-220bbda3-91ad-46b7-b5a2-18154add9780 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1519 microversion: 2.1 time: 0.230701 Aug 24 01:55:33.084635 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 744/1426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:32 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:33.150165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:33.164683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c8675ca-7740-4b0c-b0b3-0eae21ce83d4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1472 microversion: 2.1 time: 0.225593 Aug 24 01:55:33.165941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 683/1427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:32 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:33.665185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:33.666499 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:33.676482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:33.677270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:33.678410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:33.679366 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:33.680146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:33.680956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:33.841382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:33.842994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:33.854001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:33.854583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:33.855365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:33.856322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:33.857767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:33.858456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:33.982535 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:33.995751 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f5ff792a-7028-4478-8a0c-a30ec4f36307 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.335689 Aug 24 01:55:34.000030 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 745/1428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:33 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:34.112237 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:34.114809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:34.127377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:34.128734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:34.130107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:34.131129 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:34.132520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:34.133175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:34.197175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:34.217226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:34.219180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:34.220589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-794eb7c2-25ea-4ce4-9672-0ea3bc41480e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.384377 Aug 24 01:55:34.221661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 684/1429] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:33 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:34.227458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:34.233864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:34.245510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:34.246219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:34.246818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:34.250218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:34.250865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:34.251485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:34.515715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:34.537355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9b6c00a-410e-4a3a-ba6f-4e1bd7844b27 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1472 microversion: 2.1 time: 0.307893 Aug 24 01:55:34.538603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 685/1430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:34 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:34.647927 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:34.655826 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3d1430c8-ccd1-494b-8e5b-6facc5c2213d tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1519 microversion: 2.1 time: 0.552690 Aug 24 01:55:34.656420 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 746/1431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:34 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1519 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:34.699964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd", "name": "network-vif-deleted", "tag": "da72d336-8c09-4067-a0be-42d0db46325f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:34.722469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:34.724832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:34.725480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:34.758163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] Creating event network-vif-deleted:da72d336-8c09-4067-a0be-42d0db46325f for instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd on n-h1-854121-3 Aug 24 01:55:34.767670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c0666670-d79d-4a8e-a91a-2322a5fadb8d req-d522b9a0-0f2d-4b86-ab52-902ccad291cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094004 Aug 24 01:55:34.768301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 686/1432] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:35.024061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:35.025668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:35.038267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.040165 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.041251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.045811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.046558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.047200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.250360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:35.250763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:35.264903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:35.269580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.270087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.273454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.274254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.275352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.275984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.503306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:35.523002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:35.524761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:35.526287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-796fd90a-cf4b-4bb8-9cf9-930671dff574 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.280646 Aug 24 01:55:35.539871 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:35.541650 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 687/1433] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:35 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:35.560055 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-012b9861-5be7-4e53-9ab9-595aef651d87 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1477 microversion: 2.1 time: 0.536272 Aug 24 01:55:35.561764 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 747/1434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:35 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1477 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:35.562979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:35.563767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:35.570454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.570773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.571216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.571923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.572432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.572872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.680081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:35.681179 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:35.688831 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.689339 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.689787 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.690511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.691126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.691684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.723822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:35.733503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44785af3-b9cd-4b02-9953-a214d6ccf3de tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.176012 Aug 24 01:55:35.734772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 688/1435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:35 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:35.745363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:35.746745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:35.747602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:35.748233 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lazy-loading 'fault' on Instance uuid f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:55:36.066967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:36.086675 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d038e82e-4834-4dca-8352-14ec414cd967 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 200 len: 1311 microversion: 2.1 time: 0.410477 Aug 24 01:55:36.087288 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 748/1436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:35 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:36.552937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:36.553547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:36.566459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.567297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.569446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.571113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.574224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.574224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.583397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:36.584933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:36.596003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.596594 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.597057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.600167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.601368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.602161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.783725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:36.803703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:36.805396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:36.806617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f064a6a4-2d4d-4c72-89b3-62d474fdc305 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.257654 Aug 24 01:55:36.807187 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 689/1437] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:36 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:36.823015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:36.823875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:36.836046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.840811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.841470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.843245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.846142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.846815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.901177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:36.909141 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-409566e6-bdff-4805-a7d7-f48835992003 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1463 microversion: 2.1 time: 0.330713 Aug 24 01:55:36.914360 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 749/1438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:36 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1463 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:36.937973 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:36.938662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:36.946475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:36.950956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.951749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.952416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:36.953391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:36.954063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:36.954721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.117985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:37.127671 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73ebe4f6-9316-429d-96a2-5feb40c94cb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.319447 Aug 24 01:55:37.140908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 690/1439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:36 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:37.156628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:37.157729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.169817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.171507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.172201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.173965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.186415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.187209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.226337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] HTTP exception thrown: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Request method failure captured: Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd HTTP/1.1 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYTSSQF0WK64lW7ChR-sZITSrUcs9GWfthwXMTNcVbg6vT8k6d0wmbaeWlqVT7ZEqH3TXIIsV7wbdvRbxYM76S3vEWAAUQAcjBKfOsE5yPp6YJ8-CE-c6-T87jpQKwnd63c4unQrjDc2yT6gjynDxAT1OPDlELX8vh9o7G1viH6vucg Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: de7aeb19b75943d89f74ada589d05055 Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd'} Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:37.227410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:37.231792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Returning 404 to user: Instance f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:37.232914 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40a9d86e-8b14-4d35-9683-de2d70d331fd tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd" status: 404 len: 111 microversion: 2.1 time: 0.087883 Aug 24 01:55:37.235995 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 691/1440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:37 2022] GET /compute/v2.1/servers/f8b8adf4-2cc8-4533-a8cf-8ee4769eeddd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:55:37.251229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:37.253943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.263195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:37.267043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.267548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.268008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.271923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.272962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.279440 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-12402790-1d38-460c-b481-b0eade13ff55 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1463 microversion: 2.1 time: 0.346245 Aug 24 01:55:37.280032 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 750/1441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:36 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1463 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:37.280818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.301029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:37.304959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.320113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.320113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.320113 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.320862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.324172 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.324988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.339913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:55:37.504915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:55:37.511331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:55:37.512336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:55:37.512966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:55:37.513635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:55:37.554864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-824f2513-7a04-4625-856b-b76421d51e9e tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 204 len: 0 microversion: 2.1 time: 0.314549 Aug 24 01:55:37.557023 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 692/1442] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:55:37 2022] DELETE /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:55:37.566682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:37.567707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.579355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.580127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.581029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.582507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.584598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.586233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.631728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.641014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.647404 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.647988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.648870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.649465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.650167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.702659 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0941098b-6f64-4f79-85b1-8434e18077e6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 1067 microversion: 2.1 time: 0.405567 Aug 24 01:55:37.710019 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 751/1443] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:55:37 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 1067 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 01:55:37.727528 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:37.728268 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:37.740854 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.741432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.741976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.742942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:37.743688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:37.744377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:37.999717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.012729 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e61e9765-9732-4c93-ad84-7830baa85990 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.289396 Aug 24 01:55:38.013984 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 752/1444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:37 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:38.019315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:38.020517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:38.031870 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:38.032656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:38.033409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:38.034341 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:38.035002 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:38.035676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:38.207465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.219612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:38.226230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b032915e-7569-49a8-9d69-d3bb7955af04 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1518 microversion: 2.1 time: 0.664273 Aug 24 01:55:38.242456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 693/1445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:37 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1518 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:38.248217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:38.248882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:38.252415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.257524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:38.258082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:38.258491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:38.259303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:38.259689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:38.260160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:38.270472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.273127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.274465 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3ee5bce1-f4db-4601-bc53-ecd507924b97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.259314 Aug 24 01:55:38.276240 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 753/1446] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:38 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:38.890375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:38.903032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a0aa6b4-9ee5-4968-bd2f-dd7a0ecf7dae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.657970 Aug 24 01:55:38.905030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 694/1447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:38 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:39.035296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:39.035922 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:39.045052 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.045674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.046230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.047044 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.047511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.047944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.056042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:39.247843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:39.257477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:39.282397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.285067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.286442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.289972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.290664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.292111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.565159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:39.575573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:39.591687 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-61b4357c-67d0-4738-b063-53f77a667cbf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.560068 Aug 24 01:55:39.597159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b601fe6-1332-44c8-86ff-4e004ab893c9 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1518 microversion: 2.1 time: 0.349276 Aug 24 01:55:39.610658 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 754/1448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:39 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:39.624571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 695/1449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:39 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:39.631343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:39.638248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:39.644832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.645729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.646791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.647545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.648228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.648915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.929881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:39.931480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:39.945604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.946108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.946549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:39.949215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:39.949681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:39.952199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.028942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.041324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.063353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.065176 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e3be037c-eeef-41e7-9fd6-418b5c734800 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.438704 Aug 24 01:55:40.066056 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 755/1450] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:39 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:40.169687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.174267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e0724b7-b135-4a07-ac51-dfee5f2fb623 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.249713 Aug 24 01:55:40.175275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 696/1451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:39 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:40.623681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:40.624429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:40.633135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f79ec99-f574-4cf9-b793-898adb636676", "name": "network-vif-deleted", "tag": "d321907d-b901-4c62-8466-aeba6f443742"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:40.649662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:40.649931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:40.650376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.659589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:40.661239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:40.669343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.670436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:40.672235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:40.673538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.677344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] Creating event network-vif-deleted:d321907d-b901-4c62-8466-aeba6f443742 for instance 5f79ec99-f574-4cf9-b793-898adb636676 on n-h1-854121-3 Aug 24 01:55:40.693315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-109ef06c-bf74-4ed8-8ff0-7b2261715c1c req-311c59fe-8f31-4d5a-bcfb-cf29a9686b19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066002 Aug 24 01:55:40.693924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 697/1452] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:40.702076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:40.703914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:40.719584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:40.722334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:40.723982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.726730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:40.727367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:40.727967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:40.863154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7aeb19b75943d89f74ada589d05055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ecd3cbcdfec4256811072c372016fb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.885494 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58c1bf3d-1e2b-4fd5-b52d-3bd711ed5dd8 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 200 len: 1305 microversion: 2.1 time: 0.189510 Aug 24 01:55:40.886480 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 698/1453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:40 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:40.926625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:40.939140 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-81706644-74ae-48bc-b13c-83dc57297146 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.320173 Aug 24 01:55:40.940320 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 756/1454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:40 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:41.093081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:41.094305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:41.122937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.123444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.123873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.124578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.125059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.125482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.196420 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:41.203176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:41.217654 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.218145 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.218583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.229574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.230361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.231019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.417017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:41.429239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:41.430874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:41.433930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7d08ebd-3c32-4470-85a3-f08cb68364b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.345661 Aug 24 01:55:41.435300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 699/1455] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:41 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:41.453716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:41.464091 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cd49e191-16ce-4ad1-af83-cca4572317bb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.271832 Aug 24 01:55:41.477792 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 757/1456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:41 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:41.909572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:41.910683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] [instance: 5f79ec99-f574-4cf9-b793-898adb636676] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:41.925408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.926149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.926767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.927505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.927956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.928375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.943704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] HTTP exception thrown: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Request method failure captured: Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 HTTP/1.1 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYTSSQF0WK64lW7ChR-sZITSrUcs9GWfthwXMTNcVbg6vT8k6d0wmbaeWlqVT7ZEqH3TXIIsV7wbdvRbxYM76S3vEWAAUQAcjBKfOsE5yPp6YJ8-CE-c6-T87jpQKwnd63c4unQrjDc2yT6gjynDxAT1OPDlELX8vh9o7G1viH6vucg Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4ecd3cbcdfec4256811072c372016fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4ecd3cbcdfec4256811072c372016fb5 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-390564609 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: de7aeb19b75943d89f74ada589d05055 Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServerFiltersTestJSON-390564609-project Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5f79ec99-f574-4cf9-b793-898adb636676'} Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:55:41.945664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] Returning 404 to user: Instance 5f79ec99-f574-4cf9-b793-898adb636676 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bff8994-7b6c-4c30-b067-5e6d3738d832 tempest-ListServerFiltersTestJSON-390564609 tempest-ListServerFiltersTestJSON-390564609-project] 10.222.0.49 "GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676" status: 404 len: 111 microversion: 2.1 time: 0.044143 Aug 24 01:55:41.950929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 700/1457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:41 2022] GET /compute/v2.1/servers/5f79ec99-f574-4cf9-b793-898adb636676 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:55:41.963172 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:41.965283 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:41.975557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.976539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.977128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:41.978317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:41.979214 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:41.981409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:42.252178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:42.264411 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-01c51821-9954-4b3f-a3a6-f939840a8816 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.304080 Aug 24 01:55:42.265065 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 758/1458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:41 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:42.466942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:42.468984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:42.486818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:42.487506 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:42.488124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:42.488762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:42.489396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:42.491207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:42.491991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:42.492667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:42.498347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:42.500463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:42.502790 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:42.505487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:42.507377 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:42.508161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:42.726480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:42.736738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:42.738545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:42.740006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af70455c-ddbd-4be6-8dfa-854e0a4f85f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.281085 Aug 24 01:55:42.740804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 701/1459] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:42 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:42.963088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:42.975045 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-972c2825-3552-4bdb-826d-25da1d1b88f8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.491255 Aug 24 01:55:42.975991 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 759/1460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:42 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:43.288272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:43.289262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:43.298004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:43.298686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:43.300637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:43.301377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:43.305422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:43.306679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:43.530391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:43.561194 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cece837-b3b9-43a5-bbeb-30f1ed2c7751 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.279958 Aug 24 01:55:43.562882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 702/1461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:43 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:43.763629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:43.764464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:43.776975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:43.777874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:43.778538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:43.779317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:43.781429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:43.782103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:43.999057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:43.999996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:44.009058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:44.009836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:44.010542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:44.012078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:44.013157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:44.013700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:44.135622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:44.151097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:44.156304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:44.161011 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8490489e-e7bd-4099-a779-06fba91b2714 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.399633 Aug 24 01:55:44.163475 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 760/1462] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:43 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:44.584108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:44.584881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:44.597209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:44.598892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:44.599792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:44.602290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:44.604143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:44.605792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:44.606892 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:44.619235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5acba35e-6e87-4a68-8a80-252921e1d31e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.623369 Aug 24 01:55:44.638304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 703/1463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:43 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:44.950278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:44.966025 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-13316fb1-c754-4e54-972f-aecddb95f44e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.386685 Aug 24 01:55:44.966610 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 761/1464] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:44 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:45.186833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:45.187448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:45.199581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:45.200075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:45.200509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:45.204438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:45.204947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:45.205585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:45.498955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:45.512514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:45.516560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:45.520596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1678f4a8-2386-4dfd-8691-911104f92dc5 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.337891 Aug 24 01:55:45.525120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 704/1465] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:45 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:45.643926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:45.644563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:45.654316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:45.654822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:45.659616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:45.660464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:45.660967 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:45.661776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:45.991976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:45.992645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:46.010088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:46.012445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:46.012953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:46.016023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:46.016646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:46.018143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:46.058140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:46.072810 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1fe9e29c-1754-42f9-842e-546b6b5f177c tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.432972 Aug 24 01:55:46.074403 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 762/1466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:45 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:46.358067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:46.369555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8554b426-f031-443e-8c5b-07bdf5056528 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.383363 Aug 24 01:55:46.372750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 705/1467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:45 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:46.545872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:46.546533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:46.555636 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:46.556136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:46.557857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:46.559829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:46.560359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:46.562572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:46.954462 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:46.966915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:46.968561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:46.972584 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-26c5637c-cd4e-4d82-8f3d-2d14280a18f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.430684 Aug 24 01:55:46.973282 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 763/1468] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:46 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:47.096801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:47.102543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:47.111249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:47.111791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:47.112282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:47.113156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:47.114094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:47.115079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:47.397772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:47.398784 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:47.411435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:47.412037 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:47.412566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:47.413815 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:47.414292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:47.414725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:48.046829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:48.062568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:48.066884 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-310d071c-feb5-4e41-b45d-236876f2b350 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.671986 Aug 24 01:55:48.068943 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 764/1469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:47 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:48.074375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:48.078887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:48.086797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-235bb32d-9a46-441d-8467-4cd2a8160fe3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.996108 Aug 24 01:55:48.093434 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 706/1470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:47 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:48.105818 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:48.107606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:48.108960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:48.110441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:48.113183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:48.113739 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:48.426081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:48.442389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:48.448678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:48.450340 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6b864d9f-aa11-4bc5-bf3f-e9eeb4922e83 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.379728 Aug 24 01:55:48.473387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1810257118", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:48.478972 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 765/1471] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:48 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:48.537266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:55:48.589529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "name": "network-vif-unplugged", "status": "completed", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:48.599576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:48.600364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:48.601087 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:48.614022 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] Creating event network-vif-unplugged:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h2-854121-3 Aug 24 01:55:48.619662 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-dfcb52aa-094b-44ae-85dc-d068a9eb5c17 req-f48ded64-8211-43be-a8fd-eb9df4f59cdc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033605 Aug 24 01:55:48.621057 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 766/1472] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:49.091284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:49.092948 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:49.101641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.102432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.103097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.104463 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.105189 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.105847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.394256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:49.403213 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-95580e97-503f-4d18-9ba5-184d65228436 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.317187 Aug 24 01:55:49.417102 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 767/1473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:49 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:49.422163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:49.423013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:49.429482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.430232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.430838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.431719 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.432342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.433034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.595332 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:49.617450 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bf61d088-6bf0-4b03-9fc3-79f99fe23fb1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.188612 Aug 24 01:55:49.620000 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 768/1474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:49 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:49.626612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:49.627981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:49.637885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.638699 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.640139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.641447 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.643634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.644995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.732853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:55:49.733774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:55:49.734412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:55:49.734974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:55:49.742038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:55:49.760177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.762005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.763473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.765321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:49.771389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:49.773980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:49.817519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:55:49.833917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:55:49.869564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:55:49.873357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:49.878164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:55:49.886480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:49.889331 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:49.890710 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-be20d0bc-6a5b-4bf8-bf0e-1553e8bd4e9f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.269295 Aug 24 01:55:49.902841 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 769/1475] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:49 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:49.955630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcdb7f61-5032-414b-9d6d-6b2929fe37dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.726988 Aug 24 01:55:49.962021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 707/1476] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:55:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 01:55:49.970042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-be7e2005-d55b-438a-864d-138c682f4dc6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:49.970674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-be7e2005-d55b-438a-864d-138c682f4dc6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:50.107316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-be7e2005-d55b-438a-864d-138c682f4dc6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:50.122259 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-be7e2005-d55b-438a-864d-138c682f4dc6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1215 microversion: 2.1 time: 0.156143 Aug 24 01:55:50.123751 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 770/1477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:49 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:50.423860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:50.424483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:50.438217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:50.438758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:50.439141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:50.439854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:50.440312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:50.440751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:50.639493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:50.640215 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:50.665324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:50.674300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:50.675068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:50.675999 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:50.676629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:50.677856 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.023208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.036021 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-69365c75-8d39-4160-9a8d-c1ebd758c9c5 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.400501 Aug 24 01:55:51.040317 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 771/1478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:50 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:51.060579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:51.077284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:51.078133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:51.078731 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.094209 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] Creating event network-changed:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h2-854121-3 Aug 24 01:55:51.100968 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-034d17c6-db78-4f4f-937b-4c2f359ad9fa req-2d2b5875-c216-40e3-94af-d0e3c54081d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050287 Aug 24 01:55:51.101931 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 772/1479] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:55:51.111508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:51.113001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:51.119931 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:51.120683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:51.121360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.122387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:51.125365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:51.126101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.235022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:51.701714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.734588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf338661-35d1-42d4-b185-7a58d4d22f36 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 1.314451 Aug 24 01:55:51.753340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 708/1480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:50 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:51.769850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:51.774768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:51.787079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:51.788756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:51.789674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.790713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:51.792267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:51.792903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:51.928613 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.932926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.942380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.945057 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:51.946469 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-218286ef-8a71-48d8-911a-9070d94900c6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.839460 Aug 24 01:55:51.947321 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 773/1481] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:51 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:51.949713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb2465e1-3949-4814-9a91-7eb5416eb497 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1267 microversion: 2.1 time: 0.188822 Aug 24 01:55:51.964748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 709/1482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:51 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:52.064208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:52.065138 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:52.081411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:52.081914 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:52.082356 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:52.083606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:52.084088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:52.084519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:52.367890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:52.379564 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6ad0b4d6-39b3-46d4-83ef-19c3699ab350 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.322311 Aug 24 01:55:52.380790 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 774/1483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:52 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:52.763726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:52.764349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:52.800931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:52.809495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:52.810228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:52.816832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:52.818130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:52.820841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:52.975209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:52.987510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:53.008257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.014140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.014577 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.015345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.015837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.016269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.214891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.235525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ac16864-98d9-48b0-b63e-842acc91a48c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.475832 Aug 24 01:55:53.237686 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 710/1484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:52 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:53.243313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:53.251074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:53.281116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.281116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.281322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.284330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.285093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.286073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.440193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.455508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bf5d7bf-89c3-48a2-80de-536fed7bcdd7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1273 microversion: 2.1 time: 0.216423 Aug 24 01:55:53.456167 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 711/1485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:53 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:53.461524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:53.464463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:53.500186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.501178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.502168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.503196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:53.503855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:53.504485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:53.534981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:53.692077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.702029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.710342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.712095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:53.712757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5635f2d-e538-4c66-bef6-a4970bd5f134 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.255414 Aug 24 01:55:53.718028 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d0918b9f-5751-4eca-98f2-027c8699b765 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.750336 Aug 24 01:55:53.719298 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 775/1486] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:52 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:55:53.723004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 712/1487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:53 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:54.261156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:54.262582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:54.271682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.272509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.273198 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.274436 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.275284 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.275924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.493210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:54.493750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:54.505914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.506407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.514242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.515299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.516003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.516630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.676465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:54.688577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c78eb84f-52d0-49e6-8fb6-6503ab757292 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1273 microversion: 2.1 time: 0.214792 Aug 24 01:55:54.689298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 713/1488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:54 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:54.744035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:54.744678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:54.753327 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:54.755898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.756407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.758534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.760882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.761587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.763154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.771838 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b5d1ecb5-153e-431e-94ce-7e5bfe704c13 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.516540 Aug 24 01:55:54.785383 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 776/1489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:54 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:54.795814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:54.796791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:54.805078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.806143 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.806745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:54.807656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:54.808279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:54.809542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:55.047245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:55.063172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6483abf6-eb2d-4f55-92bf-2e9dca91d661 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.327479 Aug 24 01:55:55.064047 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 714/1490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:54 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:55.190498 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:55.211749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:55.214625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:55.215877 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1fcb1bc9-ef28-4ad9-b174-7bcb55e0b884 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.429135 Aug 24 01:55:55.221376 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 777/1491] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:54 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:55.710429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:55.711186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:55.721014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:55.721861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:55.722511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:55.723482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:55.724828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:55.725475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:55.797689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:55.798710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:55.814196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:55.816665 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:55.817161 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:55.821898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:55.823119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:55.823465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:55.996376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.010967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31f9475d-fd20-4861-94e5-e7add1651282 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.304733 Aug 24 01:55:56.011974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 715/1492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:55 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:56.088214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:56.088975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:56.101924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:56.102947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:56.103779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:56.105198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:56.111780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:56.112408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:56.416383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.427398 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cfca481a-4796-4f6e-b501-2ba9c9efa4ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.635395 Aug 24 01:55:56.431190 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 778/1493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:55 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:56.447919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:56.450347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:56.457437 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:56.458767 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:56.459408 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:56.464249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:56.465085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:56.465711 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:56.574197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.584750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-576a9c6f-fcd0-4065-8317-58f525c5ae99 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.502119 Aug 24 01:55:56.597301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 716/1494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:56 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:56.900277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.916676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.919224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:56.920652 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fe32d8e6-39a9-4879-b8d0-2e9a13cc39eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.488272 Aug 24 01:55:56.921756 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 779/1495] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:56 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:57.035047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:57.037275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:57.049658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.051497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.053826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.055942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.060851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.062074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.410936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:57.423746 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93369ee8-1f4e-4b17-8603-c6ea23bce574 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.395624 Aug 24 01:55:57.428896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 717/1496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:57 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:57.451844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:57.452783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:57.461078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.461584 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.465988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.474116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.478467 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.480398 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.609084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:57.610039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:57.619405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.621859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.622312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.623850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.631600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.634369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.916166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:57.928561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83dc7f17-7632-4abc-bd33-df4d73a8a991 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.322396 Aug 24 01:55:57.930742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 718/1497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:57 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:55:57.958823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:57.959879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:57.974295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.975286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.975967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:57.977133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:57.978444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:57.980101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:58.111944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:58.125079 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cef15ad1-1164-4dab-b462-18678641d1cc tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.678066 Aug 24 01:55:58.125681 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 780/1498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:57 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:58.275500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:58.290691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:58.292909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:58.294282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4128dc57-29df-46e0-ab23-777ca18e88ed tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.346148 Aug 24 01:55:58.296089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 719/1499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:57 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:58.434746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd70666-4f4f-4932-b661-f801dcc16441", "tag": "56fdb552-6a07-4abb-bd85-b60870063f1c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:58.458475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:58.459432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:58.461311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:58.509292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] Creating event network-changed:56fdb552-6a07-4abb-bd85-b60870063f1c for instance dfd70666-4f4f-4932-b661-f801dcc16441 on n-h2-854121-3 Aug 24 01:55:58.526997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d43064cd-496c-46cc-8e41-7ea58d6f04a2 req-9128a533-8d42-45f7-8fb9-abe48b30c1b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094518 Aug 24 01:55:58.529299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 720/1500] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:55:58.538940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:58.544690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:58.561885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:58.564124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:58.564593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:58.570173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:58.570749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:58.573115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:58.655162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-488282950", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:55:58.751363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] validate_networks() for [('123baaa0-ecb4-444d-bb74-daf968f733de', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:55:58.775812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:58.784521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5e8603e-3a8f-4f84-a017-0bf233f7562f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.253749 Aug 24 01:55:58.785323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 721/1501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:58 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:58.955667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:58.956600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:58.967888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:58.972559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:58.974157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:58.975087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:58.977105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:58.978988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.211090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:59.229467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a179492-1863-4340-9502-e29e69dbf386 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.278023 Aug 24 01:55:59.230634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 722/1502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:58 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:59.235700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:59.236495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:59.244887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.245597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.246280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.247131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.247731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.259003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.475278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:59.523607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d02dd2f8-9145-4291-bf2e-9b0bbdf9275b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.283473 Aug 24 01:55:59.526514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 723/1503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:59 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:55:59.532640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:59.533494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:59.559166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.561472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.564675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.566173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.566818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.568591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.797241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:59.857190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:55:59.864504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:59.897223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:59.899927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:55:59.901992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e176ddb2-df3d-43ce-aa2f-1d8339456f36 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.373395 Aug 24 01:55:59.903339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 724/1504] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:55:59 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:55:59.919284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:55:59.923718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:55:59.936168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.936964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.944244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:55:59.945547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:55:59.946171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:55:59.946756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.119068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:00.200890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:00.213627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fb8f685-f11c-408f-b08b-b4632e89b054 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.303581 Aug 24 01:56:00.214502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 725/1505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:55:59 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:00.255420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:00.256452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:00.268109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.269005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.269604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.270521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.282827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.285085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.444964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:56:00.445615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:56:00.446151 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:56:00.446747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:56:00.447011 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:56:00.466077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.466802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.467415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.468324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.468977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.471396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.514020 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Getting quotas for project ca375751092f40f79f187cab5c6c9b76. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:00.524249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Getting quotas for user a45857c939914f98bc0ea5d2350817b9 and project ca375751092f40f79f187cab5c6c9b76. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:00.560944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:56:00.578542 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:56:00.602859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:00.616210 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e27f4f8b-1990-4120-bcb4-7462e978b200 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.366095 Aug 24 01:56:00.619818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 726/1506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:00 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:00.635544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:00.636435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:00.647961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:00.649896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.655113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.656978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.658064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:00.658844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:00.659609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:00.714485 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3c0cc0fb-f38b-4d5e-953b-ce844ad4ff4d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347952 Aug 24 01:56:00.715664 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 781/1507] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:55:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:56:00.756653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1fe184e5-7864-4555-b108-de18b50e77ca tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:00.760986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1fe184e5-7864-4555-b108-de18b50e77ca tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:00.938978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1fe184e5-7864-4555-b108-de18b50e77ca tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:00.955935 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1fe184e5-7864-4555-b108-de18b50e77ca tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1216 microversion: 2.1 time: 0.209290 Aug 24 01:56:00.960984 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 782/1508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:00 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:00.979849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:00.987970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:01.009867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.010223 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.011042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.014804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.015321 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.015769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.061805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:01.102174 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75773232-379e-4b6e-bc78-64bebce2ee0a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.477748 Aug 24 01:56:01.103941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 727/1509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:00 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:01.238109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:01.239447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:01.252347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.254315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.257304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.260332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.262013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.262757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.573600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:01.587851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e236374-ff29-4a76-a793-c22b6a99a7dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.355186 Aug 24 01:56:01.592100 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 728/1510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:01 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:01.644878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:01.650334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:01.661426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.664175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.666838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.667828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:01.669258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:01.670745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:01.983409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:01.990688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:01.995275 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a146a78-c28b-4c99-872d-82ae0457cd29 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.354497 Aug 24 01:56:02.011184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 729/1511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:01 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:02.018153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:02.019156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:02.028117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.029861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.030530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.031814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.032462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.033142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.156369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.173457 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.181358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.186918 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0c15d94e-4b9c-4c66-a33a-a684edbc568e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 1.224488 Aug 24 01:56:02.195288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.201600 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 783/1512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:00 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:02.205345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-639f0e34-9b2c-4c8f-a264-03779dbcc71c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1212 microversion: 2.1 time: 0.191813 Aug 24 01:56:02.205925 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 730/1513] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:02 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1212 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:02.222135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:02.223355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:02.235434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.242486 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.243301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.244557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.245265 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.245757 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.615833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:02.623493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:02.636376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.636920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.637387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.638107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:02.638569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:02.639006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:02.903769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.913556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-129d2f18-3562-4ef2-b475-81dee3ab1671 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.303148 Aug 24 01:56:02.926349 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 731/1514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:02 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:02.959126 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:02.971854 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b76bcfc6-ae65-4452-abdb-a2f23ca4333a tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.768917 Aug 24 01:56:02.972445 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 784/1515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:02 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:03.017117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:03.017732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:03.029588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.030453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.030570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.031463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.031933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.032364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.221066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:03.224359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:03.259589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.260425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.261159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.261876 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.262490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.263082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.372383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:03.383019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-476a7b7c-c7af-4b60-aab7-bd01619862c9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.369708 Aug 24 01:56:03.386600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 732/1516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:03 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:03.403243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:03.404145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:03.422321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.422896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.423260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.424046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.424424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.424874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.513064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:03.526126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d067088-1594-423d-8174-10183faf2668 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1274 microversion: 2.1 time: 0.137111 Aug 24 01:56:03.536788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 733/1517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:03 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:03.734286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:03.746935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:03.748471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:03.749785 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f4340b5b-0756-48c7-b001-95d146465c6d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.533115 Aug 24 01:56:03.760380 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 785/1518] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:03 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:03.934292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:03.934905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:03.945708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.946201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.946633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.951219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:03.951717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:03.952153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:03.998339 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:03.998955 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:04.012616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:04.013042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:04.013537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:04.014365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:04.032959 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:04.033407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:04.861689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:04.874893 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ea451fc5-fc1d-4bee-9acf-40d2da6bcb85 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.880915 Aug 24 01:56:04.885117 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 786/1519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:03 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:04.885250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:04.897425 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-142aee79-e41d-48b9-ab9e-c825c6f157a2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.962950 Aug 24 01:56:04.899247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 734/1520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:03 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:04.919530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:04.920429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:04.932369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:04.934615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:04.935174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:04.935792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:04.936256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:04.936684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.114489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:05.121606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:05.143484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.144281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.145128 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.146601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.147391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.147988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.244330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:05.253566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95a70388-89d2-4a0e-a449-d0f5efd3826f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.338202 Aug 24 01:56:05.267913 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 735/1521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:04 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:05.274823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:05.275469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:05.290017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.290896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.290896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.291568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.292002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.296269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.596162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:05.614517 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f7f120fa-78cf-40e6-8181-34c0ffe474e1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.735444 Aug 24 01:56:05.616840 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 787/1522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:04 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:05.619254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:05.633218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:05.634766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:05.635961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62c7a88e-333f-4f00-a5bd-3ae885b2fad9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.376820 Aug 24 01:56:05.636524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 736/1523] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:05 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:05.896843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:05.897475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:05.908988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.909491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.909931 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.912142 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.912608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.914430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.920103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:05.920758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:05.931735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.932229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.932836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:05.933630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:05.934085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:05.934510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.150180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:06.164608 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b7cfaf61-f4c6-47bc-b569-8b1ae13fc947 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.272882 Aug 24 01:56:06.177005 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 788/1524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:05 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:06.183758 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:06.184376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:06.186920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:06.193596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.194251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.195051 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.196000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.196530 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.197153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.228969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:06.268385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:06.279890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7fa8a69-7212-4ca5-8d9e-05c4fe52f735 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.364054 Aug 24 01:56:06.281495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 737/1525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:05 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:06.288280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:06.288926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:06.295818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.296536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.297149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.297910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:06.298202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.298794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.299416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.350337 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-be18176d-4d6a-4d5f-9dc6-73a8efbc215b tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 204 len: 0 microversion: 2.1 time: 0.171248 Aug 24 01:56:06.351222 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 789/1526] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:06 2022] DELETE /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:06.368267 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:06.369149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:06.375857 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.376684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.377407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.378350 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.379292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.380838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.539508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:06.539737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:06.548046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d30916bb-c87a-4fec-ba50-dcf015e87a48 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.265152 Aug 24 01:56:06.553454 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4197cace-0114-4d2d-beab-44fc56de1d69 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1714 microversion: 2.1 time: 0.195299 Aug 24 01:56:06.566915 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 790/1527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:06 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:06.567108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 738/1528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:06 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:06.635707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:06.636343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:06.643317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.644082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.644825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.646631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.647323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.647905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.733085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:06.747685 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.748176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.748601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.768283 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] Creating event network-changed:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h1-854121-3 Aug 24 01:56:06.775796 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-8180afc6-21e2-4108-bad0-c55912fc18f0 req-0655a49e-210d-41df-9d65-09706d9dc3db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169119 Aug 24 01:56:06.776593 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 791/1529] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:06.788541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:06.789882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:06.797603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.798906 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.799611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:06.800591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:06.801893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:06.802544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.004889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.015370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6298f792-7f0d-4644-a00a-e358a800f77b tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1477 microversion: 2.1 time: 0.383623 Aug 24 01:56:07.024763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 739/1530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:06 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:07.180323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.189575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:07.190205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:07.214033 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.216017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.216447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.216939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.220535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.222062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.222504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.225605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.232148 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc7868d2-47cd-4bb0-842b-a01b2ed84236 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.448137 Aug 24 01:56:07.238059 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 792/1531] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:06 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:07.295975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd70666-4f4f-4932-b661-f801dcc16441", "name": "network-vif-plugged", "status": "completed", "tag": "56fdb552-6a07-4abb-bd85-b60870063f1c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:07.318598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.322889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.328744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.354388 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] Creating event network-vif-plugged:56fdb552-6a07-4abb-bd85-b60870063f1c for instance dfd70666-4f4f-4932-b661-f801dcc16441 on n-h2-854121-3 Aug 24 01:56:07.377791 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-8ae13c93-d17e-42d4-abcf-9f60a6bb3f24 req-6f7acb8a-e311-4fc7-ae03-d0bdf3316f2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089494 Aug 24 01:56:07.382182 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 793/1532] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:07.389007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:07.392851 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:07.410286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.410286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.410511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.411887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.412533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.413219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.600879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.617273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57b29c8b-38cf-4915-a811-03105431751d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.432599 Aug 24 01:56:07.631452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 740/1533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:07 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:07.636675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:07.644423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:07.669632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.670134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.670618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.671269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.671724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.672151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.706336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.720896 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-eaf67b4c-802a-4450-bb37-6ebf90e98a41 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.337201 Aug 24 01:56:07.721488 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 794/1534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:07 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:07.727415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:07.728236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:07.745611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.746393 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.747030 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.747920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:07.748541 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:07.749163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:07.860913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.875965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97085234-2775-4ec4-bddf-a46c73d59707 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.243003 Aug 24 01:56:07.878058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 741/1535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:07 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:07.936253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:07.947487 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e979468c-6551-47c8-8198-a791dc3181d4 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1714 microversion: 2.1 time: 0.223457 Aug 24 01:56:07.961340 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 795/1536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:07 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1714 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:08.046879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:08.049572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:08.058226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.059112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.059637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.060611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.061291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.061906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.241758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:08.255119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:08.256515 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:08.262878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff9f8cd9-4951-4177-acef-50b4a4f2b49a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.208989 Aug 24 01:56:08.264624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 742/1537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:08 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:08.267199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.267901 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.268531 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.269445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.270125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.270753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.568784 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:08.582015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:08.584317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:08.586045 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d8745648-74de-476a-8237-3f0e76fce1b3 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.334205 Aug 24 01:56:08.597504 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 796/1538] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:08 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:56:08.639150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:08.640460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:08.651048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.651674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.652203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.653043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.653592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.654113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.742108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:08.742603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:08.749249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.749748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.750689 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.750890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.751347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.751772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.831650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:08.842888 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b06aa381-f841-4090-ab4c-0bf16ab27634 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.207895 Aug 24 01:56:08.851285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 743/1539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:08 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:08.900033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:08.900647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:08.910965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.911616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.912096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:08.913554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:08.914421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:08.915012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.029077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.037220 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ce7e8945-1247-4236-a59a-639dd1202ca0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.298994 Aug 24 01:56:09.037813 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 797/1540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:08 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:09.093053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.106432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fff0897a-25d9-4080-bab1-e1554221576a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.210895 Aug 24 01:56:09.124490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 744/1541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:08 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:09.133246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:09.137297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:09.139646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "name": "network-vif-unplugged", "status": "completed", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:09.143425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.143920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.144752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.145509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.145966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.146821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.162715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.163827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.165971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.207686 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Creating event network-vif-unplugged:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h2-854121-3 Aug 24 01:56:09.222020 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:56:09.247252 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-1a11bc15-1024-449d-b7cd-47775f7259bd req-57fe425f-f074-4296-9397-33305e4b2fda service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.208169 Aug 24 01:56:09.247959 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 798/1542] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:09.287673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:09.289173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:09.297367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.298227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.298897 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.299949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.300644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.302595 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.332674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.359146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2cc2b8d-a899-48bf-8155-2db735b9d7b7 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1714 microversion: 2.1 time: 0.232252 Aug 24 01:56:09.360067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 745/1543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:09 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1714 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:09.470263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.479392 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f30d97c1-5843-4b66-aa97-9d855886a901 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.196633 Aug 24 01:56:09.479877 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 799/1544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:09 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:09.609684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:09.610489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:09.618400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.618900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.619493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.620216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.626726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.627177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.666676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:09.795942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.806231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.808335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:09.809773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec73fc3-1b45-473f-a80c-1eb5413913dc tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1813 microversion: 2.25 time: 0.203958 Aug 24 01:56:09.810519 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 746/1545] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:09 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1813 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:09.863650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:09.864523 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:09.870873 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.871374 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.871814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:09.872513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:09.872992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:09.873417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.047512 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:10.058562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:10.059022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:10.059472 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5965a4a8-92c1-4c24-bf4c-c3f4ae6088ab tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1472 microversion: 2.1 time: 0.199610 Aug 24 01:56:10.068239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.069991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.071194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.072688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.073415 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 800/1546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:09 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1472 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:10.073909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.074550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.132976 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:10.134459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:10.142847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.143413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.143988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.145384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.145936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.146714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.227416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:10.247761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c2e4f4d-ed01-47d9-88e9-3bf08aa7ed33 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.192675 Aug 24 01:56:10.249085 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 747/1547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:10 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:10.384789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:10.387796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:10.402993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.405365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.406454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.408500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.409222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.410081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.478588 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:10.492265 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b5dceeea-5d9e-4aea-b624-1095c129aaa5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.360900 Aug 24 01:56:10.492978 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 801/1548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:10 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:10.503688 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:10.505411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:10.535985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:10.537707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.538271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.540397 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.542678 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.543166 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.543608 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.650251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:10.666493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fb0ba73-0228-4493-b500-5497ff93a28d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1714 microversion: 2.1 time: 0.289385 Aug 24 01:56:10.671468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 748/1549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:10 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1714 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:10.835284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:10.838996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:10.848606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.850011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.850465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.851176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:10.851636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:10.852062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:10.947334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:11.219135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.219307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.228137 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5c969201-99be-4dc5-9429-ee5533be9160 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.728688 Aug 24 01:56:11.229383 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 802/1550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:10 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:11.234640 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:11.235482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:11.243092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.243769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.243900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.244516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.245396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.245854 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.246251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.246459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.252968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebb69b6b-f575-4c1b-acc5-15e98704b632 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1803 microversion: 2.25 time: 0.417818 Aug 24 01:56:11.268732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 749/1551] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:10 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1803 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:56:11.279922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:11.284968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:11.297253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.299371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.300595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.303022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.304460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.305649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.509072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.524956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8dbf2419-2d52-46e0-a990-aee1d8c26f9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1315 microversion: 2.1 time: 0.243683 Aug 24 01:56:11.537946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 750/1552] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:11 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:11.543181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51e95652-0182-4edd-94ae-540921275e2a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '.version_select at 0x7f6b92227040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:11.552049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51e95652-0182-4edd-94ae-540921275e2a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.560508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51e95652-0182-4edd-94ae-540921275e2a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.561142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51e95652-0182-4edd-94ae-540921275e2a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.594944 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51e95652-0182-4edd-94ae-540921275e2a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 4054 microversion: 2.25 time: 0.055357 Aug 24 01:56:11.609845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 751/1553] 10.222.0.49 () {60 vars in 1184 bytes} [Wed Aug 24 01:56:11 2022] GET /compute/v2.1/os-migrations => generated 4054 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:11.638060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:11.643015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:11.668622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.669900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.672307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.676829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:11.685243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:11.689095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:11.976530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:11.985295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18f77b00-2833-43df-9826-52606313ba72 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.373065 Aug 24 01:56:11.986562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 752/1554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:11 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:12.002885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.004403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.021659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.022342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.026527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.027294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.027764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.028197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.233484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:12.251667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49cdfc0f-7411-4e85-82dd-37049e826956 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 2421 microversion: 2.25 time: 0.263049 Aug 24 01:56:12.252577 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 753/1555] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:11 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 2421 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:12.259594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.260578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.267926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:12.269531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.270799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.271272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.272010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.272897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.273338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.280097 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e000fa9c-c11c-4628-ae2b-834fa0811bf6 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 1.049402 Aug 24 01:56:12.284984 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 803/1556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:11 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:12.298064 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:12.321910 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.322642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.323972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.364243 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Creating event network-changed:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h2-854121-3 Aug 24 01:56:12.378465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:56:12.408362 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c0765d5a-8276-4245-a720-4c2a83775e88 req-2e198590-e8be-4bd7-8a26-2fd413b82930 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121195 Aug 24 01:56:12.411361 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 804/1557] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:12.420309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.421429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.430326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.430958 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.435031 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.436249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.437804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.438912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.475422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:12.491474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e81f2dce-afc7-49b3-8d8d-2f23e3cf7273 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1714 microversion: 2.1 time: 0.236690 Aug 24 01:56:12.492949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 754/1558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:12 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1714 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:12.497680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.498510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.505319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.506015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.506634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.507923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.508583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.509390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.672035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:12.705925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9fca01c-aaab-46fa-a203-522a5dbb109a tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 2421 microversion: 2.25 time: 0.211537 Aug 24 01:56:12.706547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 755/1559] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:12 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 2421 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:12.711386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.712665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.719005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.719483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.719926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.720627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.721121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.721549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.893707 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:12.897247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:12.903663 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8c801829-ee77-4e45-ab74-4b865435954d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.490910 Aug 24 01:56:12.904527 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 805/1560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:12 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:12.920979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00626483-f265-4b94-8db0-aeb1bbf4154e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1503 microversion: 2.1 time: 0.199041 Aug 24 01:56:12.920979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 756/1561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:12 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:12.920979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.920979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.927347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.928147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.928596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.929524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.929987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.930445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.946661 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:12.948272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:12.975158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.976491 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.977311 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:12.978769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:12.980032 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:12.981380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.034545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:13.105622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:13.142574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lazy-loading 'services' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:13.150630 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f9042c3a-5791-45ec-9c0b-bac604ad786f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 204 len: 0 microversion: 2.1 time: 0.209802 Aug 24 01:56:13.151901 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 806/1562] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:12 2022] DELETE /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 01:56:13.161570 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.162353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.171469 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.172864 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.173409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.174249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.174814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.175470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.323175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2a1a0f8-5e9b-4681-9c4b-a4e68bba3d97 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments/61d9bc83-fe5d-4829-8797-49b07f7f0bb6" status: 202 len: 0 microversion: 2.25 time: 0.412859 Aug 24 01:56:13.324675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 757/1563] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 24 01:56:12 2022] DELETE /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments/61d9bc83-fe5d-4829-8797-49b07f7f0bb6 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:13.334024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.335588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.350224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.350833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.351340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.352168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.352659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.353376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.546855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:13.554876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5deb3803-e020-4bdc-a8a4-85161cc4f6d1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1509 microversion: 2.1 time: 0.228323 Aug 24 01:56:13.555779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 758/1564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:13.560786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.561889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.573081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.574134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.575151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.576110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.576866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.577245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.603734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:13.617366 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e3b452e6-5ee1-41c0-9b07-27207f5694f7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.463254 Aug 24 01:56:13.619121 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 807/1565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:13.644483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.647507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.654046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.654470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.654902 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.655863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.656567 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.657205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.708338 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-23a7201d-5847-424c-9575-197821cb7638 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071670 Aug 24 01:56:13.709961 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 808/1566] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:13.714843 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "name": "network-vif-plugged", "status": "completed", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:13.729829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.730324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.730913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.756324 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] Creating event network-vif-plugged:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h1-854121-3 Aug 24 01:56:13.775621 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-2fdfcfc1-26a7-4e28-a591-06d0ad689f73 req-00915ed9-2116-427a-af30-1ec596dc9215 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064275 Aug 24 01:56:13.776612 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 809/1567] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:13.785473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:13.786989 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.787875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.798787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c502f8dd-90ee-4626-a907-f3d572ea7b1b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.240756 Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.812748 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.815332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 759/1568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:13.910300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:13.922505 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8ee4fb18-0d85-4056-ad49-871d07f1a76c tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1646 microversion: 2.1 time: 0.144218 Aug 24 01:56:13.923868 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 810/1569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1646 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:13.943894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:13.944786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:13.955110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.957591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.963893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:13.964853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:13.965486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:13.966071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.284684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:14.293945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90b1d2c0-2c68-4ba9-9a5e-4e7cb78e27a8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.354879 Aug 24 01:56:14.295544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 760/1570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:13 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:14.432383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a368057-1352-4198-85e8-dd6cdd0cd104", "name": "network-vif-deleted", "tag": "d5eb0634-e3b1-4c6b-9af2-c0560042930b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:14.445336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.446047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.447924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.460844 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] Creating event network-vif-deleted:d5eb0634-e3b1-4c6b-9af2-c0560042930b for instance 9a368057-1352-4198-85e8-dd6cdd0cd104 on n-h2-854121-3 Aug 24 01:56:14.465963 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-fd593869-9414-49ce-8c0d-131c461055ab req-b96dc1ab-f4b3-4d6b-a4b7-e06c3de464ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037522 Aug 24 01:56:14.467079 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 811/1571] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:14.590326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:14.590951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:14.601777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.602630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.603739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.604630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.606290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.606907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.643148 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:14.645291 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:14.667658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.669982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.670459 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.672646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.673162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.673679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.804774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:14.817156 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1ff5c0f-f76c-4424-b769-ed7a2bdbe048 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1509 microversion: 2.1 time: 0.234999 Aug 24 01:56:14.818030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 761/1572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:14 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:14.823277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:14.831637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:14.843857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.844666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.845425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.846365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.847221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.847925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.867088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:14.880084 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-024e47e3-5ad6-4917-b41f-47c1742851cf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1316 microversion: 2.1 time: 0.240399 Aug 24 01:56:14.880959 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 812/1573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:14 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:14.892884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:14.900549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26e23b02-42dd-4d57-a6d0-b1782aa18eac tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080811 Aug 24 01:56:14.903081 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:14.903807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:14.905254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 762/1574] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:14 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:14.911287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.911965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.912583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.913691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.917363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.918154 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.949820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:14.950945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:14.981181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.981683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.982125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:14.982843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:14.983299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:14.983732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.114466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:15.130634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b215115-91c8-4d03-9410-6bd94b7330d8 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1646 microversion: 2.1 time: 0.186854 Aug 24 01:56:15.144766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 763/1575] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:14 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1646 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:15.307384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:15.318329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:15.318945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:15.321581 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3afd556b-c288-4619-8bfb-aa12685b003b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.425116 Aug 24 01:56:15.329957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.330457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.330898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.336771 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 813/1576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:14 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:15.337176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.337675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.338123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.517394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:15.529758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e180e4f5-cfa8-4a6c-8187-fa07fb1cb0e6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.215976 Aug 24 01:56:15.530934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 764/1577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:15 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:15.839009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:15.840008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:15.846679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.848959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.849911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.851134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.854173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.858136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.923875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-unplugged", "status": "completed", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:15.937725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.939089 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.939679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.955592 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] Creating event network-vif-unplugged:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:56:15.962436 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-cbdca3ee-3916-474c-b232-9651efce6b13 req-4a3749b6-3bc5-440b-b8ae-1161b3812a06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147800 Aug 24 01:56:15.965695 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 814/1578] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:15.974553 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:15.975701 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:15.988361 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.991255 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.991712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:15.992465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:15.993405 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:15.994258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.017505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:16.027319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2797373b-20ab-41b5-9251-026ceb95d7d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1509 microversion: 2.1 time: 0.192108 Aug 24 01:56:16.028384 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 765/1579] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:15 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:16.033854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:16.036756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:16.044280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.045169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.045853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.046808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.047492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.048161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.084527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1433f2c8-aeba-4c31-8d59-3818c07105e8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054692 Aug 24 01:56:16.085737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 766/1580] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:16 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:16.159946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:16.161066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:16.166164 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:16.167659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.168302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.168656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.169391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.170164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.170289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.174775 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b7640d8f-af58-4716-8ab0-656775a9bcf9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.207609 Aug 24 01:56:16.176464 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 815/1581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:15 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:16.241085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:16.250563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebbe2fd8-c82e-4edd-9bd2-32c3c2584d25 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1349 microversion: 2.1 time: 0.097074 Aug 24 01:56:16.260841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 767/1582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:16 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:16.263006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-237597358", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:16.321606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] validate_networks() for [('123baaa0-ecb4-444d-bb74-daf968f733de', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:56:16.342851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:16.343750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:16.351640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.352366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.353077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.353997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.354665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.355328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.604986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:16.632708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d323e312-85c4-4c19-ada6-4289c2dc6445 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.293650 Aug 24 01:56:16.650375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 768/1583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:16 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:16.670793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:16.673874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:16.690385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.690887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.691330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.692069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:16.692567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:16.695571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:16.915474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:16.929668 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56063275-795f-4cc0-95bd-3467fea4f707 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.279205 Aug 24 01:56:16.931148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 769/1584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:16 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:17.048808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:17.049587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:17.058869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.059520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.060327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.061147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.061662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.062159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.227626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:56:17.246915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:56:17.247662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:56:17.248566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:56:17.249220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:56:17.259849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.260763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.261445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.262432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.263231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.263918 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.284971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Getting quotas for project ca375751092f40f79f187cab5c6c9b76. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:17.291520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Getting quotas for user a45857c939914f98bc0ea5d2350817b9 and project ca375751092f40f79f187cab5c6c9b76. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:17.306032 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:56:17.308844 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:56:17.372867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:17.379495 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b8d023c-4f28-4bf3-b60b-39dc02a331bf tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121071 Aug 24 01:56:17.380752 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 816/1585] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:56:17.383045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbbeb4c1-8a5e-4d42-bec1-4532ffb6243d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1509 microversion: 2.1 time: 0.338194 Aug 24 01:56:17.384005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 770/1586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:17 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:17.386342 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:17.388853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:17.404591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:17.406392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:17.408229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.408760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.409489 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.409998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.410978 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.411429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.418376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.419544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.420229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.421469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.422997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.423927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.474110 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a45c4a63-6eed-497d-988c-7dd1f06cadde tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092091 Aug 24 01:56:17.475062 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 817/1587] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:17 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:17.481196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4299fd22-6a38-4dc4-9f52-3c4b50a42d2c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:17.482970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4299fd22-6a38-4dc4-9f52-3c4b50a42d2c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:17.512761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.513283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.514007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.514465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lazy-loading 'fault' on Instance uuid 9a368057-1352-4198-85e8-dd6cdd0cd104 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:17.612155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09c8b150bd864992a5eba1af41e760ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2880aeff3141ca85e2148b1473f471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:17.625757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b166659-9afe-4a39-a35c-07bb5b04f7bf tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 200 len: 1354 microversion: 2.1 time: 0.240136 Aug 24 01:56:17.639386 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 771/1588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:17 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 1354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:17.668170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:17.668898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:17.683596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.684249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.685842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:17.686571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:17.688230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:17.700307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.045603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:18.057723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91bd215d-0416-4855-a4a0-ecf1c52b9a9d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.394556 Aug 24 01:56:18.060450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 772/1589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:17 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:18.072560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.073193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.096425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.096957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.098352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.099340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.099798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.100403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.217625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4299fd22-6a38-4dc4-9f52-3c4b50a42d2c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:18.225868 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4299fd22-6a38-4dc4-9f52-3c4b50a42d2c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1216 microversion: 2.1 time: 0.749613 Aug 24 01:56:18.229567 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 818/1590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:17 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1216 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:18.375745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:18.391949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63c99bc2-0b15-44fb-beae-49849d1707c6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1476 microversion: 2.1 time: 0.323419 Aug 24 01:56:18.397550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 773/1591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:18 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:18.411120 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.412852 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.426349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.426853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.427299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.428007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.428464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.428928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.487729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.490818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.512083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.519436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.520598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.521748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.522690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.525116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.611713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-144b015d-f5d2-46a3-a59c-df2376a0e910 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126968 Aug 24 01:56:18.613888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 774/1592] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:18 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:18.650426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.651053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.661365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.661863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.662575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.663509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.664307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.665317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.682057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 HTTP/1.1 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9a368057-1352-4198-85e8-dd6cdd0cd104'} Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.684235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:18.691832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.698744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:18.700657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc6bcccb-d48d-4d6d-938f-c98ae2467810 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 404 len: 111 microversion: 2.1 time: 0.054540 Aug 24 01:56:18.702122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 775/1593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:18 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:18.714213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.714921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.724971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.726013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.726794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.727978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.728338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.729402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.749991 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe HTTP/1.1 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5e4fb049-ae81-41e7-abcb-53a6429c40fe'} Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:18.751821 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e19e66f-062a-43b7-ae55-75ba8128e469 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 404 len: 111 microversion: 2.1 time: 0.046861 Aug 24 01:56:18.757722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 776/1594] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:18 2022] DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:18.762615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.763232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:18.766919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:18.771701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.772327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.772831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.774234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:18.774716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:18.775210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:18.812096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.812338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe HTTP/1.1 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5e4fb049-ae81-41e7-abcb-53a6429c40fe'} Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.812486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52c29cbd-1c11-4245-a23c-fd8abad7243f tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 404 len: 111 microversion: 2.1 time: 0.046252 Aug 24 01:56:18.819032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 777/1595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:18 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:18.820278 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fff529a2-6216-4af9-84fc-8c30c89ab480 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1509 microversion: 2.1 time: 0.404627 Aug 24 01:56:18.820278 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 819/1596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:18 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:18.820473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ffdbb58-b55b-4827-8e70-f432c5c63765 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '.version_select at 0x7f6b91853f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:18.842003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ffdbb58-b55b-4827-8e70-f432c5c63765 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-929206611" status: 202 len: 0 microversion: 2.1 time: 0.031561 Aug 24 01:56:18.867687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 778/1597] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 01:56:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-929206611 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:19.091196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:19.094758 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:19.126712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.136450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.138723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.140349 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.148599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.149950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.155531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd70666-4f4f-4932-b661-f801dcc16441", "name": "network-vif-deleted", "tag": "56fdb552-6a07-4abb-bd85-b60870063f1c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:19.167688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.168366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.168656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.195908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] Creating event network-vif-deleted:56fdb552-6a07-4abb-bd85-b60870063f1c for instance dfd70666-4f4f-4932-b661-f801dcc16441 on n-h2-854121-3 Aug 24 01:56:19.202219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-39a9f210-3e44-4142-b12b-994f1827a598 req-faa0c5c7-8c84-4d26-ad44-f7de04754022 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050265 Aug 24 01:56:19.203371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 779/1598] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:19.258848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:19.260838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:19.272421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.273655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.274678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.276503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.277723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.278837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.444704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:19.459644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3b7586e-a24b-43ab-b008-00e755eb1b67 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1212 microversion: 2.1 time: 0.212626 Aug 24 01:56:19.476774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 780/1599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:19 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1212 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:19.492768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:19.493786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:19.493933 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:19.500613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.501362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.501958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.502869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.503483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.504106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.505239 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9f346fa0-c46e-4953-bc8b-5cd823f6ea1e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.427216 Aug 24 01:56:19.508214 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 820/1600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:19 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:19.624641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:19.628666 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:19.641191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.643750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.651276 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.652911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.654681 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.655414 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.697601 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-89a8218f-ef85-455b-9d90-c9c6f0bb52eb tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077581 Aug 24 01:56:19.699769 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 821/1601] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:19 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:56:19.778846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:19.789461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cddc8e2-ffb1-4eff-87fe-d9c10886a17e tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1474 microversion: 2.1 time: 0.310183 Aug 24 01:56:19.801858 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 781/1602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:19 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:19.840314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:19.841788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:19.849656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.850575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.851406 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.852605 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.853715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.854391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.892811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-plugged", "status": "completed", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:19.911612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:19.914967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:19.928360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:19.953201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] Creating event network-vif-plugged:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:56:19.969158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-89ee3ec7-b640-44ab-b49d-ef497a771e11 req-4594be36-3ae6-4f08-aa5c-4353af297d96 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080270 Aug 24 01:56:19.974185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:19.984113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 782/1603] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:19.985071 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5894210d-d3c9-44d9-b307-2810aa6057cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1467 microversion: 2.1 time: 0.148636 Aug 24 01:56:19.986412 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 822/1604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:19 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1467 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:20.127094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d108e4b9-5895-43bc-8cd7-bb33664e7f81 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.127966 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:20.127966 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:20.147119 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d108e4b9-5895-43bc-8cd7-bb33664e7f81 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/5506154" status: 202 len: 0 microversion: 2.1 time: 0.025835 Aug 24 01:56:20.147988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 783/1605] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 01:56:20 2022] DELETE /compute/v2.1/flavors/5506154 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:20.158078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-95dcaa5e-d9cb-4d08-a5f3-52cae13985a9 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.179196 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-95dcaa5e-d9cb-4d08-a5f3-52cae13985a9 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.026679 Aug 24 01:56:20.179885 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 823/1606] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:20.197986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cbc1144-3f0b-495d-905a-523f826a6fe3 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.219757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cbc1144-3f0b-495d-905a-523f826a6fe3 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2042875863" status: 202 len: 0 microversion: 2.1 time: 0.025226 Aug 24 01:56:20.220868 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 784/1607] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:56:20 2022] DELETE /compute/v2.1/flavors/2042875863 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:20.230078 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dc589eda-53c9-43dd-bb6a-87a752c71d63 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.251427 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dc589eda-53c9-43dd-bb6a-87a752c71d63 tempest-ServersWithSpecificFlavorTestJSON-1048538692 tempest-ServersWithSpecificFlavorTestJSON-1048538692-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026059 Aug 24 01:56:20.252041 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 824/1608] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:20.291031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.291886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.299979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.300530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.301055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.301753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.302231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.302650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.307862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:20.318237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 HTTP/1.1 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9a368057-1352-4198-85e8-dd6cdd0cd104'} Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:20.320144 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b5db52d-fc5e-4c49-9199-e1753ee4d7ab tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 404 len: 111 microversion: 2.1 time: 0.042641 Aug 24 01:56:20.324393 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 785/1609] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:20 2022] DELETE /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:20.330207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.330822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 9a368057-1352-4198-85e8-dd6cdd0cd104] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.334869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:20.338627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.339450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.340220 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.341591 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.342418 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.343248 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.361520 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 HTTP/1.1 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '9a368057-1352-4198-85e8-dd6cdd0cd104'} Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.363700 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 9a368057-1352-4198-85e8-dd6cdd0cd104 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a0ca9e59-9e9c-41f5-81cb-21ff3e3bcc01 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104" status: 404 len: 111 microversion: 2.1 time: 0.038807 Aug 24 01:56:20.368427 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 825/1610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/9a368057-1352-4198-85e8-dd6cdd0cd104 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:20.373735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.374263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.380964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.381453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.381888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.382575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.383031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.383458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.397481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe HTTP/1.1 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5e4fb049-ae81-41e7-abcb-53a6429c40fe'} Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:20.399039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12bc3f00-ec52-4435-ab04-5835d206e38d tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 404 len: 111 microversion: 2.1 time: 0.030719 Aug 24 01:56:20.403143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 786/1611] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:20 2022] DELETE /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:20.409136 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.409760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] [instance: 5e4fb049-ae81-41e7-abcb-53a6429c40fe] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.416315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.416828 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.417270 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.417977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.418433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.418891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.433835 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] HTTP exception thrown: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Request method failure captured: Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe HTTP/1.1 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQ8mv74-vS4G1h7-5htF1s9LMmvIajrJ1xSac4LpJDT_j9260cBI49sPMhVmFYpfQu_ySIlkNF_rZg1Fgo6K5Rjy9FUMgFmcv6g6i5A-ejh-Iyy00RjFW3hDMMOmnG61fVv5nMlQvvaEJqv97o8_P3PIPQiOqf7cf-gcxamJuCXjUE Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f2880aeff3141ca85e2148b1473f471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 4f2880aeff3141ca85e2148b1473f471 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353 Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 09c8b150bd864992a5eba1af41e760ae Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-463843353-project Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '5e4fb049-ae81-41e7-abcb-53a6429c40fe'} Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.435379 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] Returning 404 to user: Instance 5e4fb049-ae81-41e7-abcb-53a6429c40fe could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2b8d2617-373c-4ee0-8d04-9b82a60d4ba1 tempest-ServersWithSpecificFlavorTestJSON-463843353 tempest-ServersWithSpecificFlavorTestJSON-463843353-project] 10.222.0.49 "GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe" status: 404 len: 111 microversion: 2.1 time: 0.031563 Aug 24 01:56:20.443905 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 826/1612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/5e4fb049-ae81-41e7-abcb-53a6429c40fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:20.481972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.482767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.489725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.490525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.491217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.491934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.492528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.493239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.530965 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.532710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.540659 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.541600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.542043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.542751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.543206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.543626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.562725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:20.571396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fd7809d-4445-45c3-af89-bc89dd5e9d0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1212 microversion: 2.1 time: 0.093345 Aug 24 01:56:20.572280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 787/1613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:20.712601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.715624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.722103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.723423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.724089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.724890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.725414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.725917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.761263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22293656-4f82-4a34-a03e-30dbf0db694a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.054007 Aug 24 01:56:20.762035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 788/1614] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:20.781323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:20.792353 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cf6010dd-32f9-4ef3-9d9f-6775c1e1685d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.266732 Aug 24 01:56:20.793147 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 827/1615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:20.822229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:20.822809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:20.830681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.831162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.831596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:20.832575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:20.833058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:20.833483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.009075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:21.009657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:21.009920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:21.016347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.017357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.018068 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.019277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.019977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.020899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-258b448d-cc5f-429e-995e-f708a63eeddb tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1474 microversion: 2.1 time: 0.201101 Aug 24 01:56:21.021345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.022365 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 789/1616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:20 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:21.128872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:21.137327 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-17643022-fc78-40f5-b4d0-aafc61b897f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1467 microversion: 2.1 time: 0.132847 Aug 24 01:56:21.140804 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 828/1617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:21 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1467 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:21.591413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:21.592565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:21.603135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.605475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.605883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.606600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.607046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.610857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.716787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:21.726071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ae64dea-1874-4d8c-bc96-7f461e8e23a9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1212 microversion: 2.1 time: 0.138373 Aug 24 01:56:21.726646 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 790/1618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:21 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1212 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:21.814086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:21.814698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:21.825635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.828625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.829097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:21.829829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:21.832617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:21.834838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.043282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:22.043902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:22.049941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.050420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.050892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.051585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.052284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.052966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.106086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:22.115460 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f7d9ccf8-4b24-4585-8bfc-3996297bbdd8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.305541 Aug 24 01:56:22.119088 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 829/1619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:21 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:22.159789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:22.162702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:22.197441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.198228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.199096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.201387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.203178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.203788 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.244048 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:22.295798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:22.307303 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:22.321811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c109e16-d18e-4430-b4a5-9b988e3c9e41 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1474 microversion: 2.1 time: 0.282263 Aug 24 01:56:22.322393 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7a1a2fe8-8b2f-48df-a5a5-f14b598749c7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1300 microversion: 2.1 time: 0.166959 Aug 24 01:56:22.323131 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 830/1620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:22 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1300 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:22.324064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 791/1621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:22 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1474 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:22.752147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:22.753598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:22.770938 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.773572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.774035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.774779 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:22.775245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:22.777240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:22.946987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:22.964366 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7e62b1fa-82be-4627-b720-0f1a65f2b859 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1268 microversion: 2.1 time: 0.217130 Aug 24 01:56:22.969191 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 831/1622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:22 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1268 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:23.143509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:23.144207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:23.156656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.157779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.161355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.162536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.163110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.163925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.346709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:23.347333 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:23.379642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.380149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.380590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.381338 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.381797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.382227 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.476697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.479648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.482275 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.487532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'fault' on Instance uuid dfd70666-4f4f-4932-b661-f801dcc16441 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:23.600484 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:23.611055 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bd51024d-cf0e-4659-a42a-61dbf262b0d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1305 microversion: 2.1 time: 0.269318 Aug 24 01:56:23.617142 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 832/1623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:23 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:23.623208 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:23.624024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:23.631907 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.632629 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.633116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.633829 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.634288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.634716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.657489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:23.669566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-023d8cd2-6995-43b3-bd8a-8e33bf50ffd4 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.533931 Aug 24 01:56:23.670732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 792/1624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:23 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:23.865493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:23.876760 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-80c8bd12-c646-4802-ae48-b7e51608527a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1471 microversion: 2.1 time: 0.258328 Aug 24 01:56:23.882709 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 833/1625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:23 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:23.907286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:23.907423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:23.930621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.931699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.933163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.936811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.937469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:23.940662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:23.987494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:23.989563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:23.998175 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:23.999367 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.005375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.006534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.009358 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.011108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.209345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:24.219724 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-08431a94-0fa2-4d17-82c9-523dc388e677 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1268 microversion: 2.1 time: 0.236015 Aug 24 01:56:24.232423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d18d47b6-5082-4434-bd41-972fc54ee524 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "POST /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479/action" status: 202 len: 0 microversion: 2.1 time: 0.330665 Aug 24 01:56:24.234369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 793/1626] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:56:23 2022] POST /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:56:24.237212 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 834/1627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:23 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1268 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:24.246486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:24.247327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:24.263087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.263769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.264687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.265623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.266314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.266881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.490896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:24.512785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-543a5d06-ea9d-4b3a-aaaf-8254e90680e3 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.274018 Aug 24 01:56:24.529607 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 794/1628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:24 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:24.639794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:24.640586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:24.664734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.672548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.674066 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.676822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.678350 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.679957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.695414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:24.696020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:24.703814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.710054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.710513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.711255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.711714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.712134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.770250 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:24.770942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:24.771598 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:24.772228 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'fault' on Instance uuid dfd70666-4f4f-4932-b661-f801dcc16441 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:24.848389 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:24.876703 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2204bc68-db85-4f9a-bd5d-a3c61ee4d1b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1305 microversion: 2.1 time: 0.238410 Aug 24 01:56:24.880840 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 835/1629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:24 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:25.111417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:25.140032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c95d23a-d1e6-44ac-a299-8d8b7272b59f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1478 microversion: 2.1 time: 0.445873 Aug 24 01:56:25.140682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 795/1630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:24 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1478 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:25.245492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:25.248067 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:25.255641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.256812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.257721 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.260132 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.263153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.264354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.381232 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:25.390742 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-34d5fe66-17df-4920-bab7-2bfe652b5532 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1274 microversion: 2.1 time: 0.151007 Aug 24 01:56:25.391334 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 836/1631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:25 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:25.535956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:25.537714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:25.549992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.551466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.552092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.552908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.553369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.554078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.850710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:25.863086 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0d07e62-584d-46bb-bb62-02f0f1c243a9 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.332436 Aug 24 01:56:25.865882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 796/1632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:25 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:25.900563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:25.901222 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:25.916472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.917488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.918638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.919974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.920750 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.921353 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.982694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:25.983429 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:25.984273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:25.984975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'fault' on Instance uuid dfd70666-4f4f-4932-b661-f801dcc16441 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:26.048015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:26.061868 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3c71d1dd-8707-49dc-9a5f-fbfbd029e566 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 200 len: 1305 microversion: 2.1 time: 0.165724 Aug 24 01:56:26.079000 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 837/1633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:25 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 1305 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:26.162988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:26.163614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:26.178970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:26.179463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:26.179903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:26.180609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:26.194527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:26.195011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:26.417924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:26.419470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:26.439216 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:26.441835 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:26.442609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:26.443871 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:26.446597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:26.449304 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.006713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:27.024101 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c163fda6-dff9-4da6-84e3-798074eef2a1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1274 microversion: 2.1 time: 0.612415 Aug 24 01:56:27.024696 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 838/1634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:26 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1274 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:27.040919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "name": "network-vif-plugged", "status": "completed", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:27.063369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.063861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.064297 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.077755 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Creating event network-vif-plugged:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h2-854121-3 Aug 24 01:56:27.099920 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:56:27.123862 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-8d624bb3-0f40-4942-8afc-6e9565721d9d req-1cbe05ae-26b9-4187-ac6f-cca9676d3698 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097632 Aug 24 01:56:27.125228 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 839/1635] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:27.131952 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:27.132975 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:27.139792 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.140572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.141299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.142252 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.143093 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.143617 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.232269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:27.240924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cdaad08-a5b4-497d-98c8-a5e4bbf7a440 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1463 microversion: 2.1 time: 1.083476 Aug 24 01:56:27.246473 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 797/1636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:26 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1463 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:27.252076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:27.253023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:27.266341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.267174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.267832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.268540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.269037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.270131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.273394 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:27.305228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 HTTP/1.1 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'dfd70666-4f4f-4932-b661-f801dcc16441'} Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:27.308272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:27.315395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc2cb3c5-7168-4691-a40a-7db6df272e61 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 404 len: 111 microversion: 2.1 time: 0.064881 Aug 24 01:56:27.316063 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 798/1637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:27 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:27.342527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:27.344846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:27.362421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.363247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.364575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.368258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.369737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.371116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.541415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9500e1a-aff8-4b1a-acb2-773891f422a0 tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.206686 Aug 24 01:56:27.542655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 799/1638] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:56:27 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:27.548433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1863358797", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:27.724871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:56:27.896797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:27.909480 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ffb5e233-c390-4735-ad9d-ff138608cb58 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.782532 Aug 24 01:56:27.910610 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 840/1639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:27 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:27.920046 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:27.920662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:27.953637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.954131 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.954562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:27.955269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:27.955717 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:27.956140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.063485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.064180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.064508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.065205 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lazy-loading 'fault' on Instance uuid 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:28.225600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=8 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:28.356251 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e0e0e35d-b0bd-40ce-87aa-a77e94570aba tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1597 microversion: 2.1 time: 0.444640 Aug 24 01:56:28.373313 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 841/1640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:27 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1597 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:28.393206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:28.395730 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:28.410821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.412030 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.413814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.414860 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.419776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.421038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.463508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:56:28.465145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:56:28.467482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:56:28.468373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:56:28.469029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:56:28.514457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.515353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.516493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.517556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.518424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.519722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.571774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:28.582905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:28.599117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:56:28.602575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:56:28.721399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e7889ac-1270-4845-b702-06a050c49a12 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176600 Aug 24 01:56:28.729656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 800/1641] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:56:28.739962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:28.745032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:28.799047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.806062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.807013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.808232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:28.814779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:28.815860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:28.839558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:28.970764 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:29.018233 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a0142cd8-a424-4d83-9ac5-06ee7843b2ed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.611955 Aug 24 01:56:29.018233 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 842/1642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:28 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:29.048477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26d9f428-5cf0-408e-96e9-d0c1405c493d tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action" status: 202 len: 0 microversion: 2.1 time: 0.316796 Aug 24 01:56:29.049345 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-af15db97-2852-4d16-a25e-9e9b61cbfefe tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:29.050041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-af15db97-2852-4d16-a25e-9e9b61cbfefe tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:29.054130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 801/1643] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:56:28 2022] POST /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:29.067563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:29.069026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:29.083843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.084933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.085568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.086487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.087305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.089084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.195378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-af15db97-2852-4d16-a25e-9e9b61cbfefe tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:29.201496 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-af15db97-2852-4d16-a25e-9e9b61cbfefe tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1215 microversion: 2.1 time: 0.195461 Aug 24 01:56:29.217478 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 843/1644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:29 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:29.223043 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:29.223972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:29.248753 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.249822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.250433 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.251329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.252194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.253079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.507280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:29.543669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5423f118-5fd6-4d31-be31-ef38651eb318 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.488288 Aug 24 01:56:29.549992 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-48d650d7-7556-4d65-a6da-f52e46a5726f tempest-ServersAdminTestJSON-919156777 tempest-ServersAdminTestJSON-919156777-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1614 microversion: 2.1 time: 0.331056 Aug 24 01:56:29.555390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 802/1645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:29 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:29.556082 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 844/1646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:29 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1614 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:29.584758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d660cab-5e97-47a1-bfc9-1fcf2254e486", "tag": "65d55ed6-12b6-4ec5-99de-69f9eecfcad4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:29.585929 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:29.586611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:29.597184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.598438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.599038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.600894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.603409 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.606858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.608729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.609410 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.611263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] Creating event network-changed:65d55ed6-12b6-4ec5-99de-69f9eecfcad4 for instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 on n-h2-854121-3 Aug 24 01:56:29.612038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.616347 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8823e196-d3b8-4b69-b68c-baf9f4348a50 req-b50b162a-1029-431b-b443-1595f5a907af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053997 Aug 24 01:56:29.617057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 803/1647] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:29.667514 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:29.749832 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:29.811090 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-222ae3a1-8d28-448d-80ec-8431e763e073 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 204 len: 0 microversion: 2.1 time: 0.231014 Aug 24 01:56:29.812008 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 845/1648] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:29 2022] DELETE /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:29.821644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:29.822823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:29.831422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.832774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.833566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:29.834627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:29.835729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:29.836343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.052041 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:30.054158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:30.056086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:30.068689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31a0c32c-2b61-467b-9531-f0f58c3f5381 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1468 microversion: 2.1 time: 0.252303 Aug 24 01:56:30.069991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 804/1649] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:29 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:30.085769 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.086262 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.086697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.088314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.088785 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.090035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.226220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:30.228100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:30.239410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.239905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.240341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.245156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.245655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.246095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.440587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:30.453527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-069dd198-d7c8-4306-9f68-b64159d3c9d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1219 microversion: 2.1 time: 0.232229 Aug 24 01:56:30.455071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 805/1650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:30 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:30.507626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:30.518263 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-979fd14c-ca39-4f47-8087-53101a9feb92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.474044 Aug 24 01:56:30.530709 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 846/1651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:30 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:30.575254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:30.576519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:30.583182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.583910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.585229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.586141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:30.586757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:30.590168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:30.760985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:30.770936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6235df78-c230-4bc9-b2f9-3728fd219a40 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.199744 Aug 24 01:56:30.771941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 806/1652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:30 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:31.092152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:31.094602 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:31.108650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.109763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.110219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.111231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.111390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.113739 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.369384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:31.378235 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-160d6904-1bc3-467c-93eb-4a4b02cc566f tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1468 microversion: 2.1 time: 0.291228 Aug 24 01:56:31.379926 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 847/1653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:31 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:31.474722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:31.475338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:31.495699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.496196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.498030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.498751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.499212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.499636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.544019 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:31.544927 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:31.557898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.559747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.560383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.561564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.565713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.567177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.657183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:31.667344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3111f67f-0df0-48dd-ad28-cfdd1981992f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1219 microversion: 2.1 time: 0.195689 Aug 24 01:56:31.668608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 807/1654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:31 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1219 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:31.793915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:31.794838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:31.815097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.817721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.818206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:31.821184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:31.821772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:31.822091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:32.119647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:32.136831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af3812db-ed1f-4c5e-b75d-45a9f1be5fc4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.347160 Aug 24 01:56:32.139057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 808/1655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:31 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:32.152473 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:32.170914 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-16fb84b7-7c42-44bc-a805-5063a3d744bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.631294 Aug 24 01:56:32.172131 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 848/1656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:31 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:32.406939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:32.410391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:32.447534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:32.452053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:32.452771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:32.454318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:32.457778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:32.458670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:32.694886 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:32.695905 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:32.709507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:32.710288 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:32.710898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:32.713403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:32.715991 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:32.716628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:32.847639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:32.859519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-918aeac2-bb06-4c85-a780-acc628cc1b43 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1468 microversion: 2.1 time: 0.463020 Aug 24 01:56:32.860975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 809/1657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:32 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1468 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:32.890111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:32.903250 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-eb37e5f9-d598-4db0-9166-c86d9faf2416 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1267 microversion: 2.1 time: 0.214093 Aug 24 01:56:32.905524 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 849/1658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:32 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:33.159186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:33.159901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:33.166640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.167231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.167779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:33.168574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.169143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.169661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:33.192070 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:33.192609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:33.200178 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.200670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.201224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:33.201830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.202290 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.203648 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:33.320863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:33.331971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-332253f1-e554-4b67-a7f3-1daff53ec666 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.176656 Aug 24 01:56:33.332662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 810/1659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:33 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:33.882561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:33.884084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:33.894832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.897550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.899283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:33.900419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:33.901126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:33.901966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.048115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:34.063788 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c005a538-4faa-4ae9-8ea9-996508fb950b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1426 microversion: 2.1 time: 0.184381 Aug 24 01:56:34.065759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 811/1660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:33 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1426 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:34.085733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:34.086352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:34.096413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:34.122405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.125310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.125775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.126524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.126992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.127416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.190086 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:34.205174 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9c0aa910-c6b5-4ac8-b35f-5ab040e640fb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 1.016100 Aug 24 01:56:34.207362 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 850/1661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:33 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:34.232816 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:34.237233 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:34.252259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.252894 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.257656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.259285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.261472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.263319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.486769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:34.502185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09830396-4bcc-4e44-b595-bcfd603b54c1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1273 microversion: 2.1 time: 0.429170 Aug 24 01:56:34.506027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 812/1662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:34 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:34.526215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:34.527076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:34.534860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.535601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.536297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.538151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.538972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.539631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.922439 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-37ac3d19-fa52-4fe2-b888-b92c7945bfe2 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1811 microversion: 2.1 time: 0.700124 Aug 24 01:56:34.926075 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 851/1663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:34 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1811 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:34.947540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:34.960284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c474c8c9-1968-4f25-be61-eee5f81189f2 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.450241 Aug 24 01:56:34.960500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0681c016-7fbe-4d6b-8482-bb3a103eaf72", "name": "network-vif-deleted", "tag": "8421e5b7-ae6d-42a4-9e88-aa13f339a133"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:34.976874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 813/1664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:34 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:34.983458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:34.988352 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:34.988352 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:34.989915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.990766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.991873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:34.992930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:34.994804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:34.995832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.008667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.008667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.008667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.033593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cdc647b-863d-4ae5-ac71-b40934615f8b tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.055380 Aug 24 01:56:35.042715 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 814/1665] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:56:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:35.043745 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] Creating event network-vif-deleted:8421e5b7-ae6d-42a4-9e88-aa13f339a133 for instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 on n-h2-854121-3 Aug 24 01:56:35.049551 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-fea8ce1f-d6d0-4c5a-8f2a-a7ee5c0443d6 req-105fecd2-1bd5-48cd-9bf9-de2137aa6794 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122000 Aug 24 01:56:35.053279 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 852/1666] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:35.089172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:35.089794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:35.096741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.097780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.098219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.098916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.099368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.099789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.147074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.148319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.149498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.150158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid 0681c016-7fbe-4d6b-8482-bb3a103eaf72 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:35.214622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "name": "network-vif-unplugged", "status": "completed", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:35.239097 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.240773 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.244826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.271300 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Creating event network-vif-unplugged:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h1-854121-3 Aug 24 01:56:35.286153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128566) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:56:35.316243 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-143a9a6d-85eb-437d-ba2b-05ea443b0714 req-5ea52759-4815-45ce-9413-0bd4d37f6157 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106138 Aug 24 01:56:35.318526 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 853/1667] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:35.326622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:35.330676 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:35.335395 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:35.345505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9652d5af-c6f2-4b76-97c3-ba4e9b9a8f88 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1303 microversion: 2.1 time: 0.263176 Aug 24 01:56:35.348602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 815/1668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:35 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1303 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:35.350819 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.351546 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.352355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.354118 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.357203 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.357908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.529801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:35.531089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:35.538475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.542783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.543826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.544909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:35.545855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:35.547343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:35.695428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:35.708538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ae93524-4546-4e9e-9f54-2f9371c4a240 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1273 microversion: 2.1 time: 0.182460 Aug 24 01:56:35.712055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 816/1669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:35 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:35.864994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:35.879043 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9d06c46c-7c22-4c03-a8bb-d673ec4fbc7c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.557231 Aug 24 01:56:35.893288 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 854/1670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:35 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:35.983878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:35.984509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:36.021958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.022465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.024640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.025411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.026707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.027148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.067896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:36.367879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:36.368487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:36.380964 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.381460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.381908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.382626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.383088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.383518 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.450700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:36.475865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c58108f-5900-4d08-b3b3-0f5f2e464de6 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.496602 Aug 24 01:56:36.479472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 817/1671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:35 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:36.485475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.486235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.486917 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.488200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid 0681c016-7fbe-4d6b-8482-bb3a103eaf72 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:36.584583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:36.605648 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a76a7386-15b3-4f96-a296-f0367f374a61 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1303 microversion: 2.1 time: 0.240917 Aug 24 01:56:36.609368 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 855/1672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:36 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:36.734556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:36.735428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:36.744221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.744775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.745225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.746127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.746753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.747353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.904010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:36.905706 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:36.922000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.922657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.923116 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:36.923830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:36.924465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:36.925139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.041857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:37.054614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e7a93e4-7dae-4d47-ace3-3dd8076b7fb9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.324079 Aug 24 01:56:37.056272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 818/1673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:36 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:37.301990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:37.317598 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6e6224ed-8883-4c51-86e2-9346bfe32a82 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.417292 Aug 24 01:56:37.321242 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 856/1674] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:36 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:37.354558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:37.370136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.373302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.373942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.387553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Creating event network-changed:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h1-854121-3 Aug 24 01:56:37.393514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 01:56:37.408227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e5b6f020-e7ef-4020-9137-2a0341861d4a req-3b446aed-9b0e-48bd-838e-d12d2a011c5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057669 Aug 24 01:56:37.410446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 819/1675] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:37.499622 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:37.500416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:37.509960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.516253 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.516840 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.517649 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.518188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.519499 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.631223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:37.632036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:37.642479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.644890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.646237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.649109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.650737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.652200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.693589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.694608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.695040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.695668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid 0681c016-7fbe-4d6b-8482-bb3a103eaf72 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:37.747869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:37.775667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41933553-c325-4c66-aa88-828ea8485bc3 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 200 len: 1303 microversion: 2.1 time: 0.149740 Aug 24 01:56:37.777175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 820/1676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:37 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:37.822434 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:37.838197 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2c5407ce-bd81-4760-8aad-9ad22874acd1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.342396 Aug 24 01:56:37.840812 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 857/1677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:37 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:37.967170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1b4f1a6-7de3-4905-bf7d-243d3b894985", "device": "/dev/xvdb"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:37.972671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:37.993772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.994462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.995326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:37.996153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:37.996750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:37.997293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:38.076926 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:38.077957 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:38.087122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:38.087874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:38.088490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:38.089445 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:38.090259 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:38.090842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:38.593628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:38.661983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:38.672795 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1c27e901-940f-4fd9-b65a-f20989a389fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.600174 Aug 24 01:56:38.673804 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 858/1678] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:38 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:38.678971 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:38.679714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:38.685879 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:38.686480 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:38.687122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:38.688163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:38.688575 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:38.691456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:39.141441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:39.152606 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7b5d5f1c-d511-47e4-91fd-a709396ada26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.477399 Aug 24 01:56:39.154445 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 859/1679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:38 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:39.170477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:39.171368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 0681c016-7fbe-4d6b-8482-bb3a103eaf72] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:39.185713 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:39.186825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:39.188996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:39.192095 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:39.192767 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:39.193544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:39.233200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:39.241505 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] HTTP exception thrown: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Request method failure captured: Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 HTTP/1.1 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTAx-fj4P-YzagYkzSlMQHLNO8dcl1bKRUSNQh1jhA2dli8Rn9C_8i6p2tn7r2K5SB7cDnTSBeeB8Gvl3PBlp5V9rmVR7ESWDIY6e0KhFwO1vKdrKnXAkg0z_EzwlLzKPT00yQlIOeWOW3EOdci9fOna7dX6SsN3L3vtZdTmCjN0zE Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17768302608445dda904cd4791e1a0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17768302608445dda904cd4791e1a0ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 00d5425074f540b8be6a17014a1eec40 Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '0681c016-7fbe-4d6b-8482-bb3a103eaf72'} Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:39.250698 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. Aug 24 01:56:39.256636 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:39.258751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Returning 404 to user: Instance 0681c016-7fbe-4d6b-8482-bb3a103eaf72 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:39.261222 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b978e87-5ce5-4d96-8ba0-ab7aa7275355 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72" status: 404 len: 111 microversion: 2.1 time: 0.104100 Aug 24 01:56:39.266628 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 860/1680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:39 2022] GET /compute/v2.1/servers/0681c016-7fbe-4d6b-8482-bb3a103eaf72 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:39.297226 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:39.307119 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:39.341755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:39.345231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:39.346922 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:39.347732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:39.360372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:39.360372 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:39.646549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:39.655527 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-08ef7ab8-d4eb-4ea6-aab6-e40cce15aa94 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1470 microversion: 2.1 time: 0.382630 Aug 24 01:56:39.655814 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 861/1681] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:39 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:40.044504 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f6215e53-2ef0-46f8-a5b8-9bfa4403a364 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1635586221", "id": 235034251, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:40.052067 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:40.052067 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:40.087618 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f6215e53-2ef0-46f8-a5b8-9bfa4403a364 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.421692 Aug 24 01:56:40.089206 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 862/1682] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:39 2022] POST /compute/v2.1/flavors => generated 436 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:40.100240 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:40.101092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:40.108200 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.109056 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.109715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.110709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.111336 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.112055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.154424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:40.198578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:40.408381 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:40.411699 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f2389905-be2d-44e7-a206-5138543c967c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 204 len: 0 microversion: 2.1 time: 0.321093 Aug 24 01:56:40.427620 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 863/1683] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:40 2022] DELETE /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:40.451423 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0096410f-c55c-4bbe-a2d7-c22f89245511", "tag": "6abb6483-c100-4d90-92e6-3710a9cc5e8a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:40.488610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.491579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.493207 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.534102 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] Creating event network-changed:6abb6483-c100-4d90-92e6-3710a9cc5e8a for instance 0096410f-c55c-4bbe-a2d7-c22f89245511 on n-h2-854121-3 Aug 24 01:56:40.579957 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-649d332b-042d-4037-9a67-68104aa4a858 req-55221579-8c56-4648-837c-f85e9d72b876 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144845 Aug 24 01:56:40.587390 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 864/1684] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:40.623196 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95e62da5-1a65-42c5-a98f-99d769e5a43a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.663002 Aug 24 01:56:40.623929 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:40.625014 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:40.634586 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 821/1685] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 01:56:37 2022] POST /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments => generated 194 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:40.653417 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.656210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fc55100-4bda-470a-be6f-069f9add3d53 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:40.658300 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.658763 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.663646 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:40.663646 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:40.665479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.666729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.668183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.871772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fc55100-4bda-470a-be6f-069f9add3d53 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/235034251/action" status: 200 len: 96 microversion: 2.1 time: 0.233119 Aug 24 01:56:40.879356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 822/1686] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:40 2022] POST /compute/v2.1/flavors/235034251/action => generated 96 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:40.887821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:40.888563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:40.911716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.917468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.922678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:40.923984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:40.925571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:40.926200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:41.005279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:41.016306 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ec815a06-e66e-42fd-b9b1-fe35b053f6cf tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.426512 Aug 24 01:56:41.034172 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 865/1687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:40 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:41.046382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:41.047003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:41.054202 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:41.054968 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:41.055572 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:41.058144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:41.059380 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:41.060015 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:41.262307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:41.292810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52b8bc6d-c659-445f-90a3-06a1d31976be tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.411931 Aug 24 01:56:41.293411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 823/1688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:40 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:41.318576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:41.319462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:41.343979 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:41.350573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:41.351092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:41.351536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:41.352279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:41.353261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:41.353699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:41.357907 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-82934967-d67a-4103-9692-7388f626b9ba tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1469 microversion: 2.1 time: 0.322344 Aug 24 01:56:41.372287 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 866/1689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:41 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:41.384709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7ebc89e-a27d-4fab-a8f8-5ce80dd026b9 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:41.388120 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:41.388120 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:41.506727 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-f7ebc89e-a27d-4fab-a8f8-5ce80dd026b9 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] HTTP exception thrown: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7ebc89e-a27d-4fab-a8f8-5ce80dd026b9 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Request method failure captured: Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/flavors/235034251/action HTTP/1.1 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 67 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYVWiZEeXxq_9EzGyTP_4gGs_eJ-8L73mhPGYfEWBY2aeLchtf4QciHocojvs3JIZ2Gs73T1cU5bMn7k6_uOrTTXF6DlYKYnp7hB8j9cxWZLRQ-qjIe3yzNF-28uxdLXb3bJ_zD4MZj6hxoMMk0mlXsDMpSmW1W3nL5z3TJxaCN-_v0 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 2f9b0f7b4efa4c7fbe38600b4e140a35 Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: exception: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '235034251', 'body': {'addTenantAccess': {'tenant': 'a1aa1e23b3624c4b9b778233f6f50c1f'}}} Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '34-a1aa1e23b3624c4b9b778233f6f50c1f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.513034 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi session.flush() Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi result.read() Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 01:56:41.517355 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '34-a1aa1e23b3624c4b9b778233f6f50c1f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 24, 1, 56, 41, 495614), 'updated_at': None, 'flavor_id': 34, 'project_id': 'a1aa1e23b3624c4b9b778233f6f50c1f'}] Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. Aug 24 01:56:41.524833 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:41.540430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f7ebc89e-a27d-4fab-a8f8-5ce80dd026b9 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Returning 409 to user: Flavor access already exists for flavor 34 and project a1aa1e23b3624c4b9b778233f6f50c1f combination. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:41.545893 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f7ebc89e-a27d-4fab-a8f8-5ce80dd026b9 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/235034251/action" status: 409 len: 152 microversion: 2.1 time: 0.172168 Aug 24 01:56:41.550794 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 867/1690] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:41 2022] POST /compute/v2.1/flavors/235034251/action => generated 152 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:56:41.559328 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-da8ab008-eb6c-4982-9f9e-6e245a022d33 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:41.581780 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:41.581780 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:41.774035 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-da8ab008-eb6c-4982-9f9e-6e245a022d33 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/235034251/action" status: 200 len: 21 microversion: 2.1 time: 0.217306 Aug 24 01:56:41.774999 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 868/1691] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:41 2022] POST /compute/v2.1/flavors/235034251/action => generated 21 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:41.786677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3a9af505-2612-452b-b9dd-b01bf8e6bc06 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:41.787934 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:41.787934 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:41.813657 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3a9af505-2612-452b-b9dd-b01bf8e6bc06 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/235034251" status: 202 len: 0 microversion: 2.1 time: 0.031984 Aug 24 01:56:41.828678 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 869/1692] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:56:41 2022] DELETE /compute/v2.1/flavors/235034251 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:41.837849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b405c0be-7d9a-4759-834b-48a0a355486a tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:41.888057 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b405c0be-7d9a-4759-834b-48a0a355486a tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047779 Aug 24 01:56:41.889152 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 870/1693] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:41.920526 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d925319e-1e99-4edf-8ea2-47ea3a7cc3cc tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-478111135", "id": 802307214, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:41.925469 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:41.925469 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:41.946935 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d925319e-1e99-4edf-8ea2-47ea3a7cc3cc tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.035311 Aug 24 01:56:41.947670 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 871/1694] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:41 2022] POST /compute/v2.1/flavors => generated 434 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:41.965551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:41.977248 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b8e3583-7a0b-4ec4-a8e1-d0bcb9fbec17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1463 microversion: 2.1 time: 0.677499 Aug 24 01:56:41.982954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3a1417d8-2e73-4135-8fb4-3410616fdb90 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:41.985699 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 824/1695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:41 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1463 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:41.989814 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:41.989814 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:42.004988 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-3a1417d8-2e73-4135-8fb4-3410616fdb90 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3a1417d8-2e73-4135-8fb4-3410616fdb90 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Request method failure captured: Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/flavors/802307214/os-flavor-access HTTP/1.1 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYVWiZEeXxq_9EzGyTP_4gGs_eJ-8L73mhPGYfEWBY2aeLchtf4QciHocojvs3JIZ2Gs73T1cU5bMn7k6_uOrTTXF6DlYKYnp7hB8j9cxWZLRQ-qjIe3yzNF-28uxdLXb3bJ_zD4MZj6hxoMMk0mlXsDMpSmW1W3nL5z3TJxaCN-_v0 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 2f9b0f7b4efa4c7fbe38600b4e140a35 Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: exception: Access list not available for public flavors. Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'flavor_id': '802307214'} Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 24 01:56:42.013062 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:42.018616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3a1417d8-2e73-4135-8fb4-3410616fdb90 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:42.020651 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3a1417d8-2e73-4135-8fb4-3410616fdb90 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/802307214/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.064702 Aug 24 01:56:42.025748 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 872/1696] 10.222.0.49 () {58 vars in 1206 bytes} [Wed Aug 24 01:56:41 2022] GET /compute/v2.1/flavors/802307214/os-flavor-access => generated 91 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:56:42.036149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f1ce8bd3-708d-4ae0-aca4-c94ef03d1071 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.066418 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f1ce8bd3-708d-4ae0-aca4-c94ef03d1071 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/802307214" status: 202 len: 0 microversion: 2.1 time: 0.039231 Aug 24 01:56:42.079301 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 873/1697] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:56:42 2022] DELETE /compute/v2.1/flavors/802307214 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:42.092206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.094092 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:42.118597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.124256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.124908 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.125875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.126425 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.126925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.267001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.267691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:42.284777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.285841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.286517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.288118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.288822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.289682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.444580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:42.453105 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f8b9f16c-8061-4bdf-8643-8e59ec9be0b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.372474 Aug 24 01:56:42.466709 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 874/1698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:42 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:42.472694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-e70eb90e-41cd-4569-9b84-2eac526e6034 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.496063 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-e70eb90e-41cd-4569-9b84-2eac526e6034 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027599 Aug 24 01:56:42.497865 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 875/1699] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:42.504564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.505415 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:42.526180 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.526445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15ac2264-178b-4c9c-8f3a-c02cdc9581ee tempest-MigrationsAdminTest-1800917752 tempest-MigrationsAdminTest-1800917752-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1614 microversion: 2.1 time: 0.526528 Aug 24 01:56:42.526883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 825/1700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:41 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1614 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:42.527287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.527884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.537827 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.540759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.541716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:42.545153 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.545674 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.559834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.560733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.561555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.563835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.564373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.564933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.747715 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:42.786397 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-207aba2c-eb1e-41fe-b20c-b4510e007ecd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.285192 Aug 24 01:56:42.806799 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 876/1701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:42 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:42.824695 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-548620d5-bcab-435b-898e-2bb94316c0aa tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1202448019", "id": 2124593973, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:42.830234 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:42.830234 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:42.861202 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-548620d5-bcab-435b-898e-2bb94316c0aa tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.050309 Aug 24 01:56:42.869452 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 877/1702] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:42 2022] POST /compute/v2.1/flavors => generated 439 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:42.881001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:42.881533 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:42.892340 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.892885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.905354 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.906576 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:42.907314 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:42.907974 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:42.966218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:42.971716 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:42.977443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f43c3a58-1c27-47eb-bbfd-f0deaca8867b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1469 microversion: 2.1 time: 0.449495 Aug 24 01:56:42.982569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 826/1703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:42 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1469 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:43.173571 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5ce1a0ff-d1f8-4127-8551-1dac8944bc1d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 204 len: 0 microversion: 2.1 time: 0.304508 Aug 24 01:56:43.175656 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 878/1704] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:42 2022] DELETE /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:43.191277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:43.192363 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:43.203100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.203734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.204432 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:43.205752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.207516 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.208063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:43.262292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8556f15-d3cd-4284-89da-cfc22855b82b tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:43.265012 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:43.265012 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:43.266460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8556f15-d3cd-4284-89da-cfc22855b82b tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '791986df5ab648968fabad4bbe4f2427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1aa1e23b3624c4b9b778233f6f50c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8556f15-d3cd-4284-89da-cfc22855b82b tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Request method failure captured: Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/flavors/2124593973/action HTTP/1.1 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 67 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVVnWHDte8uynAXP8P0wa_isS1fAi0x7RzPcgw80Vzlw6Zc9YsCsyTEhJvNgBmKMNzUFc4Vu9uQE59fA5rarbYPcNubgDEeB-X9FjNx_tdVnJAzfIb-dejOqmPGZf-9RWFiKjb6gbVD-mr8Aa5bmB8wnde7683ERS4GRvUcZZgG36Q Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a1aa1e23b3624c4b9b778233f6f50c1f Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a1aa1e23b3624c4b9b778233f6f50c1f Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsAccessNegativeTestJSON-938727997-project Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 791986df5ab648968fabad4bbe4f2427 Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-938727997-project Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2124593973', 'body': {'addTenantAccess': {'tenant': 'a1aa1e23b3624c4b9b778233f6f50c1f'}}} Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:56:43.269106 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 24 01:56:43.273586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.276365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8556f15-d3cd-4284-89da-cfc22855b82b tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:43.278427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8556f15-d3cd-4284-89da-cfc22855b82b tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] 10.222.0.49 "POST /compute/v2.1/flavors/2124593973/action" status: 403 len: 130 microversion: 2.1 time: 0.291629 Aug 24 01:56:43.279881 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 827/1705] 10.222.0.49 () {60 vars in 1200 bytes} [Wed Aug 24 01:56:42 2022] POST /compute/v2.1/flavors/2124593973/action => generated 130 bytes in 297 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:43.292863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f32765e-dbc5-4d76-b684-a6a7eac35d45 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:43.296579 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:43.296579 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:43.327369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f32765e-dbc5-4d76-b684-a6a7eac35d45 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/2124593973" status: 202 len: 0 microversion: 2.1 time: 0.042878 Aug 24 01:56:43.329015 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 828/1706] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:56:43 2022] DELETE /compute/v2.1/flavors/2124593973 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 01:56:43.337017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75064a3f-2c64-4d05-8d83-73622aecda71 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:43.364952 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75064a3f-2c64-4d05-8d83-73622aecda71 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031706 Aug 24 01:56:43.366345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 829/1707] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:43.384397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6be57fd3-7406-4018-85b2-f6e6ab4eaa82 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-518754164", "id": 806375715, "os-flavor-access:is_public": "False"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:43.387681 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:43.387681 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:43.406118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6be57fd3-7406-4018-85b2-f6e6ab4eaa82 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.025743 Aug 24 01:56:43.407574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 830/1708] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:43 2022] POST /compute/v2.1/flavors => generated 435 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:43.420860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-310d67b2-6a7f-4202-9375-218f4fc604e0 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:43.524107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-310d67b2-6a7f-4202-9375-218f4fc604e0 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/806375715/action" status: 200 len: 96 microversion: 2.1 time: 0.108160 Aug 24 01:56:43.527257 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 831/1709] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:43 2022] POST /compute/v2.1/flavors/806375715/action => generated 96 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:43.533589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:43.535251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:43.547198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.548339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.549068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:43.551156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.552323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.553992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:43.875507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:43.887418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbdbc248-303d-4769-9181-a89cdc0f24c3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.358177 Aug 24 01:56:43.896266 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 832/1710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:43 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:43.902332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-455fd1c7-2fcc-4c50-8e85-761b369f19dc tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:43.909107 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:43.909107 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:43.914401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-455fd1c7-2fcc-4c50-8e85-761b369f19dc tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '791986df5ab648968fabad4bbe4f2427', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1aa1e23b3624c4b9b778233f6f50c1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-455fd1c7-2fcc-4c50-8e85-761b369f19dc tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Request method failure captured: Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/flavors/806375715/action HTTP/1.1 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 70 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVVnWHDte8uynAXP8P0wa_isS1fAi0x7RzPcgw80Vzlw6Zc9YsCsyTEhJvNgBmKMNzUFc4Vu9uQE59fA5rarbYPcNubgDEeB-X9FjNx_tdVnJAzfIb-dejOqmPGZf-9RWFiKjb6gbVD-mr8Aa5bmB8wnde7683ERS4GRvUcZZgG36Q Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a1aa1e23b3624c4b9b778233f6f50c1f Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a1aa1e23b3624c4b9b778233f6f50c1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a1aa1e23b3624c4b9b778233f6f50c1f Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-938727997 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FlavorsAccessNegativeTestJSON-938727997-project Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 791986df5ab648968fabad4bbe4f2427 Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-938727997-project Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: {"removeTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '806375715', 'body': {'removeTenantAccess': {'tenant': 'a1aa1e23b3624c4b9b778233f6f50c1f'}}} Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can( Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 01:56:43.917650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 24 01:56:43.922849 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:43.925181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-455fd1c7-2fcc-4c50-8e85-761b369f19dc tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:43.928874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-455fd1c7-2fcc-4c50-8e85-761b369f19dc tempest-FlavorsAccessNegativeTestJSON-938727997 tempest-FlavorsAccessNegativeTestJSON-938727997-project] 10.222.0.49 "POST /compute/v2.1/flavors/806375715/action" status: 403 len: 133 microversion: 2.1 time: 0.029104 Aug 24 01:56:43.932995 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 833/1711] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:43 2022] POST /compute/v2.1/flavors/806375715/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:43.941725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:43.943222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:43.991218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.992379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.993190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:43.994089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:43.994839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:43.995432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:44.235653 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:44.249629 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-05265393-3f16-406e-9336-c9e06a0629db tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1469 microversion: 2.1 time: 1.059953 Aug 24 01:56:44.262151 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 879/1712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:43 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1469 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:44.269875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc44a379-ac55-4541-afb2-8a2ff60d571b tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1aa1e23b3624c4b9b778233f6f50c1f"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:44.278392 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:44.278392 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:44.279227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:44.288423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d10f945-e87f-4774-8ebe-3c1d7c3fc25a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.354055 Aug 24 01:56:44.292037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 834/1713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:43 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:44.303249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.303867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:44.319121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:44.322657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:44.323138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:44.323829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:44.337576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:44.338213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:44.416965 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc44a379-ac55-4541-afb2-8a2ff60d571b tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/806375715/action" status: 200 len: 21 microversion: 2.1 time: 0.152215 Aug 24 01:56:44.417996 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 880/1714] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:44 2022] POST /compute/v2.1/flavors/806375715/action => generated 21 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:44.432127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-72583529-30ad-4641-8ce3-d5beb82a2037 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.433491 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:44.433491 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:44.479712 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-72583529-30ad-4641-8ce3-d5beb82a2037 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/806375715" status: 202 len: 0 microversion: 2.1 time: 0.055800 Aug 24 01:56:44.481061 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 881/1715] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:56:44 2022] DELETE /compute/v2.1/flavors/806375715 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:44.493989 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f336f4b2-76a9-464f-98d9-68b2e7cf085a tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.559304 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f336f4b2-76a9-464f-98d9-68b2e7cf085a tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073298 Aug 24 01:56:44.561273 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 882/1716] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:44.582710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-24a68c53-e486-42d9-ad46-9239320bc0aa tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1259174196", "id": 523911279, "os-flavor-access:is_public": "False"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:44.586104 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:44.586104 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:44.615945 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-24a68c53-e486-42d9-ad46-9239320bc0aa tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038831 Aug 24 01:56:44.617942 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 883/1717] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:44 2022] POST /compute/v2.1/flavors => generated 436 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:56:44.632274 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3f2b7981-399f-4d7b-a9f5-ca2015b5d841 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e3a1dc772e4e4f58b4ea4727f73410ed"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:44.657131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:44.668982 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-402daaa4-4a8d-4af7-ba95-4057064c4d4e tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1469 microversion: 2.1 time: 0.375727 Aug 24 01:56:44.680757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 835/1718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:44 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:44.768502 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-3f2b7981-399f-4d7b-a9f5-ca2015b5d841 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] HTTP exception thrown: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3f2b7981-399f-4d7b-a9f5-ca2015b5d841 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Request method failure captured: Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/flavors/523911279/action HTTP/1.1 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 70 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYVWiZEeXxq_9EzGyTP_4gGs_eJ-8L73mhPGYfEWBY2aeLchtf4QciHocojvs3JIZ2Gs73T1cU5bMn7k6_uOrTTXF6DlYKYnp7hB8j9cxWZLRQ-qjIe3yzNF-28uxdLXb3bJ_zD4MZj6hxoMMk0mlXsDMpSmW1W3nL5z3TJxaCN-_v0 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Role: admin,reader,member Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: admin,reader,member Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_328eb20b5b994dbab37b9045be6d75c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 328eb20b5b994dbab37b9045be6d75c9 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-866789160 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 2f9b0f7b4efa4c7fbe38600b4e140a35 Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: {"removeTenantAccess": {"tenant": "e3a1dc772e4e4f58b4ea4727f73410ed"}} Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: exception: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': '523911279', 'body': {'removeTenantAccess': {'tenant': 'e3a1dc772e4e4f58b4ea4727f73410ed'}}} Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:44.776016 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. Aug 24 01:56:44.780377 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:44.782744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3f2b7981-399f-4d7b-a9f5-ca2015b5d841 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Returning 404 to user: Flavor access not found for 38 / e3a1dc772e4e4f58b4ea4727f73410ed combination. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:44.784518 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3f2b7981-399f-4d7b-a9f5-ca2015b5d841 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/523911279/action" status: 404 len: 124 microversion: 2.1 time: 0.157988 Aug 24 01:56:44.791271 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 884/1719] 10.222.0.49 () {60 vars in 1197 bytes} [Wed Aug 24 01:56:44 2022] POST /compute/v2.1/flavors/523911279/action => generated 124 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:44.796704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0045956-a9a1-499a-ba1c-e0bb2ab41278 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.798194 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:44.798194 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:44.839518 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0045956-a9a1-499a-ba1c-e0bb2ab41278 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/523911279" status: 202 len: 0 microversion: 2.1 time: 0.044009 Aug 24 01:56:44.855705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0509c117-60c0-44c6-a33c-d960e7b6f2d2 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.859675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 836/1720] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 01:56:44 2022] DELETE /compute/v2.1/flavors/523911279 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:44.917246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:44.918100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:44.948637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:44.950794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:44.951969 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0509c117-60c0-44c6-a33c-d960e7b6f2d2 tempest-FlavorsAccessNegativeTestJSON-866789160 tempest-FlavorsAccessNegativeTestJSON-866789160-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108061 Aug 24 01:56:44.955418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:44.961033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:44.961318 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 885/1721] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:44.968808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:44.970899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:45.079534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:45.274633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:45.275663 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:45.293626 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:45.294060 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:45.294507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:45.295241 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:45.303919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:45.303919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:45.942439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:45.952004 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-240f4554-c005-4ac4-afe3-f0fb6f13e188 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 1.039791 Aug 24 01:56:45.954865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 837/1722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:44 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:45.966512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:45.969882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:45.979988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:45.982673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:45.983911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:45.985639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:45.987837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:45.988453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:46.314530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:46.325301 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d2df36a-309e-425e-bdc3-7f0e69b5c807 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.368057 Aug 24 01:56:46.326149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 838/1723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:45 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:46.351184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:46.352941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:46.364437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:46.365075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:46.365405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:46.366131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:46.366595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:46.367024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:46.408802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:46.418647 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-97a72beb-d7a5-4d4b-96fe-3c16939288ec tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1469 microversion: 2.1 time: 1.147932 Aug 24 01:56:46.436498 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 886/1724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:45 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1469 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:46.442582 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d660cab-5e97-47a1-bfc9-1fcf2254e486", "name": "network-vif-plugged", "status": "completed", "tag": "65d55ed6-12b6-4ec5-99de-69f9eecfcad4"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:46.480874 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:46.481368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:46.481805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:46.531851 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] Creating event network-vif-plugged:65d55ed6-12b6-4ec5-99de-69f9eecfcad4 for instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 on n-h2-854121-3 Aug 24 01:56:46.541994 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-0dad87ff-45f0-40c7-a386-58a7e43b8448 req-bf03633f-3692-4a18-97e2-699eafb46332 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103568 Aug 24 01:56:46.542615 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 887/1725] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:46.616013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:46.639599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6477246e-217b-4613-bf8c-20c73b273cda tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1427 microversion: 2.1 time: 0.312642 Aug 24 01:56:46.643460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 839/1726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:46 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1427 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:46.676064 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3a8697-8a4c-4e11-9a81-e7885b30c479", "name": "network-vif-deleted", "tag": "a8452641-c3cd-4ca3-afb8-b88f13c6ace5"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:46.686986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:46.687720 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:46.688317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:46.706627 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] Creating event network-vif-deleted:a8452641-c3cd-4ca3-afb8-b88f13c6ace5 for instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 on n-h1-854121-3 Aug 24 01:56:46.721639 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-dc3cf988-e6ec-4329-bbb0-364fa7fe25dd req-07ce3a24-6485-4d5b-9df9-28fee8875f7b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049926 Aug 24 01:56:46.722326 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 888/1727] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 01:56:46.977737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:46.985379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:47.004542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.005666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.008955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.011502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.013867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.014624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.047758 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51b2488-e3fd-4a20-ae35-172334c377a4", "name": "network-vif-deleted", "tag": "30a7ccff-8bc6-4035-9010-174afac3795b"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:47.076644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.077185 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.079042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.108568 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] Creating event network-vif-deleted:30a7ccff-8bc6-4035-9010-174afac3795b for instance b51b2488-e3fd-4a20-ae35-172334c377a4 on n-h2-854121-3 Aug 24 01:56:47.122160 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c0d88d8a-0abe-4612-b6aa-a6bda19c3a22 req-810e2f18-1ede-4c4e-ab6b-f73ed33782c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080691 Aug 24 01:56:47.140759 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 889/1728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:47.296091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:47.298606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:47.311747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5f890da-16c8-4896-b6f8-90dd2d8cf3af tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.340217 Aug 24 01:56:47.318447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 840/1729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:46 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:47.352007 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:47.353578 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:47.381569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.382065 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.382501 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.383477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.383941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.384940 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.441522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:47.442998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:47.457335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.457979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.458970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.459960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.461747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.463146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.593138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.609526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.611895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.619196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lazy-loading 'fault' on Instance uuid ab3a8697-8a4c-4e11-9a81-e7885b30c479 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:47.677953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:47.686999 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2542acca-fcdc-4a03-8448-969b1a8e29ab tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 200 len: 1303 microversion: 2.1 time: 0.251477 Aug 24 01:56:47.687595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 841/1730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:47 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:47.707447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:47.708310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:47.718765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.719533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.720295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.729165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.730637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.731454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.816063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:47.816964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:47.817558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:47.820687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid b51b2488-e3fd-4a20-ae35-172334c377a4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:47.954084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:47.974225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4101ac1-121f-49f0-8ac3-0c2c34905e0c tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1303 microversion: 2.1 time: 0.267322 Aug 24 01:56:47.976989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 842/1731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:47 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:48.042729 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:48.052409 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-eed9d7df-6254-480d-aaf7-e74946ccddc0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.708783 Aug 24 01:56:48.070158 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 890/1732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:47 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:48.325429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-052838b0-c150-4009-a472-13231a3d5e61 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Action: 'create', calling method: .version_select at 0x7f6b9177b790>, body: {"keypair": {"name": "tempest-keypair-1020293187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXgYljfTHolxBF+8bfqvoTJFT55A8l8xQ5xR/2kraEV8cDcuxhoLRsclziGKdxm8dzFTN5JpjfoPyOa51RCBdxxGg+hhjgz+ZUQvJ92MRLiBWmuVlGhp4zEitZ2mGVLtw=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:48.339744 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:48.341124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:48.359359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.364000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.364802 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.365745 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.392574 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.396187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.425833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-052838b0-c150-4009-a472-13231a3d5e61 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Getting quotas for project 11b9c09fe62f48a493380c77be9a6de9. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:48.444825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-052838b0-c150-4009-a472-13231a3d5e61 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Getting quotas for user 12bf7164fa554f238b90c30e30484c80 and project 11b9c09fe62f48a493380c77be9a6de9. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:48.534452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-052838b0-c150-4009-a472-13231a3d5e61 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.213726 Aug 24 01:56:48.535503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 843/1733] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 01:56:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 01:56:48.709882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:48.711220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: ab3a8697-8a4c-4e11-9a81-e7885b30c479] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:48.714666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:48.722426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:48.732237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.734046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.736378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.737236 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-32b220ea-5db6-409f-88db-a101c161163e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.402210 Aug 24 01:56:48.737848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.739477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.741623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.741854 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 891/1734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:48 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:48.783539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] HTTP exception thrown: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Request method failure captured: Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 HTTP/1.1 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQDxpUvZpe6FeCUTAuGpLVWHEDah-Tc8TnRGHv39kpWXP9li4doXjaXp_dmq29IBv38_XPCWyLqZLhc6zrhnp0zzlWPSwvdjOfRnAY5ONhWKUzpYihAVKIvtQz-jC-0Lm8Bx1TA34FZvqJZdpnUpLOrR3VDEUG5PQqyWrykgQ5U1IU Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MigrationsAdminTest-66988046-project Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 665536bfd6424ee3a0afc0fc92572319 Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MigrationsAdminTest-66988046-project Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ab3a8697-8a4c-4e11-9a81-e7885b30c479'} Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:48.789214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Returning 404 to user: Instance ab3a8697-8a4c-4e11-9a81-e7885b30c479 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-181d79c9-026d-44f1-a86b-96e6f0212378 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479" status: 404 len: 111 microversion: 2.1 time: 0.088909 Aug 24 01:56:48.798604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 844/1735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:48 2022] GET /compute/v2.1/servers/ab3a8697-8a4c-4e11-9a81-e7885b30c479 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:48.802537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:48.802825 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:48.806435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=12 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:48.828188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.829149 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.830192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.832219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:48.833256 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:48.833945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:48.867937 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:49.003359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:49.004203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:49.027634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.028457 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f123e69f-ef19-4bc6-8bfd-b879ddf24613 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 204 len: 0 microversion: 2.1 time: 0.230044 Aug 24 01:56:49.031019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.031925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.033632 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 892/1736] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:48 2022] DELETE /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:49.038462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.039181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.040766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.042655 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:49.043634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:49.058108 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.063109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.064637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.071107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.073872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.075206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.143701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.144211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.146069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.146887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid b51b2488-e3fd-4a20-ae35-172334c377a4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:49.267796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:49.277890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e09f49e9-ed9c-456c-a9ca-152e4739742d tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 200 len: 1303 microversion: 2.1 time: 0.281176 Aug 24 01:56:49.279361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 845/1737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:48 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:49.287658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:49.295849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:49.310703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.311469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.312962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.314883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.315816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.316266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.552505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:49.561606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fdec6b5-69d5-44c9-9fca-1fdd96c6f64e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1316 microversion: 2.1 time: 0.280884 Aug 24 01:56:49.562746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 846/1738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:49 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:49.590899 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:49.600077 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:49.604253 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2e7b1b77-9533-425d-979e-9da6ce297d17 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1534 microversion: 2.1 time: 0.567725 Aug 24 01:56:49.606316 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 893/1739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:49 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1534 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:49.757799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:49.758422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:49.776463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.777049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.778859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:49.783045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:49.783844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:49.784316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.052613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:50.068596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02f09d17-36e4-40eb-acc9-1fd8fe46571e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.313323 Aug 24 01:56:50.070950 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 847/1740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:49 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:50.303638 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.306996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: b51b2488-e3fd-4a20-ae35-172334c377a4] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:50.327727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.329841 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.331396 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.332460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.333323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.334025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.354818 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] HTTP exception thrown: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Request method failure captured: Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 HTTP/1.1 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYTAx-fj4P-YzagYkzSlMQHLNO8dcl1bKRUSNQh1jhA2dli8Rn9C_8i6p2tn7r2K5SB7cDnTSBeeB8Gvl3PBlp5V9rmVR7ESWDIY6e0KhFwO1vKdrKnXAkg0z_EzwlLzKPT00yQlIOeWOW3EOdci9fOna7dX6SsN3L3vtZdTmCjN0zE Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17768302608445dda904cd4791e1a0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17768302608445dda904cd4791e1a0ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 00d5425074f540b8be6a17014a1eec40 Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'b51b2488-e3fd-4a20-ae35-172334c377a4'} Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:50.356646 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Returning 404 to user: Instance b51b2488-e3fd-4a20-ae35-172334c377a4 could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5aea0ebb-df80-4f00-bb06-af80e69e6352 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4" status: 404 len: 111 microversion: 2.1 time: 0.062249 Aug 24 01:56:50.361953 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 894/1741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:50 2022] GET /compute/v2.1/servers/b51b2488-e3fd-4a20-ae35-172334c377a4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:50.369120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.369836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:50.377081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.377790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.378627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.379650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.380383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.381273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.431154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:50.584243 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.584887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:50.591441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.596869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.600009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.601705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.602817 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.603481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.618338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-036eec5f-026b-43ba-b8b3-1f931f0987d8 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "DELETE /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 204 len: 0 microversion: 2.1 time: 0.253265 Aug 24 01:56:50.619342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 848/1742] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:50 2022] DELETE /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:50.633754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.636324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:50.647537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.649678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.650695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.653527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.654140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.654668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.862811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:50.871577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a915d14-b977-417b-935e-a2f787685894 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1534 microversion: 2.1 time: 0.247787 Aug 24 01:56:50.872524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 849/1743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:50 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1534 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:50.879179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.880079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:50.891285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.892124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.892815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.894288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:50.894939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:50.895707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:50.949630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:50.958501 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-831c6825-cc41-4d84-80d6-4bba46b5022d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1505 microversion: 2.1 time: 0.379118 Aug 24 01:56:50.959079 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 895/1744] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:50 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:50.987615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:50.988370 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:51.017884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.019140 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.021702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.025732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.027257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.027710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.080055 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:56:51.151163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:51.167619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a31f615f-3e62-40ef-ae2b-1f5ee71440eb tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1469 microversion: 2.1 time: 0.293009 Aug 24 01:56:51.169906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 850/1745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:50 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1469 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:51.176113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:51.177040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:51.186364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.187219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.187827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.188875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.189641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.190832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.250671 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-edfbaf5f-f9b1-4238-bd1c-2f0fc824c84d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 204 len: 0 microversion: 2.1 time: 0.271643 Aug 24 01:56:51.253707 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 896/1746] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:56:50 2022] DELETE /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:56:51.266072 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:51.267159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:51.276390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.279634 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.280371 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.281292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.281928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.282703 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.406051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:51.418491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-390e6fcb-c22c-464a-a21e-9a14ca1e94ad tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.247294 Aug 24 01:56:51.421197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 851/1747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:51 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:51.433155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-881672567", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f5eafc91-daf7-4a96-bb78-11999ca8314c"}, {"port": "034ef6c6-396b-407e-948c-b10759a257a8", "tag": "port-1"}, {"port": "6b6ab3af-bffd-4035-a651-6a36df9542f8", "tag": "port-2"}, {"uuid": "55a567a8-5850-498a-952d-a8314847874f", "tag": "net-1"}, {"uuid": "55a567a8-5850-498a-952d-a8314847874f"}, {"uuid": "2b980bc5-9ace-46e6-b6a4-fcb4030fce7c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2b980bc5-9ace-46e6-b6a4-fcb4030fce7c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ee553dc8-e98e-49af-b2f8-183601cecd6a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "10392e59-4fdd-49d0-8639-a341b0995cba", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b8f667e3-dea7-4260-a6e3-b90c12ebd96a", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--623801152"}], "key_name": "tempest-keypair-1020293187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:51.478088 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:51.493242 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2f310dca-a275-4c95-8d65-fb914d36df3c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1511 microversion: 2.1 time: 0.234650 Aug 24 01:56:51.494371 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 897/1748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:51 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:51.501231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0096410f-c55c-4bbe-a2d7-c22f89245511", "name": "network-vif-plugged", "status": "completed", "tag": "6abb6483-c100-4d90-92e6-3710a9cc5e8a"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:51.531846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.532943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.535039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.555700 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] Creating event network-vif-plugged:6abb6483-c100-4d90-92e6-3710a9cc5e8a for instance 0096410f-c55c-4bbe-a2d7-c22f89245511 on n-h2-854121-3 Aug 24 01:56:51.561735 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-44119230-03c3-4dc0-9f48-aeb10356677d req-fb373d5a-6e77-42c8-b58d-3ef6f2ac24cb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065828 Aug 24 01:56:51.562639 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 898/1749] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:51.608319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] validate_networks() for [('f5eafc91-daf7-4a96-bb78-11999ca8314c', None, None, None, None, None), (None, None, '034ef6c6-396b-407e-948c-b10759a257a8', None, None, None), (None, None, '6b6ab3af-bffd-4035-a651-6a36df9542f8', None, None, None), ('55a567a8-5850-498a-952d-a8314847874f', None, None, None, None, None), ('55a567a8-5850-498a-952d-a8314847874f', None, None, None, None, None), ('2b980bc5-9ace-46e6-b6a4-fcb4030fce7c', '10.2.2.100', None, None, None, None), ('2b980bc5-9ace-46e6-b6a4-fcb4030fce7c', '10.2.2.200', None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:56:51.904505 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:51.905412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:51.913407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.913898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.914330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:51.915970 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:51.916465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:51.916921 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.076159 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:52.084421 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0fef2b63-0c3e-4c29-b252-9288a54f14a1 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1534 microversion: 2.1 time: 0.186316 Aug 24 01:56:52.085388 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 899/1750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:51 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1534 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:52.191362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:52.191522 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:52.200456 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.201812 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.202269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.202984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.203439 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.203863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.352117 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:52.359941 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-abd7a94f-8f14-4ae4-9e4e-a40bea58f38b tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1469 microversion: 2.1 time: 0.173712 Aug 24 01:56:52.360511 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 900/1751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:52 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:52.440798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:52.441475 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:52.447885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.448364 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.448826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.449751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.450376 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.450977 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.589824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:52.597512 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-dd00186b-737f-46a7-8d99-7a73dff8d082 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.161757 Aug 24 01:56:52.598094 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 901/1752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:52 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:52.602941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:52.603847 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:52.617691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.618770 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.619517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.620826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:52.621471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:52.621969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:52.762005 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:52.769720 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-794f0b46-3212-4c50-9237-a3fc3adbac61 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1511 microversion: 2.1 time: 0.170511 Aug 24 01:56:52.770287 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 902/1753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:52 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:52.893135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3eb7aa95-abdb-405f-9ac2-7568751dcc93 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1228925875", "ram": 512, "vcpus": 1, "disk": 10, "id": 1275857378, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:52.896190 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:52.896190 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:52.911884 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3eb7aa95-abdb-405f-9ac2-7568751dcc93 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.140574 Aug 24 01:56:52.912483 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 903/1754] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:52 2022] POST /compute/v2.1/flavors => generated 416 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:52.917562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-7141980", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0c6330be-cca7-4bf4-967a-c3f5a62fa964"}], "block_device_mapping_v2": [{"uuid": "27bffce1-7c91-4ab8-87bd-ad390b83f83b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:52.984510 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.network.neutron [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] validate_networks() for [('0c6330be-cca7-4bf4-967a-c3f5a62fa964', None, None, None, None, None)] {{(pid=128566) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:56:53.714399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:56:53.714879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:56:53.715289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:56:53.715702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:56:53.716126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:56:53.726012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:53.726497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:53.726934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:53.727676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:53.728128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:53.728562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:53.747239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Getting quotas for project 11b9c09fe62f48a493380c77be9a6de9. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:53.751626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Getting quotas for user 12bf7164fa554f238b90c30e30484c80 and project 11b9c09fe62f48a493380c77be9a6de9. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:53.923770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:56:53.926863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ee553dc8-e98e-49af-b2f8-183601cecd6a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='10392e59-4fdd-49d0-8639-a341b0995cba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8f667e3-dea7-4260-a6e3-b90c12ebd96a',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:56:54.216612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:56:54.217173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image limits 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:56:54.217600 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Flavor pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:56:54.218018 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Image pref 0:0:0 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:56:54.218435 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.virt.hardware [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128566) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:56:54.240751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.241302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.241747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.242488 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.242960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.243527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.286003 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:56:54.297671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.quota [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Getting quotas for user 6223af42e4e34d7cb4f327824ac148af and project 74a49d21a3bf48cda64bd438f11e6363. Resources: {'instances', 'ram', 'cores'} {{(pid=128566) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:56:54.376670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05a7553e-0fbe-4b0a-b591-97ecedb29ac7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 2.952320 Aug 24 01:56:54.377840 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 852/1755] 10.222.0.49 () {62 vars in 1189 bytes} [Wed Aug 24 01:56:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2956 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:56:54.383380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c91d144f-5d9b-4d9a-bb32-7a278788e165 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:54.387295 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:54.387295 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:54.425652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c91d144f-5d9b-4d9a-bb32-7a278788e165 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046389 Aug 24 01:56:54.426641 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 853/1756] 10.222.0.49 () {60 vars in 1224 bytes} [Wed Aug 24 01:56:54 2022] POST /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:54.433642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:54.434796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:54.443625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.448600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.449369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.450377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.451025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.451561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.451923 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Going to run 1 instances... {{(pid=128566) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:56:54.454114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='27bffce1-7c91-4ab8-87bd-ad390b83f83b',volume_size=None,volume_type=None)] {{(pid=128566) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:56:54.623373 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-385304e3-ce54-4370-a957-c75dd5923fc6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.709773 Aug 24 01:56:54.631336 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 904/1757] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 01:56:54.633453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:54.639250 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:54.640273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:54.642859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47dfa329-8ff1-4f4f-9052-34a0d5751727 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1534 microversion: 2.1 time: 0.214578 Aug 24 01:56:54.644374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 854/1758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:54 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1534 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:54.650191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:54.651221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:54.659032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.659793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.660771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.661845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.662851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.663670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.664481 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.665181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.665410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.666307 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.666944 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.668858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.844875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:54.866087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2415b4e-9fd1-43a1-815f-1a56620ddbb8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1315 microversion: 2.1 time: 0.209831 Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 855/1759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:54 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.887671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.889315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.983964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:54.984408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:54.985167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:54.985851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'fault' on Instance uuid 7d660cab-5e97-47a1-bfc9-1fcf2254e486 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:55.026728 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.036363 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-58e2b043-4e5c-4d1b-a78c-239fa970ed12 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1469 microversion: 2.1 time: 0.403426 Aug 24 01:56:55.039694 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 905/1760] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:54 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:55.062538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d660cab-5e97-47a1-bfc9-1fcf2254e486", "name": "network-vif-deleted", "tag": "65d55ed6-12b6-4ec5-99de-69f9eecfcad4"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:55.087154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.098480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32f51fd7-7159-4392-beb2-3ede24487ccb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1306 microversion: 2.1 time: 0.224908 Aug 24 01:56:55.112752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.112752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.112752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.114003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 856/1761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:54 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:55.120098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.121061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:55.137256 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] Creating event network-vif-deleted:65d55ed6-12b6-4ec5-99de-69f9eecfcad4 for instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 on n-h2-854121-3 Aug 24 01:56:55.144287 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-1418e5e6-a238-4457-b3df-01ab1c0d45f2 req-eef3280e-056b-4d70-9d36-e5f53caf67fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101844 Aug 24 01:56:55.145297 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 906/1762] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:55.183475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.194426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.196898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.198295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0f63d3b-4d08-49d0-9e24-3ef6f6d39d2b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1285 microversion: 2.32 time: 0.082635 Aug 24 01:56:55.199247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 857/1763] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:55.205520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.206366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:55.336501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.349415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.351893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.352040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-05a63e36-719a-4a0b-91ab-cdc61f7b57a4 tempest-FlavorsExtraSpecsTestJSON-1654246454 tempest-FlavorsExtraSpecsTestJSON-1654246454-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.358147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b5afb5d-da50-4313-b823-221af85ad8ee tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1101 microversion: 2.25 time: 0.157345 Aug 24 01:56:55.358991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 858/1764] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1101 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:55.365702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c18b9cf2-530a-4494-822a-95ede195093d", "name": "network-vif-deleted", "tag": "188d31fd-d95b-432d-bb7b-0e74bf6d98d5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:55.391502 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-05a63e36-719a-4a0b-91ab-cdc61f7b57a4 tempest-FlavorsExtraSpecsTestJSON-1654246454 tempest-FlavorsExtraSpecsTestJSON-1654246454-project] 10.222.0.49 "GET /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.244757 Aug 24 01:56:55.391833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.392552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.393001 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 907/1765] 10.222.0.49 () {58 vars in 1203 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.393587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.411096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bc1a0fe4-35ac-424c-9f9c-41ae03bb66a9 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:55.415923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] Creating event network-vif-deleted:188d31fd-d95b-432d-bb7b-0e74bf6d98d5 for instance c18b9cf2-530a-4494-822a-95ede195093d on n-h2-854121-3 Aug 24 01:56:55.423476 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:55.423476 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:55.438688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-47b752d3-cd8f-4316-ba26-bc218095ac9c req-9dd4f4c2-aa27-47f1-9ded-ae008629aa77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077775 Aug 24 01:56:55.440502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 859/1766] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:55.459235 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bc1a0fe4-35ac-424c-9f9c-41ae03bb66a9 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059813 Aug 24 01:56:55.465198 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 908/1767] 10.222.0.49 () {60 vars in 1224 bytes} [Wed Aug 24 01:56:55 2022] POST /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.471550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35c41b52-019a-44e8-9820-01bc71b056e9 tempest-FlavorsExtraSpecsTestJSON-1654246454 tempest-FlavorsExtraSpecsTestJSON-1654246454-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.489547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35c41b52-019a-44e8-9820-01bc71b056e9 tempest-FlavorsExtraSpecsTestJSON-1654246454 tempest-FlavorsExtraSpecsTestJSON-1654246454-project] 10.222.0.49 "GET /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.022871 Aug 24 01:56:55.493666 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 860/1768] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes => generated 22 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.503147 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fd5f6564-4a7a-43ea-957f-8ce1b941174a tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:55.538136 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fd5f6564-4a7a-43ea-957f-8ce1b941174a tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039167 Aug 24 01:56:55.546593 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 909/1769] 10.222.0.49 () {60 vars in 1224 bytes} [Wed Aug 24 01:56:55 2022] POST /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.552909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ba9fda2-4ad3-460b-86c3-9f554a50f400 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.567472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ba9fda2-4ad3-460b-86c3-9f554a50f400 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019184 Aug 24 01:56:55.569006 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 861/1770] 10.222.0.49 () {58 vars in 1203 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 01:56:55.578989 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b64d08c8-0227-4519-9966-77c4ea9394a3 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:55.582042 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:55.582042 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:56:55.633886 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b64d08c8-0227-4519-9966-77c4ea9394a3 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.058707 Aug 24 01:56:55.634596 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 910/1771] 10.222.0.49 () {60 vars in 1265 bytes} [Wed Aug 24 01:56:55 2022] PUT /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes => generated 22 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 01:56:55.646496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-264e08e3-f6b7-40ae-a211-99bc7fc495f1 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.674623 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.675711 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:55.679019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-264e08e3-f6b7-40ae-a211-99bc7fc495f1 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038116 Aug 24 01:56:55.681492 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 862/1772] 10.222.0.49 () {58 vars in 1203 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/1275857378/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.693599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.694056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bcc644a-0748-496b-b0dd-5b10a2b6aa20 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.697557 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.698791 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:55.698791 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:55.699073 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.700359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.701199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.703082 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.759721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bcc644a-0748-496b-b0dd-5b10a2b6aa20 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.074045 Aug 24 01:56:55.760578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 863/1773] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 01:56:55 2022] DELETE /compute/v2.1/flavors/1275857378/os-extra_specs/hw:numa_nodes => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 24 01:56:55.767422 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.768477 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.768937 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.769390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lazy-loading 'fault' on Instance uuid c18b9cf2-530a-4494-822a-95ede195093d {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:55.770991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98e42355-c2cc-41fa-98a0-fb3edc3fb185 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.798117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98e42355-c2cc-41fa-98a0-fb3edc3fb185 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1275857378/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.033220 Aug 24 01:56:55.800966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 864/1774] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 01:56:55 2022] DELETE /compute/v2.1/flavors/1275857378/os-extra_specs/hw:cpu_policy => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 01:56:55.806449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-793d31b7-5b53-4cb5-b617-452b090db8c0 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.818701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-793d31b7-5b53-4cb5-b617-452b090db8c0 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/1275857378/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015763 Aug 24 01:56:55.819754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 865/1775] 10.222.0.49 () {58 vars in 1203 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/1275857378/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:56:55.826587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:55.832441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc9bb06b-8831-4e13-9e7f-835a8b7b140a tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.833292 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:56:55.833292 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:56:55.835859 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9f26d688-8a71-4769-9f01-366b0ea304d7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1368 microversion: 2.1 time: 0.175235 Aug 24 01:56:55.836447 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 911/1776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:55.842486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:55.855813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc9bb06b-8831-4e13-9e7f-835a8b7b140a tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1275857378" status: 202 len: 0 microversion: 2.1 time: 0.027773 Aug 24 01:56:55.856484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 866/1777] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 01:56:55 2022] DELETE /compute/v2.1/flavors/1275857378 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:55.866448 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7018ea17-5427-469f-a8c4-4cdfb636e5e7 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.891837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:55.892213 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7018ea17-5427-469f-a8c4-4cdfb636e5e7 tempest-FlavorsExtraSpecsTestJSON-281500012 tempest-FlavorsExtraSpecsTestJSON-281500012-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031235 Aug 24 01:56:55.892339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:55.892844 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 912/1778] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:55.904760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.905605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.906356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.907080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:55.907531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:55.907992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:55.927212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:56.061258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.062811 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.079359 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.083560 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.084465 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.086664 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.088272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.092114 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.114753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.135568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52212e3e-3913-4251-b705-2f1f1db58b4d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1503 microversion: 2.1 time: 0.247764 Aug 24 01:56:56.137130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 867/1779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:55 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1503 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:56.145950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.146755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.157357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.158400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.159926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.161926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.163144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.165261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.202411 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.202911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.203355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.203851 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lazy-loading 'fault' on Instance uuid 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:56.253364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.254932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.255549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.256328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'fault' on Instance uuid 7d660cab-5e97-47a1-bfc9-1fcf2254e486 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:56.336221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.349327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-648dc4a0-2c16-43fe-b980-247fa1c23553 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 200 len: 1306 microversion: 2.1 time: 0.210616 Aug 24 01:56:56.350310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 868/1780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 1306 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:56.353726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00d5425074f540b8be6a17014a1eec40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17768302608445dda904cd4791e1a0ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.358185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.359145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.362843 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c6dc7077-0946-42fe-9eb0-81f7467cb4bf tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 200 len: 1303 microversion: 2.1 time: 0.306328 Aug 24 01:56:56.365449 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 913/1781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:56:56.381416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.381910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.382359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.383063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.385311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.385764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.386994 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.388301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.394216 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3,nova_api:INSERT=4,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:56.396942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.397698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.398319 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.399470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.400174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.400794 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.506362 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.521513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.523115 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.524248 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2d7c4c9d-5526-4f73-bb24-fa810705f4aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1174 microversion: 2.25 time: 0.141111 Aug 24 01:56:56.524841 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 914/1782] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1174 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:56.617778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.632320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.643235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.646697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:56.647391 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.654432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd8b5952-8ad2-4b94-88b3-5424018811d1 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1575 microversion: 2.32 time: 0.299368 Aug 24 01:56:56.658182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 869/1783] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1575 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:56.675302 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.676022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.676611 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.678107 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.678735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.679805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.859903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:56.860629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:56.896480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.899494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.900771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:56.904102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:56.906917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:56.914174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.002518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.002725 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bd2d179a-1a1c-43b1-bfb3-af052c659005 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1857 microversion: 2.1 time: 0.366100 Aug 24 01:56:57.003733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.004849 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 915/1784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1857 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:57.005098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.007277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lazy-loading 'fault' on Instance uuid c18b9cf2-530a-4494-822a-95ede195093d {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:57.030830 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:57.038960 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:57.057679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.063671 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.064567 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.067668 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.068765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.069725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.128685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:57.141985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d5c1799-1e7b-44ca-bc0d-26aa575770bc tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 200 len: 1368 microversion: 2.1 time: 0.283746 Aug 24 01:56:57.143600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 870/1785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:56 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:57.149520 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.objects.instance [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lazy-loading 'flavor' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128566) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:56:57.165133 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:56:57.184987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Going to try to live migrate instance to n-h2-854121-3 {{(pid=128566) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:56:57.371219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:57.371939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:57.380301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.382883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.383633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.385405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.386202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.386857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.402992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 HTTP/1.1 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7d660cab-5e97-47a1-bfc9-1fcf2254e486'} Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:57.404996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.411379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:57.415116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec2524ba-e1bf-4a29-aec0-0ad74b0d5266 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 404 len: 111 microversion: 2.1 time: 0.043643 Aug 24 01:56:57.415116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 871/1786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:57 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:57.420848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:57.421583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] [instance: 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:57.429008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.429772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.430425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.431321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.431945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.432482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.450221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] HTTP exception thrown: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Request method failure captured: Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e HTTP/1.1 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYTAx-fj4P-YzagYkzSlMQHLNO8dcl1bKRUSNQh1jhA2dli8Rn9C_8i6p2tn7r2K5SB7cDnTSBeeB8Gvl3PBlp5V9rmVR7ESWDIY6e0KhFwO1vKdrKnXAkg0z_EzwlLzKPT00yQlIOeWOW3EOdci9fOna7dX6SsN3L3vtZdTmCjN0zE Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/17768302608445dda904cd4791e1a0ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/17768302608445dda904cd4791e1a0ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_17768302608445dda904cd4791e1a0ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 17768302608445dda904cd4791e1a0ba Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAdminTestJSON-610281081 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 00d5425074f540b8be6a17014a1eec40 Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAdminTestJSON-610281081-project Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '14b1cce6-7f92-4df0-8609-5e9fcae5cd0e'} Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:57.451950 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:57.457897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] Returning 404 to user: Instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:57.459036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09a8617a-8c36-4b39-a20b-f474f56d35a2 tempest-ServersAdminTestJSON-610281081 tempest-ServersAdminTestJSON-610281081-project] 10.222.0.49 "GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e" status: 404 len: 111 microversion: 2.1 time: 0.044541 Aug 24 01:56:57.460895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 872/1787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:57 2022] GET /compute/v2.1/servers/14b1cce6-7f92-4df0-8609-5e9fcae5cd0e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:57.466597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:57.467213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:57.477807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.478306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.478737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.479469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.479923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.480401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.649541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:57.661198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae0b9c20-0f04-4a56-9770-b6a08f455523 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.198912 Aug 24 01:56:57.663662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 873/1788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:57 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:57.680312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b1cce6-7f92-4df0-8609-5e9fcae5cd0e", "name": "network-vif-deleted", "tag": "0f426425-1c7b-4fff-a7f9-e4ed7375618a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:57.726028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.728449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.729973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.771121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] Creating event network-vif-deleted:0f426425-1c7b-4fff-a7f9-e4ed7375618a for instance 14b1cce6-7f92-4df0-8609-5e9fcae5cd0e on n-h2-854121-3 Aug 24 01:56:57.794190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-23ddc0a0-72eb-4453-8d70-17e96535a32c req-49631f69-2252-4744-bb85-7a531ea5e5b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126669 Aug 24 01:56:57.794843 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 874/1789] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:56:57.819609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:57.822582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:57.855927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.860286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.863783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:57.868035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:57.871249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:57.875557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.079641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.094290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.095802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.105158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34d698bb-962c-4f51-b69c-a13fdfbab4de tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1238 microversion: 2.25 time: 0.296265 Aug 24 01:56:58.114574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 875/1790] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:57 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1238 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:58.121403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:58.129663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:58.153508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.155612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.158070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.164287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.165170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.165875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.490838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.505461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.508660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:58.513896 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85da3422-ca3e-4179-bcac-29d614c6f7d0 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1593 microversion: 2.32 time: 0.397999 Aug 24 01:56:58.515097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 876/1791] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:58 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1593 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:56:58.520632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-874a365d-3341-409d-9156-b743411064bd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-874a365d-3341-409d-9156-b743411064bd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 163 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": 12345, "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 12345 Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:56:58.524768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 24 01:56:58.529532 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.532588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-874a365d-3341-409d-9156-b743411064bd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:58.534883 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-874a365d-3341-409d-9156-b743411064bd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017447 Aug 24 01:56:58.536027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 877/1792] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:56:58 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:56:58.541413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:58.542837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c18b9cf2-530a-4494-822a-95ede195093d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:58.554878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.555643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.556328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.557348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.558053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.558761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.577344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] HTTP exception thrown: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Request method failure captured: Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d HTTP/1.1 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQDxpUvZpe6FeCUTAuGpLVWHEDah-Tc8TnRGHv39kpWXP9li4doXjaXp_dmq29IBv38_XPCWyLqZLhc6zrhnp0zzlWPSwvdjOfRnAY5ONhWKUzpYihAVKIvtQz-jC-0Lm8Bx1TA34FZvqJZdpnUpLOrR3VDEUG5PQqyWrykgQ5U1IU Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MigrationsAdminTest-66988046-project Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 665536bfd6424ee3a0afc0fc92572319 Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MigrationsAdminTest-66988046-project Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c18b9cf2-530a-4494-822a-95ede195093d'} Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:56:58.579304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. Aug 24 01:56:58.584512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:56:58.588463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Returning 404 to user: Instance c18b9cf2-530a-4494-822a-95ede195093d could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:56:58.589671 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94691389-203d-44ff-b47e-04bf2049a706 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d" status: 404 len: 111 microversion: 2.1 time: 0.052385 Aug 24 01:56:58.591410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 878/1793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:58 2022] GET /compute/v2.1/servers/c18b9cf2-530a-4494-822a-95ede195093d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:56:58.598151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:58.599177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:58.608977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.611548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.612521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:58.613679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:58.615583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:58.616135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:59.735434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:56:59.746041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a996d72-31aa-4f37-b64a-db9cf5cd79d7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 1.153294 Aug 24 01:56:59.764710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 879/1794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:56:58 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:56:59.772619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7e5931f-47aa-45ef-b063-2ed91114cf6a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '.version_select at 0x7f6b9167fdc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:59.827372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7e5931f-47aa-45ef-b063-2ed91114cf6a tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774357451" status: 202 len: 0 microversion: 2.1 time: 0.061439 Aug 24 01:56:59.828892 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 880/1795] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 01:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774357451 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:56:59.836898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:56:59.837988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:56:59.846563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:59.847235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:59.847955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:56:59.848823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:56:59.849520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:56:59.850243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.179114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.188601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.191063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.192473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc709f74-87a8-46a6-bf57-f41464eb1593 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.362362 Aug 24 01:57:00.224355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 881/1796] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:56:59 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:00.229516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:00.231460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:00.245696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.246467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.247123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.248070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.248790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.249493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.429842 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4bb88b46-fcd6-4042-8c75-fd03a326736f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/action" status: 202 len: 0 microversion: 2.1 time: 3.409175 Aug 24 01:57:00.431465 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 916/1797] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:56:57 2022] POST /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/action => generated 0 bytes in 3412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:57:00.441846 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:00.443224 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:00.465440 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.466289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.466930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.467866 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.468596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.469385 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.786532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.825201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.827465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.829025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23b86262-f557-4969-a5ec-32c343433205 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1660 microversion: 2.32 time: 0.603270 Aug 24 01:57:00.830115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 882/1798] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:00 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1660 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:00.852137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:00.856555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:00.879622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.880695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.882781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.883712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:00.887159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:00.890340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:00.940474 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:00.961795 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-156e1f38-9fda-474a-999d-d2df6369f146 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.517503 Aug 24 01:57:00.972490 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 917/1799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:00 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:01.215379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:01.215988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:01.223986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:01.224472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:01.225194 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:01.227915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:01.228565 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:01.236258 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:01.702680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:01.712265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2fe758f-13ca-4942-98b7-c2e15d90bd6b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.877397 Aug 24 01:57:01.715928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 883/1800] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:00 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:01.863572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:01.865106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:01.874078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:01.875958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:01.878608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:01.882610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:01.884304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:01.886278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.033972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.044683 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.046654 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.048366 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d32b0621-b349-4d36-8796-084a273b10fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.836760 Aug 24 01:57:02.050237 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 918/1801] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:01 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:02.440932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.457319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.458868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:02.460095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f01aa31-5688-43ac-9b6e-fbe3829c27d6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1660 microversion: 2.32 time: 0.605362 Aug 24 01:57:02.466815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 884/1802] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:01 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1660 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:57:02.485571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3effb318-d8d0-4d2c-80e1-18f95a4a9151", "tag": "8a5a216a-6187-4d02-9bea-0ba1be5be92a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:02.503074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:02.509515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:02.510328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.537890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] Creating event network-changed:8a5a216a-6187-4d02-9bea-0ba1be5be92a for instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 on n-h1-854121-3 Aug 24 01:57:02.547865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-35cc8477-1488-4c9e-9785-940ab6d8fdd3 req-93a5e080-8373-462f-a16d-62b0c64b3ef4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079446 Aug 24 01:57:02.550960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 885/1803] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:02.618763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:02.619714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:02.636510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:02.638979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:02.641144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.644997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:02.645704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:02.646344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.672988 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-6a92a567-0a4b-47f9-887f-d1117058f29b tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-136771011", "id": 1889513028, "os-flavor-access:is_public": "True"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:02.677410 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:02.677410 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:02.709002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:57:02.726250 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-6a92a567-0a4b-47f9-887f-d1117058f29b tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.674268 Aug 24 01:57:02.727512 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 919/1804] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 01:57:02 2022] POST /compute/v2.1/flavors => generated 467 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:02.876262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edaffcc4-9bd9-463d-b1ec-55e3acc88918 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 204 len: 0 microversion: 2.1 time: 0.262093 Aug 24 01:57:02.876899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 886/1805] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:57:02 2022] DELETE /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 01:57:02.906556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:02.907270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:02.926911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:02.927726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:02.928361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.929860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:02.930499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:02.931167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:02.994324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:03.154023 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-186bb20c-130e-46ae-9e1d-50c90b4b5a08 tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.166185 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-186bb20c-130e-46ae-9e1d-50c90b4b5a08 tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] 10.222.0.49 "GET /compute/v2.1/flavors/1889513028" status: 200 len: 467 microversion: 2.61 time: 0.427955 Aug 24 01:57:03.167170 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 920/1806] 10.222.0.49 () {60 vars in 1199 bytes} [Wed Aug 24 01:57:02 2022] GET /compute/v2.1/flavors/1889513028 => generated 467 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:03.172909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.174599 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:03.181317 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.182684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.183751 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.184889 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.185789 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.186454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.249334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.259146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac1e17f3-28e9-4d03-91a3-617c49daffbe tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.380538 Aug 24 01:57:03.260962 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 887/1807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:02 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:03.276858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.277861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:03.286433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.287296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.287967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.288975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.289546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.290090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.381176 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.389434 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-101103fa-d326-446f-be63-a30b216b08ae tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1469 microversion: 2.1 time: 0.220970 Aug 24 01:57:03.390028 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 921/1808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:03.407047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-af01125a-ac13-455f-9c7c-cb5f3b032397 tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9908ed30>, body: {"flavor": {"description": "new"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:03.419855 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:03.419855 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:03.455763 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-af01125a-ac13-455f-9c7c-cb5f3b032397 tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] 10.222.0.49 "PUT /compute/v2.1/flavors/1889513028" status: 200 len: 468 microversion: 2.61 time: 0.056942 Aug 24 01:57:03.457295 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 922/1809] 10.222.0.49 () {62 vars in 1219 bytes} [Wed Aug 24 01:57:03 2022] PUT /compute/v2.1/flavors/1889513028 => generated 468 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:03.475286 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-1689a486-02ba-4cae-8a8d-d7fe85e108a2 tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.507404 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-1689a486-02ba-4cae-8a8d-d7fe85e108a2 tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.038297 Aug 24 01:57:03.508007 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 923/1810] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:57:03.514289 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.515997 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:03.528604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.529278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.529781 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.530561 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:03.531083 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:03.531601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:03.695293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.703764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.705329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.706443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e50cfb68-3819-44ef-b4ed-b8186a68d2d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.444299 Aug 24 01:57:03.707002 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 888/1811] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:03.732747 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.738684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:03.743936 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.745642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:03.746887 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8eb562ad-45ba-459a-ae3a-2e02e42bee31 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1706 microversion: 2.32 time: 0.236947 Aug 24 01:57:03.747649 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 924/1812] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1706 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:03.752350 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-63e59078-e3da-4255-b52a-9222b986ef4c tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.774202 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-63e59078-e3da-4255-b52a-9222b986ef4c tempest-FlavorsV261TestJSON-311224575 tempest-FlavorsV261TestJSON-311224575-project] 10.222.0.49 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.025247 Aug 24 01:57:03.774892 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 925/1813] 10.222.0.49 () {60 vars in 1166 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:03.793188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c07cec5d-160d-4833-b9d4-0662b9436533 tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.793959 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:03.793959 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:03.811979 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c07cec5d-160d-4833-b9d4-0662b9436533 tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1889513028" status: 202 len: 0 microversion: 2.61 time: 0.023565 Aug 24 01:57:03.812560 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 926/1814] 10.222.0.49 () {60 vars in 1202 bytes} [Wed Aug 24 01:57:03 2022] DELETE /compute/v2.1/flavors/1889513028 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:57:03.820625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-cc5c43ae-3e7b-4b6a-8e2c-17786fdf62db tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:03.842637 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-cc5c43ae-3e7b-4b6a-8e2c-17786fdf62db tempest-FlavorsV261TestJSON-1211107510 tempest-FlavorsV261TestJSON-1211107510-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.025666 Aug 24 01:57:03.843311 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 927/1815] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:57:03 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:57:03.848343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-948186776", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:03.903931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:04.218722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:04.219760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:04.220554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:04.221726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:04.222419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:04.238975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.240190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.243624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.244445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.244960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.245398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.266385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:04.271106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:04.284315 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:04.284914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:04.285916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:04.286809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:04.288507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:04.307158 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.309324 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.310063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.311616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.315603 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.317482 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.320174 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell0:SELECT=6 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:04.365633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2545c3dd-6ada-4fa4-9cc8-b338a51f08ff tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654946 Aug 24 01:57:04.366469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 889/1816] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:57:04.379585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d34f3ae0-1cdf-4226-8e1a-9a95bebf4bce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:04.379701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d34f3ae0-1cdf-4226-8e1a-9a95bebf4bce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:04.545269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:04.546661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d34f3ae0-1cdf-4226-8e1a-9a95bebf4bce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:04.555437 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b0c371af-8fa9-4888-8c4b-b03031a5d009 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.275145 Aug 24 01:57:04.557012 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 928/1817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:04 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:04.561969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:04.562500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:04.563375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d34f3ae0-1cdf-4226-8e1a-9a95bebf4bce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1216 microversion: 2.1 time: 0.189511 Aug 24 01:57:04.566652 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 890/1818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:04 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:57:04.597096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.597096 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.597412 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.597951 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.598403 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.598824 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.733051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:04.734228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:04.750419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.754072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.755465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.758624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.760579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.762210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.928534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:04.936749 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-5fb24319-3a9d-4290-8ca1-ef39b4743c2d tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1469 microversion: 2.1 time: 0.378503 Aug 24 01:57:04.942359 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 929/1819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:04 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1469 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:04.952989 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:04.953945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:04.987705 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:04.994669 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:04.996493 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:04.999935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:05.000983 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:05.004029 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:05.235199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.250235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.256139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.257409 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b3ae067-f41c-4f45-871b-0635138d3119 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.530653 Aug 24 01:57:05.258112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 891/1820] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:04 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:05.355301 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.366524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.370679 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.371769 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ea986c94-aa09-40d2-a40d-4eea796055bf tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1706 microversion: 2.32 time: 0.427923 Aug 24 01:57:05.372337 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 930/1821] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:04 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1706 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:05.591881 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:05.592509 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:05.598317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:05.599175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:05.622772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:05.623648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:05.624878 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:05.627631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:05.628116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:05.628292 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:05.630199 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:05.632177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:05.632737 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:05.633162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:05.634150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:05.638579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:05.976023 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:05.986286 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7f5309c5-565f-4ef9-a439-24612ba40621 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1268 microversion: 2.1 time: 0.398988 Aug 24 01:57:05.994124 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 931/1822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:05 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1268 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:06.012122 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff16aea-6b19-4be3-88da-d2b2e57f4e57", "name": "network-vif-deleted", "tag": "a8aee841-9ab1-44af-97ab-f7455c501859"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:06.027517 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.027995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.028438 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.036802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:06.050880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d02061a7-66f7-4ab3-ad91-5d2cfe1ef7a6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.474368 Aug 24 01:57:06.051708 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 892/1823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:05 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:06.062664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:06.064203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:06.075272 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] Creating event network-vif-deleted:a8aee841-9ab1-44af-97ab-f7455c501859 for instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 on n-h1-854121-3 Aug 24 01:57:06.084760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.086047 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-1f9fe656-9c61-4210-b61a-3763908cba4d req-10cfc980-9e61-4474-8dc3-c398830028ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087903 Aug 24 01:57:06.086181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.086607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.089724 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 932/1824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:06.089928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.093360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.093854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.282950 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:06.284854 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:06.331752 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.337710 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.338755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.342893 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.345100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.347277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.551981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.552546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.552947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.556508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lazy-loading 'fault' on Instance uuid fff16aea-6b19-4be3-88da-d2b2e57f4e57 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:57:06.618264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:06.628792 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d5520b5-3a6c-4ebd-8679-5d36e954c1b4 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 200 len: 1303 microversion: 2.1 time: 0.574067 Aug 24 01:57:06.643792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 893/1825] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:06 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 1303 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:06.654652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:06.656014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:06.669768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.670269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.670773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.671481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:06.672120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:06.673585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:06.938941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:06.948934 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:06.950807 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:06.952296 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-788d7a53-a84d-4217-8638-badf6ac0dc25 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.676387 Aug 24 01:57:06.968913 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 933/1826] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:06 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:07.018849 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.019470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.025992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.026483 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.028672 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.040872 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.041368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.041810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.161105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:07.177010 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-78a6bebe-5c13-4d59-99c1-7b1eef9d925e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1274 microversion: 2.1 time: 0.162370 Aug 24 01:57:07.177919 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 934/1827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:07 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:07.190709 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.194816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:07.207466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.228733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:07.232482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:07.240681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67ac29be-7e7e-4125-a640-1a00be97480f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1752 microversion: 2.32 time: 0.594042 Aug 24 01:57:07.249277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.249490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 894/1828] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:06 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1752 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:07.253562 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.254231 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.256987 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.257694 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.259239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.521583 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:07.531896 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a8f14fb0-0117-49df-a494-9a9952f43b00 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.351413 Aug 24 01:57:07.535200 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 935/1829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:07 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:07.650134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.650865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: fff16aea-6b19-4be3-88da-d2b2e57f4e57] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.658635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.660750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.662718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.663962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.664675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.665489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.695756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] HTTP exception thrown: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Request method failure captured: Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 HTTP/1.1 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQDxpUvZpe6FeCUTAuGpLVWHEDah-Tc8TnRGHv39kpWXP9li4doXjaXp_dmq29IBv38_XPCWyLqZLhc6zrhnp0zzlWPSwvdjOfRnAY5ONhWKUzpYihAVKIvtQz-jC-0Lm8Bx1TA34FZvqJZdpnUpLOrR3VDEUG5PQqyWrykgQ5U1IU Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MigrationsAdminTest-66988046-project Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 665536bfd6424ee3a0afc0fc92572319 Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MigrationsAdminTest-66988046-project Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fff16aea-6b19-4be3-88da-d2b2e57f4e57'} Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:07.698370 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Returning 404 to user: Instance fff16aea-6b19-4be3-88da-d2b2e57f4e57 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7599c5e-e80f-436b-b53f-c08b785365b0 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57" status: 404 len: 111 microversion: 2.1 time: 0.054239 Aug 24 01:57:07.705534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 895/1830] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:07 2022] GET /compute/v2.1/servers/fff16aea-6b19-4be3-88da-d2b2e57f4e57 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:07.717552 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.721383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.739026 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.739554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.740012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.741330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.741859 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.743157 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.813125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Going to try to terminate instance {{(pid=128566) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:57:07.933087 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d398e15d-3364-4fa6-a60d-922fc16b4db7 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 204 len: 0 microversion: 2.1 time: 0.224993 Aug 24 01:57:07.933947 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 936/1831] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:57:07 2022] DELETE /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:57:07.945232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.946229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.961183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.962200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.978465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.979687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.980355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:07.980939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.981919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:07.982114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.991373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.992269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.993062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:07.994103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:07.994809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:07.995538 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.026597 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:08.276914 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:08.285916 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:08.290225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:08.293187 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9cf6e08c-72f8-4287-a4c5-7e9d4cc9df29 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.320089 Aug 24 01:57:08.295669 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 937/1832] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:07 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:08.300320 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:08.300963 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:08.308279 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.309330 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.309775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.310558 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.311022 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.311502 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.590382 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:08.600467 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c4c5f44e-b49e-46b0-ac5e-91dd1fc17a75 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.303555 Aug 24 01:57:08.601404 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 938/1833] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:08 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:08.606105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:08.606723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:08.614529 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.615032 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.615472 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.616191 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.616660 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.617109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.634902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:08.653998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b13ab539-4504-495d-b0e8-5d310cfe9ad8 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1468 microversion: 2.1 time: 0.715376 Aug 24 01:57:08.659618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 896/1834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:07 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1468 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:08.669906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:08.670535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:08.685306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.690730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.691245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.692024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:08.692504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:08.692962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:08.984578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.000932 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6889d31-796d-426a-96ca-26b19eaeddad tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.340173 Aug 24 01:57:09.005049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 897/1835] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:08 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:09.092943 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.108860 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.113548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.117392 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ef40cc25-6ed8-4fcf-9da7-e3b0648dd703 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1798 microversion: 2.32 time: 0.514923 Aug 24 01:57:09.119395 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 939/1836] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:08 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1798 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:09.318892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.319856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:09.336277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.338941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.343100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.344098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.344662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.346708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.516601 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b916cddc0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.520084 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:09.520084 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:09.521589 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.522628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.523257 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.524163 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.524930 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.525772 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.562048 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f4d85786-dc3b-49a6-88e6-be9db6dc1d15 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.236460 Aug 24 01:57:09.563228 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 940/1837] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 01:57:09.575384 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b916cd5e0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.578557 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:09.578557 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:09.580992 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.581656 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.582293 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.583192 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.583814 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.584402 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.615971 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-70766884-67b1-48ef-b9a4-88c0c04edc73 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.044683 Aug 24 01:57:09.618085 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 941/1838] 10.222.0.49 () {58 vars in 1139 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:09.628981 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.630152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:09.640102 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.641242 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.643103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.644010 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.644658 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.645272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.671080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.687748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.691803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.696961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8a009d9-b078-48e1-93a4-2007fc5347ad tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.382176 Aug 24 01:57:09.700597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 898/1839] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:09.712204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b91745820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.720936 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:09.720936 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:09.722444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.725306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.726035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.726948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.727587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.728186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.761730 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3aa83cb-0f01-477d-9c8d-2a54973e13c0 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.059798 Aug 24 01:57:09.763371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 899/1840] 10.222.0.49 () {58 vars in 1145 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:09.770815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.771469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:09.781928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:09.785017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.785765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.786485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.787606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.788064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.788495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.962615 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:09.971181 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-278b2b12-87b3-4854-922c-6086fa801094 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.351776 Aug 24 01:57:09.972187 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 942/1841] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:09.979135 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b9b502790>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:09.982813 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:09.982813 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:09.987861 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.990109 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.991104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:09.993134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:09.994771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:09.995853 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.046320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '665536bfd6424ee3a0afc0fc92572319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340bc32a8aa54ad98abc20aa8d137da2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:10.058291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8394e7d3-8ee7-4d64-abf9-58f817ec9842 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 200 len: 1468 microversion: 2.1 time: 0.293649 Aug 24 01:57:10.079172 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3776638e-1567-4a0c-a4cc-b9bc37192a4b tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.104644 Aug 24 01:57:10.080341 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 943/1842] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:10.084699 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 900/1843] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:09 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 1468 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:10.090197 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:10.090821 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:10.101343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b91853940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:10.105840 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:10.105840 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:10.108348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.109207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.109965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.112100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.113024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.113660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.114368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.116127 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.116450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.118355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.119033 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.121195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.154536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cca72253-c232-4484-ac11-12f274d2dc90 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.057461 Aug 24 01:57:10.162984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 901/1844] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 01:57:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:10.169029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:10.169976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:10.177821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.178553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.179175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.180053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.180697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.181489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.552693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:10.574302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:10.578765 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:10.585430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:10.589357 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ef931a40-0b84-4971-a849-4756f5c5edfd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.507463 Aug 24 01:57:10.593922 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 944/1845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:10 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:10.605229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b916cd9d0>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:10.608670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d3d054b-9cab-46a7-ba90-2cff4dda02f9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1844 microversion: 2.32 time: 0.444203 Aug 24 01:57:10.610597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 902/1846] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:10 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1844 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:10.611068 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:10.611068 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:10.612413 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.612942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.613388 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.616892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18ff70a6-b987-428e-b122-bda5fb9267b3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:10.617039 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.617462 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.617838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.625396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:10.663258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.664700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.666343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.675098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.676329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.677368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.713938 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-af06c1ac-42ef-4159-9578-8483bfa37215 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.118649 Aug 24 01:57:10.715081 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 945/1847] 10.222.0.49 () {58 vars in 1128 bytes} [Wed Aug 24 01:57:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:10.727637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c590b19d-c876-47a0-8261-444f49717dea", "name": "network-vif-deleted", "tag": "d409b8c2-b267-4102-aaaf-a1a5a3ebcd87"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:10.770625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.771379 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.772042 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.792254 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] Creating event network-vif-deleted:d409b8c2-b267-4102-aaaf-a1a5a3ebcd87 for instance c590b19d-c876-47a0-8261-444f49717dea on n-h1-854121-3 Aug 24 01:57:10.805672 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-d3b94abf-36f7-4820-9201-36b941308f5b req-4f0436c1-7507-4bff-9257-c30df9e318e0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089120 Aug 24 01:57:10.811065 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 946/1848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:10.822712 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "54393e22-36ea-466c-a75d-f21b7d4792a8"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:10.853996 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.854754 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.855941 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.878199 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] Creating event network-changed:54393e22-36ea-466c-a75d-f21b7d4792a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:10.894969 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-cad28f25-49c6-40fa-b578-7ecd7fa77257 req-c56a64c0-f43b-46bb-ae1e-7823398a7d97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081598 Aug 24 01:57:10.895829 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 947/1849] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:10.910387 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b9b59a280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:10.914633 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:10.914633 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:10.946260 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:10.958079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:10.960956 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:10.998652 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:11.000536 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:11.001009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:11.072697 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c15ae1c0-1278-4ff9-9d4d-15d72acbd25d tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h1-854121-3" status: 200 len: 991 microversion: 2.1 time: 0.174704 Aug 24 01:57:11.081434 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 948/1850] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 01:57:10 2022] GET /compute/v2.1/os-hosts/n-h1-854121-3 => generated 991 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:11.088887 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:11.091537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:11.105025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:11.110325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:11.110826 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:11.111299 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:11.112009 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:11.112466 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:11.112924 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:11.479281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:11.505616 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:11.511184 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:11.512388 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-353a85ec-33f3-4aad-9dbc-fe56a9441e47 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.429708 Aug 24 01:57:11.513049 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 949/1851] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:11 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:11.539711 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:11.540335 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:11.560373 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:11.561549 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:11.562000 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:11.562725 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:11.563183 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:11.563610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:11.949898 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:11.967511 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-448529b5-e2cb-4ee3-8613-a3ebd7ce100a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.432146 Aug 24 01:57:11.981087 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 950/1852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:11 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:11.986628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:11.987247 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] [instance: c590b19d-c876-47a0-8261-444f49717dea] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:12.002182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.002972 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.003670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.004552 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.005212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.011553 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.031318 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] HTTP exception thrown: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Request method failure captured: Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: request: GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea HTTP/1.1 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 0 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYQDxpUvZpe6FeCUTAuGpLVWHEDah-Tc8TnRGHv39kpWXP9li4doXjaXp_dmq29IBv38_XPCWyLqZLhc6zrhnp0zzlWPSwvdjOfRnAY5ONhWKUzpYihAVKIvtQz-jC-0Lm8Bx1TA34FZvqJZdpnUpLOrR3VDEUG5PQqyWrykgQ5U1IU Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_340bc32a8aa54ad98abc20aa8d137da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: 340bc32a8aa54ad98abc20aa8d137da2 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-MigrationsAdminTest-66988046 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-MigrationsAdminTest-66988046-project Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: 665536bfd6424ee3a0afc0fc92572319 Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-MigrationsAdminTest-66988046-project Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: exception: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'id': 'c590b19d-c876-47a0-8261-444f49717dea'} Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:12.046590 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. Aug 24 01:57:12.052567 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:12.063620 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] Returning 404 to user: Instance c590b19d-c876-47a0-8261-444f49717dea could not be found. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:12.064632 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-bbd893c2-2b9a-47a1-b7a0-b8e1c9974684 tempest-MigrationsAdminTest-66988046 tempest-MigrationsAdminTest-66988046-project] 10.222.0.49 "GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea" status: 404 len: 111 microversion: 2.1 time: 0.082417 Aug 24 01:57:12.065246 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 951/1853] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:11 2022] GET /compute/v2.1/servers/c590b19d-c876-47a0-8261-444f49717dea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:12.070105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Calling method '.version_select at 0x7f6b9b527820>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:12.071355 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:12.071355 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:12.103236 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.104130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.104793 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.123875 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.124691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.125369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.183138 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3038a483-6e40-41ca-b285-cb0939386036 tempest-HostsAdminTestJSON-577918816 tempest-HostsAdminTestJSON-577918816-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hosts/n-h2-854121-3" status: 200 len: 729 microversion: 2.1 time: 0.116795 Aug 24 01:57:12.189924 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 952/1854] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 01:57:12 2022] GET /compute/v2.1/os-hosts/n-h2-854121-3 => generated 729 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:12.198858 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:12.199884 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:12.207281 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.208532 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.209173 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.210625 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.211254 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.211845 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.493195 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:12.507170 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-64698c53-1701-44f3-b579-bee133a4f473 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.315814 Aug 24 01:57:12.507960 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 953/1855] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:12 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:12.527492 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:12.532230 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:12.543545 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.544040 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.544469 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.550822 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.551612 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.553225 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.952838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:12.962457 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:12.963995 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:12.965166 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-59211338-f981-4da1-b768-5f368314170d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.455692 Aug 24 01:57:12.965718 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 954/1856] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:12 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:12.975249 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:12.976869 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:12.986511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.987090 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.987726 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:12.988441 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:12.988925 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:12.989416 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.141755 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:13.151347 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:13.152885 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:13.154206 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-efb73385-861a-45c7-907f-2293388d4d1d tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1290 microversion: 2.25 time: 0.187385 Aug 24 01:57:13.154765 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 955/1857] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:12 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1290 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:13.170094 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958ebf3c-bb2f-4596-bc40-d6335ff442ba", "tag": "dbf46218-c5fa-486c-82fc-55873c34223e"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:13.181196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.182021 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.182569 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.195124 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] Creating event network-changed:dbf46218-c5fa-486c-82fc-55873c34223e for instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba on n-h2-854121-3 Aug 24 01:57:13.200547 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-5bfeda11-9368-4797-a868-40392f8cdf97 req-2ae6f004-774c-43f2-9612-c46adc403018 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038380 Aug 24 01:57:13.201417 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 956/1858] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:13.210112 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "034ef6c6-396b-407e-948c-b10759a257a8"}, {"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "6b6ab3af-bffd-4035-a651-6a36df9542f8"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:13.220137 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.221452 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.221882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.232648 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Creating event network-changed:034ef6c6-396b-407e-948c-b10759a257a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:13.233174 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] Creating event network-changed:6b6ab3af-bffd-4035-a651-6a36df9542f8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:13.239103 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-a1ef33c4-7a82-4696-94ed-ae708121f0cf req-42d86577-f116-4916-be91-52007d63cc89 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033030 Aug 24 01:57:13.240139 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 957/1859] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:13.245513 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:13.246213 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:13.252942 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.253430 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.253863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.254563 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.255012 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.255431 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.645791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:13.658518 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9e6f1d18-77e9-41fc-aac5-9ebd3188ca7a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.416969 Aug 24 01:57:13.666744 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 958/1860] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:13 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:13.684636 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:13.689001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:13.714111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.718296 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.718691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.719756 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:13.719904 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:13.723547 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:13.899700 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:13.914577 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0cdc99d9-6983-4c57-9f58-c75f7d13e694 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.246315 Aug 24 01:57:13.916134 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 959/1861] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:13 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:13.990628 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:13.991357 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:14.002271 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:14.002891 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:14.003610 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:14.004461 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:14.005637 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:14.007727 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:14.019177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:14.310449 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:14.321606 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:14.323733 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:14.325946 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-c43b7757-2821-4a70-87b4-da7e085cc518 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.339433 Aug 24 01:57:14.327465 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 960/1862] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:13 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:14.333909 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:14.334800 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:14.341969 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:14.342848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:14.343504 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:14.344450 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:14.346134 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:14.347047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:14.561341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=22 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:15.234973 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:15.244032 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:15.245945 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:15.247294 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4f31a3ae-4e30-4d49-93d6-105d5df8f4f8 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1278 microversion: 2.25 time: 0.918581 Aug 24 01:57:15.248025 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 961/1863] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:14 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1278 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:15.255911 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:15.256805 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:15.277539 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:15.278329 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:15.278935 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:15.279842 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:15.280454 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:15.280917 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:15.856334 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:15.876557 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-ceb3f22c-76d2-44d9-919f-b54909a36a14 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.627090 Aug 24 01:57:15.893028 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 962/1864] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:15 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:15.898771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:15.899682 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:15.906586 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:15.908325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:15.909698 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:15.910691 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:15.911424 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:15.912298 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:16.528309 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:16.538331 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-3387e9b9-cdb3-4d82-8c98-f8c0eae38123 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.643760 Aug 24 01:57:16.538931 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 963/1865] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:15 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:16.568862 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "957de5bb-22b4-440c-a3f5-be84eac0472f"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:16.588471 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:16.588982 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:16.598269 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:16.624740 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] Creating event network-changed:957de5bb-22b4-440c-a3f5-be84eac0472f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:16.640638 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-881ac932-aaa1-4976-aa56-5ccac9f3b956 req-efe902f7-43a8-4ecb-ab52-40f2cfa1011b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083767 Aug 24 01:57:16.642418 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 964/1866] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:16.659984 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:16.663076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:16.687804 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:16.688306 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:16.688771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:16.692455 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:16.695734 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:16.696196 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:17.274524 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.293673 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.296624 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.299268 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-14e0277c-5d5a-401b-a46f-fcb6be679fe8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.651591 Aug 24 01:57:17.305607 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 965/1867] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:16 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:17.318006 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:17.319251 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:17.331922 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:17.335641 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:17.336746 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:17.340567 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:17.341407 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:17.342085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:17.685326 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.694644 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.696144 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.697301 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8496385c-a358-4eb7-a3c5-fb6914a7d968 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1278 microversion: 2.25 time: 0.390364 Aug 24 01:57:17.699006 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 966/1868] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:17 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1278 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:17.706035 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:17.706643 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:17.713305 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:17.713776 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:17.714263 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:17.715211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:17.715867 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:17.716485 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:17.902008 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:17.910565 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7be9f1b5-cdd1-4762-b2a2-87439c68afd7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.210140 Aug 24 01:57:17.923643 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 967/1869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:17 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:18.337323 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-0014da0c-b55a-4ec4-b79f-b043eacbd8c0 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b9b4d2280>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:18.550131 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-0014da0c-b55a-4ec4-b79f-b043eacbd8c0 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a" status: 200 len: 371 microversion: 2.1 time: 0.637005 Aug 24 01:57:18.551023 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 968/1870] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 01:57:17 2022] GET /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a => generated 371 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:18.556167 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:18.557053 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:18.564121 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:18.564686 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:18.565209 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:18.565990 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:18.566511 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:18.566998 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:18.705667 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:18.715620 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-637d3dc3-3ade-47d6-b5bf-9c97523f7a70 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.163285 Aug 24 01:57:18.716200 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 969/1871] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:18 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:18.729101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:18.729101 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:18.730325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:18.731058 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:18.731714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:18.732554 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:18.733037 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:18.733460 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:18.923714 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:18.935287 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:18.937075 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:18.938465 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-f99c8feb-cad0-4a2c-b5b8-6391faa50148 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.220379 Aug 24 01:57:18.939232 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 970/1872] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:18 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:18.992621 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Calling method '.version_select at 0x7f6b9b46de50>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:18.993530 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:18.993530 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:18.994596 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:18.995084 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:18.995518 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.009579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.010062 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.010494 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.021619 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.022111 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.022544 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.029112 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-7b820e50-01d6-45da-b117-34f05e3d54c6 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.088669 Aug 24 01:57:19.029930 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 971/1873] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 01:57:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:19.034882 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9b502700>, body: {"quota_set": {"ram": "5120"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:19.100162 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.101024 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.101633 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.102365 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.102954 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.103383 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.156047 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d85a800c-e0d6-4ed1-b1cb-78c33969deb1 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a" status: 200 len: 328 microversion: 2.1 time: 0.124969 Aug 24 01:57:19.162949 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 972/1874] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:19 2022] PUT /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a => generated 328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:19.162949 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "cf13d730-863e-41c4-a6c7-d3070eaee9b1"}, {"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "efdfe94a-558a-4964-b054-0ee5008b309f"}, {"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "388674f5-75f1-4dad-984e-1a85c9e5ed1c"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:19.172124 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.172604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.173130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.184227 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Creating event network-changed:cf13d730-863e-41c4-a6c7-d3070eaee9b1 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:19.184744 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Creating event network-changed:efdfe94a-558a-4964-b054-0ee5008b309f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:19.185260 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] Creating event network-changed:388674f5-75f1-4dad-984e-1a85c9e5ed1c for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:57:19.190245 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-c3d8e10c-ffe1-4f06-8ef8-82afe3841314 req-a2986add-016f-44c2-9d7f-766f2f0c56ef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.032378 Aug 24 01:57:19.191262 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 973/1875] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:19.196642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.197360 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:19.203966 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.205272 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.205912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.206863 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.207534 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.208211 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.392775 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:19.405684 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:19.407378 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:19.408684 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-981bfa54-4ecb-495e-881c-21df101491c0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1278 microversion: 2.25 time: 0.216353 Aug 24 01:57:19.413157 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 974/1876] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:19 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:19.418919 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.419809 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:19.429025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.429735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.430177 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.430890 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.431735 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.432375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.572848 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:19.581337 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-941b6e48-92f8-413a-8bb0-24b184374847 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.166235 Aug 24 01:57:19.582098 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 975/1877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:19 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:19.593760 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Calling method '.version_select at 0x7f6b9b4e0790>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.595109 n-d-854121-3 devstack@n-api.service[128566]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:19.595109 n-d-854121-3 devstack@n-api.service[128566]: warnings.warn(msg) Aug 24 01:57:19.596630 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.597150 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.597592 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.610001 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.610490 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.611496 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.617701 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-2794b538-6360-4f98-b17d-9c087b80bf67 tempest-HypervisorAdminV228Test-1457724408 tempest-HypervisorAdminV228Test-1457724408-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.027667 Aug 24 01:57:19.618490 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 976/1878] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 01:57:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:19.622642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-548978c9-8d76-4fae-a36a-ad867cf0bbc4 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.640085 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-548978c9-8d76-4fae-a36a-ad867cf0bbc4 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a" status: 202 len: 0 microversion: 2.1 time: 0.020402 Aug 24 01:57:19.641497 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 977/1879] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 01:57:19 2022] DELETE /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:57:19.649079 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ebf3c-bb2f-4596-bc40-d6335ff442ba", "name": "network-vif-plugged", "status": "completed", "tag": "dbf46218-c5fa-486c-82fc-55873c34223e"}]} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:19.661343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.662277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.662277 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.673037 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.compute.server_external_events [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] Creating event network-vif-plugged:dbf46218-c5fa-486c-82fc-55873c34223e for instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba on n-h2-854121-3 Aug 24 01:57:19.678885 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [req-3e56ded2-47ec-4da2-a1dc-01e9abbe01b8 req-524d526d-8229-4111-8b57-83fa0a7b8e49 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035894 Aug 24 01:57:19.679802 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 978/1880] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:19.684839 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-9b011712-1b49-4a00-9537-4ba136548729 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b916cdd30>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.793980 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-9b011712-1b49-4a00-9537-4ba136548729 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a" status: 200 len: 371 microversion: 2.1 time: 0.112215 Aug 24 01:57:19.795784 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 979/1881] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 01:57:19 2022] GET /compute/v2.1/os-quota-sets/c86e6532f506439eab43078e9fc2262a => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:19.803912 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:19.805025 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:19.821076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.822047 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.822650 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:19.823670 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:19.824527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:19.828566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.070426 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.079517 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a5bfcf0f-7e47-4d99-810c-49b87b94bd4f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.282183 Aug 24 01:57:20.080113 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 980/1882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:19 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:20.085076 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:20.085702 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:20.096498 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.096498 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.097235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.098139 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.098791 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.099206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.125130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:20.311543 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.325915 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.327479 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.328939 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-4f9b323a-37c8-481e-91a6-9e4a1735ee1d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.247748 Aug 24 01:57:20.346269 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 981/1883] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:20 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:20.351627 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-46e173c9-f4b1-4f85-bd78-87a17e4ef0bf tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b9b4e0790>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:20.547153 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-46e173c9-f4b1-4f85-bd78-87a17e4ef0bf tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795/defaults" status: 200 len: 371 microversion: 2.1 time: 0.199901 Aug 24 01:57:20.553264 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 982/1884] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 01:57:20 2022] GET /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795/defaults => generated 371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:20.553264 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:20.553771 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:20.572635 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.573103 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.573540 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.574273 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.576355 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.576810 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.656988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:20.781566 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.785548 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_cell1:SELECT=100 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:20.791985 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.793928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.795978 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d4c40214-b523-41f2-88ec-1ae3ae47f9b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1278 microversion: 2.25 time: 0.246457 Aug 24 01:57:20.797629 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 983/1885] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:20 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:20.803647 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:20.804556 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:20.812206 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.816470 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.817212 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.818013 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:20.818662 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:20.819390 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:20.966487 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:20.975308 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-d168f81d-eb9c-492c-acf9-e4eb8fdf4d3b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1316 microversion: 2.1 time: 0.175784 Aug 24 01:57:20.975918 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 984/1886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:20 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:20.980351 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9b527550>, body: {"quota_set": {"ram": "5120"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:21.208375 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.209021 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.209837 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.210187 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.210642 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.211063 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.242677 n-d-854121-3 devstack@n-api.service[128566]: DEBUG dbcounter [-] [128566] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=128566) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:21.275126 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-8a10c5ed-9bf3-4156-aa44-24e0485e7a7e tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54" status: 200 len: 328 microversion: 2.1 time: 0.298147 Aug 24 01:57:21.275767 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 985/1887] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:20 2022] PUT /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54 => generated 328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:21.281182 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:21.282085 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:21.288604 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.289219 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.289732 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.290508 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.291038 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.291537 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.548054 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:21.557685 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-903e729f-e033-45ce-aefa-73438ef2260e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.280586 Aug 24 01:57:21.558259 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 986/1888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:21 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:21.563749 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b9b527160>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:21.664294 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.665285 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.666278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.668293 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.669105 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.670495 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.696063 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-fb65a628-cbba-476a-9014-61a1566ed25b tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54/detail" status: 200 len: 916 microversion: 2.1 time: 0.136202 Aug 24 01:57:21.698479 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 987/1889] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:57:21 2022] GET /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54/detail => generated 916 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:21.704034 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:21.704928 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:21.714439 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.715061 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.715580 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.716573 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:21.717146 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:21.718325 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:21.980758 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:21.991742 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:21.993527 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:21.994731 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-a58918da-f860-486c-bbb1-e1794b501821 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.295050 Aug 24 01:57:22.008797 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 988/1890] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:21 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:22.008797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:22.008797 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:22.011152 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.011913 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.012783 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.014368 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.015369 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.015986 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.174798 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:22.188235 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:22.191723 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:22.194659 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-aeb18826-2758-4d47-8fd2-e041eecc6ad4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1278 microversion: 2.25 time: 0.196992 Aug 24 01:57:22.195964 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 989/1891] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:21 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:22.204609 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:22.206234 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:22.213316 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.214156 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.215130 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.219587 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.227100 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.228697 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.433579 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.policy [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128566) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:22.443654 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-aeb0ad42-76d5-49b4-ac68-75e4b7230b20 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1465 microversion: 2.1 time: 0.245950 Aug 24 01:57:22.445176 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 990/1892] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:22 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1465 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:22.450229 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Action: 'update', calling method: .version_select at 0x7f6b916cd9d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:22.518472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4b40da9-02b1-46c6-9cec-5d4dd79721ed tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.905882 Aug 24 01:57:22.519877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 903/1893] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 01:57:10 2022] POST /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511/os-volume_attachments => generated 194 bytes in 11908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:22.725028 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.726278 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.727657 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.728500 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.729507 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.731245 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.813343 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.814188 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.816464 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.817519 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.819564 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.820239 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.836617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:22.837325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:22.859952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.860382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.864736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.865507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:22.865982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:22.866419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:22.925555 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-40d735d3-beea-4fe3-93f4-9cd5c390dc67 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54?user_id=0fe4ae8dc04d4591aefbfb3900d31b13" status: 200 len: 328 microversion: 2.1 time: 0.478789 Aug 24 01:57:22.927490 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 991/1894] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 01:57:22 2022] PUT /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54?user_id=0fe4ae8dc04d4591aefbfb3900d31b13 => generated 328 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:22.933104 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b540a437-96b8-4075-ac6b-0aaa4e0c0fa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304575133", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c332929b-ee81-4ae3-bfaf-e9455b2f8e34", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:23.686238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a619bce-5b7b-4a9f-8e24-7084624f7851 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1616 microversion: 2.1 time: 1.165135 Aug 24 01:57:23.708579 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 904/1895] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:22 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1616 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:23.718805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:23.719749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:23.733489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:23.733999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:23.734446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:23.735164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:23.741354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:23.742429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:23.948392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:23.950788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:23.958770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ab61a89-1120-4985-8b0e-1ebd71510b3d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.248775 Aug 24 01:57:23.959338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 905/1896] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:23 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:23.963671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0eac01fe-54d6-48f4-8b0f-9f0c9efe2ceb tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b917bf790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:24.189786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0eac01fe-54d6-48f4-8b0f-9f0c9efe2ceb tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54?user_id=0fe4ae8dc04d4591aefbfb3900d31b13" status: 200 len: 370 microversion: 2.1 time: 0.229323 Aug 24 01:57:24.190517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 906/1897] 10.222.0.49 () {58 vars in 1323 bytes} [Wed Aug 24 01:57:23 2022] GET /compute/v2.1/os-quota-sets/87e72e6ed3424b739a7a65d264427c54?user_id=0fe4ae8dc04d4591aefbfb3900d31b13 => generated 370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:24.203575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:24.205053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:24.214971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:24.215458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:24.215889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:24.216584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:24.217103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:24.217521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:24.306459 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.wsgi [None req-b540a437-96b8-4075-ac6b-0aaa4e0c0fa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b540a437-96b8-4075-ac6b-0aaa4e0c0fa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Accept: application/json Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Accept-Encoding: identity Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Connection: close Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Content-Length: 357 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Content-Type: application/json Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Host: 10.222.0.49 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Openstack-System-Scope: None Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Id: None Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Domain-Name: None Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Identity-Status: Confirmed Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Is-Admin-Project: True Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Id: default Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Domain-Name: Default Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Role: reader,member Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Roles: reader,member Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Id: default Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-User-Domain-Name: Default Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-304575133", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c332929b-ee81-4ae3-bfaf-e9455b2f8e34", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: method: > Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: exception: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-304575133', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c332929b-ee81-4ae3-bfaf-e9455b2f8e34'}], 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:24.318346 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. Aug 24 01:57:24.322903 n-d-854121-3 devstack@n-api.service[128566]: ERROR nova.api.openstack.wsgi Aug 24 01:57:24.327181 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-b540a437-96b8-4075-ac6b-0aaa4e0c0fa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Block Device c332929b-ee81-4ae3-bfaf-e9455b2f8e34 is not bootable. {{(pid=128566) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:24.328279 n-d-854121-3 devstack@n-api.service[128566]: INFO nova.api.openstack.requestlog [None req-b540a437-96b8-4075-ac6b-0aaa4e0c0fa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 1.399446 Aug 24 01:57:24.333199 n-d-854121-3 devstack@n-api.service[128566]: [pid: 128566|app: 0|req: 992/1898] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 1405 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:24.338903 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.api.openstack.wsgi [None req-d87aecdd-98e0-43e9-9c89-38ca31af6e24 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128566) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:24.339838 n-d-854121-3 devstack@n-api.service[128566]: DEBUG nova.compute.api [None req-d87aecdd-98e0-43e9-9c89-38ca31af6e24 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128566) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:24.350125 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d87aecdd-98e0-43e9-9c89-38ca31af6e24 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:24.351099 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d87aecdd-98e0-43e9-9c89-38ca31af6e24 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:24.352478 n-d-854121-3 devstack@n-api.service[128566]: DEBUG oslo_concurrency.lockutils [None req-d87aecdd-98e0-43e9-9c89-38ca31af6e24 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128566) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:24.374251 n-d-854121-3 devstack@n-api.service[128566]: Traceback (most recent call last): Aug 24 01:57:24.374521 n-d-854121-3 devstack@n-api.service[128566]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Aug 24 01:57:24.374521 n-d-854121-3 devstack@n-api.service[128566]: timer() Aug 24 01:57:24.374934 n-d-854121-3 devstack@n-api.service[128566]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Aug 24 01:57:24.374934 n-d-854121-3 devstack@n-api.service[128566]: cb(*args, **kw) Aug 24 01:57:24.375290 n-d-854121-3 devstack@n-api.service[128566]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Aug 24 01:57:24.375290 n-d-854121-3 devstack@n-api.service[128566]: waiter.switch() Aug 24 01:57:24.375556 n-d-854121-3 devstack@n-api.service[128566]: greenlet.error: cannot switch to a different thread Aug 24 01:57:24.557778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:24.575448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:24.577461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:24.578838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06a6f1a2-a9cc-4f6f-ad53-514d79219e84 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.380136 Aug 24 01:57:24.580752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 907/1899] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:24 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:24.585449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: .version_select at 0x7f6b918be0d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-703860726", "policies": ["affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:24.604071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:24.608330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:24.667370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:24.673340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:24.685238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffc2c14b-c429-4739-98e9-a843c1cf4b52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.103261 Aug 24 01:57:24.686161 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 908/1900] 10.222.0.49 () {60 vars in 1174 bytes} [Wed Aug 24 01:57:24 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:25.006333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Calling method '.version_select at 0x7f6b9202fb80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:25.009276 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:25.009276 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:25.010454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.010951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.011396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.027100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.027851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.028467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.076260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.077058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.077677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.089191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.089950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.091214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.120475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.121269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.121889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.129868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2109653-a137-42e2-a458-e796e84fae68 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2467 microversion: 2.53 time: 0.442417 Aug 24 01:57:25.131071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 909/1901] 10.222.0.49 () {60 vars in 1243 bytes} [Wed Aug 24 01:57:24 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2467 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:25.136396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:25.137460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:25.144046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.144914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.145532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.146434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.147068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.147694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.338179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:25.348023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aca44155-85e7-49db-a9fc-a336a3c0d089 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.215732 Aug 24 01:57:25.358321 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 910/1902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:25 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:25.366803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8dc7b26-56d7-48fa-acdd-bbb038ce57c5 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Calling method '.version_select at 0x7f6b91869550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:25.511790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8dc7b26-56d7-48fa-acdd-bbb038ce57c5 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795/defaults" status: 200 len: 371 microversion: 2.1 time: 0.152383 Aug 24 01:57:25.512493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 911/1903] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 01:57:25 2022] GET /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795/defaults => generated 371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:25.517299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1043363280", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "12f429fa-dce0-4352-92d6-c30e4ec1277b"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:25.587519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:25.809881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:25.810543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:25.811755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:25.812187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:25.812666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:25.839907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.840393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.840870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.841602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:25.842695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:25.843129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:25.862146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:25.866441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:25.879135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 2 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:25.881575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:25.918572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128567) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 24 01:57:25.938136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:25.942824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:25.989913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:25.993756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:26.006849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:26.041719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:26.059576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:26.063832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:26.098090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:26.102095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:26.136030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9d285f3-bfa3-405d-8dfa-f662116f1eec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.622298 Aug 24 01:57:26.139547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 912/1904] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 01:57:26.141607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:26.142203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:26.148413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.148935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.149369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.150065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.150514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.150933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.289495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:26.300123 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb6bd036-ae3d-437a-b544-329d4f405098 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.161982 Aug 24 01:57:26.300780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 913/1905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:26 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:26.306511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Calling method '.version_select at 0x7f6b92ac2820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:26.309354 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:26.309354 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:26.310865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.311511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.312379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.327707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.328186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.328705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.362905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.363717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.363844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.375208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.375692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.376158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.405849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.406438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.406937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.413981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55a7ef1c-544a-4c62-b033-860d39548912 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1160 microversion: 2.53 time: 0.111930 Aug 24 01:57:26.414831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 914/1906] 10.222.0.49 () {60 vars in 1222 bytes} [Wed Aug 24 01:57:26 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1160 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:26.419419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:26.420075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:26.426999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.427763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.428010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.428704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.429247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.429686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.569778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:26.577770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ee6e44c-1633-41d4-8765-0c320972f705 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.162079 Aug 24 01:57:26.578346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 915/1907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:26 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:26.583533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9183b160>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:26.653869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.654357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.654797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.655681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.656155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.656588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.887552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0fb778e-d0eb-4511-b40e-c6b98d37249f tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795" status: 200 len: 329 microversion: 2.1 time: 0.307902 Aug 24 01:57:26.888488 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 916/1908] 10.222.0.49 () {60 vars in 1263 bytes} [Wed Aug 24 01:57:26 2022] PUT /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795 => generated 329 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:26.899037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:26.899705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:26.907330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.907952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.908464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:26.909363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:26.909893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:26.910316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.126598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:27.137170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:27.138641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:27.139819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5e0fd4e-9640-4e0f-9682-ebfe1b74dcae tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.249753 Aug 24 01:57:27.140394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 917/1909] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:26 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:27.169856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3effb318-d8d0-4d2c-80e1-18f95a4a9151", "name": "network-vif-plugged", "status": "completed", "tag": "8a5a216a-6187-4d02-9bea-0ba1be5be92a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:27.189990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.190477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.190915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.213372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] Creating event network-vif-plugged:8a5a216a-6187-4d02-9bea-0ba1be5be92a for instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 on n-h1-854121-3 Aug 24 01:57:27.218990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-66f4fa0a-bd41-4696-9a0b-1ba0f8e63aa6 req-c191ca18-82e9-4cd9-8583-51401b17d373 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066539 Aug 24 01:57:27.220391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 918/1910] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:27.227415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:27.243379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:27.251894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Searching by: {'deleted': False, 'project_id': 'd75231c930634323908998c748d5e4dd'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:57:27.263282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.263867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.264565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.265402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.266092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.267242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.296020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:57:27.337384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09dab52a-b618-4bcf-8390-936b90602a7b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.115198 Aug 24 01:57:27.344243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 919/1911] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 01:57:27 2022] GET /compute/v2.1/servers => generated 1003 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:27.344243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Calling method '.version_select at 0x7f6b91745430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:27.346840 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:27.346840 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:27.348142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.348629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.351085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.368997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.369776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.370369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.378934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fdb2da0-395a-466f-8218-fcce48d97203 tempest-HypervisorAdminV253TestBase-979317436 tempest-HypervisorAdminV253TestBase-979317436-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/38ce6b84-dc05-46d1-acb4-a77a529c2875" status: 200 len: 791 microversion: 2.53 time: 0.038686 Aug 24 01:57:27.380136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 920/1912] 10.222.0.49 () {60 vars in 1298 bytes} [Wed Aug 24 01:57:27 2022] GET /compute/v2.1/os-hypervisors/38ce6b84-dc05-46d1-acb4-a77a529c2875 => generated 791 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:57:27.385230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9183b310>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:27.503625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.504190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.504698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.505536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.506065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.506557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.577197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=17,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:27.804220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:27.834499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb8e4566-e4c4-43d3-9d7a-6b86f8de3d63 tempest-QuotasAdminTestJSON-325482742 tempest-QuotasAdminTestJSON-325482742-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795" status: 200 len: 329 microversion: 2.1 time: 0.453051 Aug 24 01:57:27.842162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 921/1913] 10.222.0.49 () {60 vars in 1263 bytes} [Wed Aug 24 01:57:27 2022] PUT /compute/v2.1/os-quota-sets/d579a29b0ab347cb9849d76c5f4a9795 => generated 329 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:27.846873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:27.847618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:27.854885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.855386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.855829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:27.856573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:27.857073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:27.857518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:28.039350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:28.053966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab43756c-95ae-4642-b1d2-f11b772cb795 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.217794 Aug 24 01:57:28.055485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 922/1914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:27 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:28.062288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:28.063208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:28.071720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:28.072540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:28.073105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:28.073916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:28.074477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:28.075007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:28.159585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:28.170548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-865780f5-7c53-435a-9207-9d1b5f0448ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1271 microversion: 2.1 time: 0.113575 Aug 24 01:57:28.171502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 923/1915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:28 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:28.185171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:28.185874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:28.193122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:28.193894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:28.194753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:28.195578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:28.196091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:28.196574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:28.427478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:28.437914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:28.440238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:28.441510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a1bafb6-6d80-4431-804a-32913fcbc013 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.268479 Aug 24 01:57:28.442070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 924/1916] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:28 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:29.079590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:29.080476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:29.092914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.093728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.094439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:29.096020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.096640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.097608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:29.126526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:29.334014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:29.344313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd5a5a81-4a6c-4d88-b642-363a3f6bb901 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.271605 Aug 24 01:57:29.346374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 925/1917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:29 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:29.352033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:29.353243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:29.375846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.376369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.376903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:29.378523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.379329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.379902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:29.470527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:29.484810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22b7853d-8dcd-4666-9180-8cd2f42d40fb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1271 microversion: 2.1 time: 0.137135 Aug 24 01:57:29.488146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 926/1918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:29 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:29.506024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:29.507261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:29.522708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.523471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.524372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:29.527383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:29.528066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:29.532406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:30.010219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:30.025870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:30.027419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:30.028611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4920394e-0c7a-4922-b0cf-cf85836b5ade tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.538548 Aug 24 01:57:30.050210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 927/1919] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:29 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:30.368190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:30.369192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:30.399138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:30.400052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:30.401889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:30.404293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:30.405240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:30.408477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:30.856257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:30.865675 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1f20152-9187-4c21-8e2b-2bba333f1742 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.501873 Aug 24 01:57:30.866172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 928/1920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:30 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:30.903168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:30.905179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:30.921345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:30.936859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:30.939422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:30.940009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:30.940486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:30.940957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:31.424557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:31.437665 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e827cc0-e173-4c5c-a62f-efaccd3c8cc9 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.542749 Aug 24 01:57:31.439754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 929/1921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:30 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:31.446864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:31.448117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:31.472591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:31.475691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:31.476449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:31.478451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:31.480687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:31.481990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:31.862431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:31.874835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:31.876399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:31.882019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56ae12ce-79aa-424a-9e20-9ae97052475e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.440464 Aug 24 01:57:31.883984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 930/1922] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:31 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:31.903598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "name": "network-vif-unplugged", "status": "completed", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:31.926203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:31.928291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:31.929716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:31.946020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] Creating event network-vif-unplugged:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h1-854121-3 Aug 24 01:57:31.954454 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ace51e31-0fa6-4757-bcfa-43d4b01175ab req-171b98dd-fa84-4cc6-839f-ac7533fcbfb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067609 Aug 24 01:57:31.955642 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 931/1923] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:32.574535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Calling method '.version_select at 0x7f6b916b6b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:32.575466 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:32.575466 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:32.576609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:32.577131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:32.578056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:32.613090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:32.613598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:32.614042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:32.642255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:32.642760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:32.643202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:32.658600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cceb5ad-1bbc-4e7d-9ab7-bb3e5c86f815 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.701514 Aug 24 01:57:32.659202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 932/1924] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:57:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:32.678567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:32.683201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:32.697490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:32.698317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:32.698930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:32.699847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:32.700482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:32.701104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:32.952597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:32.962115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-199b2c3a-c24f-42d6-a040-583e6d2c96cc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.290000 Aug 24 01:57:32.962734 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 933/1925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:32 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:33.062227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1309ba0b-ba98-4793-9e05-024c6bc5dd2e tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Calling method '.version_select at 0x7f6b91767040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:33.168582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1309ba0b-ba98-4793-9e05-024c6bc5dd2e tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 371 microversion: 2.1 time: 0.189068 Aug 24 01:57:33.169591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 934/1926] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 01:57:32 2022] GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:33.176613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:33.178279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:33.185677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:33.186543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:33.187427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:33.188692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:33.189652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:33.190448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:33.520487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:33.533386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5bb2355-3978-48f6-b917-16cd781d534d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.357287 Aug 24 01:57:33.541112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 935/1927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:33 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:33.771838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e213a7df-2897-43ae-83f1-d82ba6075e86 tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Calling method '.version_select at 0x7f6b917bf9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:33.772646 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:33.772646 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:33.773773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e213a7df-2897-43ae-83f1-d82ba6075e86 tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1403702d8f974029961118ae4d8e977a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92233855e71e4f6694cdb9eafc7a05fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e213a7df-2897-43ae-83f1-d82ba6075e86 tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Request method failure captured: Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/n-h1-854121-3/search HTTP/1.1 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWKgAdwn4SzKLCxfToUrssAEH4-7sHBcfP-FCtTYEyUGK4nsIPqIVJ9-9dNLAEgKTrTtO0orPvFgWAnUUsy2ijdRYNv4DgvcZ3-cUPR8QjyYdXZ0AIIc7VQVXGi0ct-m6H-THjneO-kgAMCCFYlXji7WmH_ppgjnkbqfdp7YAMkw9c Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 92233855e71e4f6694cdb9eafc7a05fa Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 92233855e71e4f6694cdb9eafc7a05fa Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-796070856-project Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1403702d8f974029961118ae4d8e977a Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856-project Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'n-h1-854121-3'} Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:33.776071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e213a7df-2897-43ae-83f1-d82ba6075e86 tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:33.782381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e213a7df-2897-43ae-83f1-d82ba6075e86 tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/n-h1-854121-3/search" status: 403 len: 117 microversion: 2.1 time: 0.235477 Aug 24 01:57:33.783453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 936/1928] 10.222.0.49 () {58 vars in 1209 bytes} [Wed Aug 24 01:57:33 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-3/search => generated 117 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:33.788735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:33.789378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:33.798634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:33.799141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:33.799585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:33.800321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:33.800810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:33.801252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.052633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:34.061948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:34.064018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:34.065209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99d27e83-5657-45a5-8f26-bef970c26e94 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1886 microversion: 2.32 time: 0.280847 Aug 24 01:57:34.065768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 937/1929] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:33 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1886 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:34.070723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53", "tag": "646f1064-72d6-4593-995b-825a034bbb1a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:34.081376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.082144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.082796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.094923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] Creating event network-changed:646f1064-72d6-4593-995b-825a034bbb1a for instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 on n-h2-854121-3 Aug 24 01:57:34.099738 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e9d4dbee-0be4-4592-8881-da50b48c6f10 req-02247b1b-3435-41e8-a041-a9070009a617 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Aug 24 01:57:34.100340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 938/1930] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:34.106347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b919001f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:34.175293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.175810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.176454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.177237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.177902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.178338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.234490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=75,nova_api:UPDATE=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:34.238135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f229f1f2-b8f3-4395-b127-a9c2c7abc640 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 328 microversion: 2.1 time: 0.135893 Aug 24 01:57:34.249779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 939/1931] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:34 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:34.255586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Calling method '.version_select at 0x7f6b9177b4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:34.256622 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:34.256622 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:34.257998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.258674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.259302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.266433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Request method failure captured: Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLgAUxqXil-hifMgRYKJkdbRxR7iYJI4URQlang2ypS5zKeMQqExuhN083phFvKPEnQN9w9RLsSyEmUEtqFK2vq6uiNVLAuulAmBdiIGGzhv9gbErbnFsmJiQ93anoSzUhfGpgD4QXMFyiPi2Mul8ol7rwIdUMxzzXHTIuBpZJsBk Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 910cb88a4e914bf9b5c99e406d8a44bf Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 910cb88a4e914bf9b5c99e406d8a44bf Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f424c76665024ec7901b6ee3aa725569 Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 24 01:57:34.269334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:34.275892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:34.276976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fcf23275-c04a-4e67-9364-39a1915537e4 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025708 Aug 24 01:57:34.278339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 940/1932] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 01:57:34 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:34.285650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}, {"name": "network-changed", "server_uuid": "3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad", "tag": "e67c4267-ad7a-455d-a020-b89842be4979"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:34.298980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.299661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.300270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.313266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Creating event network-changed:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h1-854121-3 Aug 24 01:57:34.313782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] Creating event network-changed:e67c4267-ad7a-455d-a020-b89842be4979 for instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad on n-h2-854121-3 Aug 24 01:57:34.322923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a123a195-33be-42b0-9b69-4e77a677556f req-8b72a429-a3ba-4015-b69d-051ebab5f599 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043037 Aug 24 01:57:34.323889 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 941/1933] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:34.329532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:34.330236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:34.337358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.337885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.338327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.339036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.339493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.339921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.590100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:34.600263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3765c3f-7dce-4133-8be5-509157d82815 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.275096 Aug 24 01:57:34.601177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 942/1934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:34 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:34.606015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Calling method '.version_select at 0x7f6b917bf4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:34.607115 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:34.607115 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:34.608452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.609184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.609812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.627082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.627843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.628557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.644181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:34.644976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:34.645792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:34.652931 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b62a6f63-4008-46ba-ae84-221184695aed tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050310 Aug 24 01:57:34.653738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 943/1935] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 01:57:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:34.715531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2121693007", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:34.801755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:35.108545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:35.108999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:35.109471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:35.109912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:35.110352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:35.120253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.121881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.122333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.123794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.124258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.124679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.144014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:35.148694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for user a85308f636d5482da1a8bb3682af2490 and project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:35.160016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.utils [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] cores quota exceeded for 1543201242714e73975fac0624348325, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 01:57:35.160813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Request method failure captured: Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 145 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLh-EeaG-FG-1d4QKPN4nroW0YGKTgapWg_OK-0hK0VLjfDIRPKt00F-yiFvnhTj-lavO0jaIhY7JccJt-PbecsNFY6BXL-XgA2et6KUtnH1jc0MoNZAFu6bHHQ4CnBeKFhbhypbLNqviCjVMpo1xmHwv2l_Ezds6Aj2_rFEfF_3I Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1543201242714e73975fac0624348325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1543201242714e73975fac0624348325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a85308f636d5482da1a8bb3682af2490 Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2121693007", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2121693007', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452'}}} Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:35.164373 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 24 01:57:35.169800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.173372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:35.174235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ec8b2a7-0138-43ba-a8d0-a47bc3679cd5 tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.519444 Aug 24 01:57:35.175134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 944/1936] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 521 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:35.182098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.182719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:35.189451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.189926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.190358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.191039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.191495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.191916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.331744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.339402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a2a4684-829b-4bfc-9a28-0782823e60a3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.163276 Aug 24 01:57:35.340156 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 945/1937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:35.344561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eddd83be-bf80-473e-b86f-2aa05d6a2cbf tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Calling method '.version_select at 0x7f6b917603a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.345396 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:35.345396 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:35.346461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eddd83be-bf80-473e-b86f-2aa05d6a2cbf tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1403702d8f974029961118ae4d8e977a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92233855e71e4f6694cdb9eafc7a05fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eddd83be-bf80-473e-b86f-2aa05d6a2cbf tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Request method failure captured: Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWKgAdwn4SzKLCxfToUrssAEH4-7sHBcfP-FCtTYEyUGK4nsIPqIVJ9-9dNLAEgKTrTtO0orPvFgWAnUUsy2ijdRYNv4DgvcZ3-cUPR8QjyYdXZ0AIIc7VQVXGi0ct-m6H-THjneO-kgAMCCFYlXji7WmH_ppgjnkbqfdp7YAMkw9c Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 92233855e71e4f6694cdb9eafc7a05fa Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92233855e71e4f6694cdb9eafc7a05fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 92233855e71e4f6694cdb9eafc7a05fa Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856 Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-796070856-project Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1403702d8f974029961118ae4d8e977a Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-796070856-project Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1'} Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.347987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eddd83be-bf80-473e-b86f-2aa05d6a2cbf tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eddd83be-bf80-473e-b86f-2aa05d6a2cbf tempest-HypervisorAdminNegativeUnderV252Test-796070856 tempest-HypervisorAdminNegativeUnderV252Test-796070856-project] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.008333 Aug 24 01:57:35.353230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 946/1938] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:35.354475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-686c2792-6ecd-485c-9645-fea40362185b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494497454", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "71c852a4-8aa1-4649-8920-fa03a58666b5", "destination_type": "local"}, {"source_type": "volume", "uuid": "05dbf2bc-2318-438d-970e-840cebe65a22", "destination_type": "invalid"}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-686c2792-6ecd-485c-9645-fea40362185b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 495 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494497454", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "71c852a4-8aa1-4649-8920-fa03a58666b5", "destination_type": "local"}, {"source_type": "volume", "uuid": "05dbf2bc-2318-438d-970e-840cebe65a22", "destination_type": "invalid"}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1494497454', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '05dbf2bc-2318-438d-970e-840cebe65a22', 'destination_type': 'invalid'}], 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'invalid' Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:35.358689 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-686c2792-6ecd-485c-9645-fea40362185b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-686c2792-6ecd-485c-9645-fea40362185b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009246 Aug 24 01:57:35.364426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 947/1939] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:35.366586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.366586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:35.372490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.373000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.373433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.374118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.374564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.374984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.556054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.566249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.567741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.569163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f4e940e-29e8-43f9-af58-f5e4811d0a6f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.207066 Aug 24 01:57:35.569779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 948/1940] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:35.574110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9251ef70>, body: {"quota_set": {"cores": 20}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:35.635205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.635684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.636158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.636933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.637395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.637825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.691522 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98d66691-1ecc-4ce2-85e0-479d02dff657 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 329 microversion: 2.1 time: 0.120710 Aug 24 01:57:35.692107 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 949/1941] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:35 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:35.696739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Calling method '.version_select at 0x7f6b91900790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.697669 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:35.697669 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:35.698703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.699431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.699626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.708383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] HTTP exception thrown: No hypervisor matching '5a00b280-c92d-4f6b-afdc-b940803d51e5' could be found. Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Request method failure captured: Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-hypervisors/5a00b280-c92d-4f6b-afdc-b940803d51e5/servers HTTP/1.1 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLgAUxqXil-hifMgRYKJkdbRxR7iYJI4URQlang2ypS5zKeMQqExuhN083phFvKPEnQN9w9RLsSyEmUEtqFK2vq6uiNVLAuulAmBdiIGGzhv9gbErbnFsmJiQ93anoSzUhfGpgD4QXMFyiPi2Mul8ol7rwIdUMxzzXHTIuBpZJsBk Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 910cb88a4e914bf9b5c99e406d8a44bf Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_910cb88a4e914bf9b5c99e406d8a44bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 910cb88a4e914bf9b5c99e406d8a44bf Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f424c76665024ec7901b6ee3aa725569 Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: exception: No hypervisor matching '5a00b280-c92d-4f6b-afdc-b940803d51e5' could be found. Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5a00b280-c92d-4f6b-afdc-b940803d51e5'} Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5a00b280-c92d-4f6b-afdc-b940803d51e5' could be found. Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5a00b280-c92d-4f6b-afdc-b940803d51e5' could be found. Aug 24 01:57:35.709757 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:35.714272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] Returning 404 to user: No hypervisor matching '5a00b280-c92d-4f6b-afdc-b940803d51e5' could be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:35.714272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-42261bdc-753e-49bc-a12a-0b114c5bc590 tempest-HypervisorAdminNegativeUnderV252Test-1758381498 tempest-HypervisorAdminNegativeUnderV252Test-1758381498-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors/5a00b280-c92d-4f6b-afdc-b940803d51e5/servers" status: 404 len: 123 microversion: 2.1 time: 0.018091 Aug 24 01:57:35.714272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 950/1942] 10.222.0.49 () {58 vars in 1281 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/os-hypervisors/5a00b280-c92d-4f6b-afdc-b940803d51e5/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:35.715981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.716594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:35.723166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.723654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.724126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.724856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.725319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.725748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.741411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:35.859078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:35.871934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3696dd4-eb5a-4b38-8677-f043a2b214bb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.159336 Aug 24 01:57:35.872547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 951/1943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:35.877482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:35.878073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:35.883964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.884695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.885226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:35.885927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:35.886388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:35.886812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.023192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:36.031588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d673dbe-f9ae-4b14-849a-fd403c717496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.157880 Aug 24 01:57:36.032757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 952/1944] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:35 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:36.037304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a349a52c-879c-40c4-970d-12ee10bdcb2a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Calling method '.version_select at 0x7f6b92659ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:36.229216 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a349a52c-879c-40c4-970d-12ee10bdcb2a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 371 microversion: 2.1 time: 0.195190 Aug 24 01:57:36.229811 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 953/1945] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 01:57:36 2022] GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:36.235063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:36.235953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:36.244797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.245647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.247141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.247825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.248288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.248741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.397235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:36.406202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d87d5dfa-f742-4862-977f-62baad397787 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.174994 Aug 24 01:57:36.407500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 954/1946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:36.413519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9251e9d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:36.710098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.711160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.711666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.712582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.713241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.713721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.774568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce786908-37eb-4104-a06d-c4bed2e3be17 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 328 microversion: 2.1 time: 0.364348 Aug 24 01:57:36.775513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 955/1947] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:36 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 328 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:36.793020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:36.793717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:36.801185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.801680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.802117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.802856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:36.803319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:36.803753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:36.991490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:36.999840 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a17cd87-5674-4b01-958a-58dfbf59c084 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.222671 Aug 24 01:57:37.000427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 956/1948] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:36 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:37.005248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4f8f1c1-c395-4dc7-8b86-5a9e791ca284 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-210055534", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4f8f1c1-c395-4dc7-8b86-5a9e791ca284 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 491 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-210055534", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-210055534', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.009399 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 24 01:57:37.013408 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.017471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4f8f1c1-c395-4dc7-8b86-5a9e791ca284 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:37.018381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4f8f1c1-c395-4dc7-8b86-5a9e791ca284 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016956 Aug 24 01:57:37.019016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 957/1949] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:37 2022] POST /compute/v2.1/servers => generated 624 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:37.024370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:37.025011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:37.031836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.032865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.033305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.034007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.034466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.034891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.221790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:37.231689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:37.233236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:37.234614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-000b8f9b-dcf3-413e-8ebf-7a3ca807cc4c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.214434 Aug 24 01:57:37.235378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 958/1950] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:37 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:37.254930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1936610051", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:37.306414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:37.503938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:37.504387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:37.504920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:37.505333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:37.505747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:37.515500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.515989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.517016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.517746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.518210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.518639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.535434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:37.540396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for user a85308f636d5482da1a8bb3682af2490 and project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:37.551207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.utils [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] instances quota exceeded for 1543201242714e73975fac0624348325, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 01:57:37.551753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Request method failure captured: Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 145 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLh-EeaG-FG-1d4QKPN4nroW0YGKTgapWg_OK-0hK0VLjfDIRPKt00F-yiFvnhTj-lavO0jaIhY7JccJt-PbecsNFY6BXL-XgA2et6KUtnH1jc0MoNZAFu6bHHQ4CnBeKFhbhypbLNqviCjVMpo1xmHwv2l_Ezds6Aj2_rFEfF_3I Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1543201242714e73975fac0624348325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1543201242714e73975fac0624348325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a85308f636d5482da1a8bb3682af2490 Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1936610051", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1936610051', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452'}}} Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:37.553734 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d87c67fe-0d7c-4637-98aa-d558fb413f1a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.318649 Aug 24 01:57:37.559661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 959/1951] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:37 2022] POST /compute/v2.1/servers => generated 119 bytes in 320 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:37.564256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:37.564256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:37.569908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.570388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.570820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.571508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.571954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.572377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.710963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:37.718933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-722d0de7-9c3c-493d-9ab8-a2a29cedf887 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.162326 Aug 24 01:57:37.719817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 960/1952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:37 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:37.724245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:37.724996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:37.730796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.731293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.732288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.732455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:37.732956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:37.734698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:37.866821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:37.875102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae6350f9-e53b-4593-b9a2-6357d47c0fb1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.154341 Aug 24 01:57:37.876303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 961/1953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:37 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:37.880584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b925ae3a0>, body: {"quota_set": {"instances": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:38.127360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.128053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.128277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.129080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.129541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.129970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.184097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:38.187361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37bab0b5-8bcc-4710-9d92-71c0868c023d tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 329 microversion: 2.1 time: 0.309869 Aug 24 01:57:38.187985 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 962/1954] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:37 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:38.193221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:38.194423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:38.201744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.202236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.202824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.203690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.204154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.204584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.345219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:38.353869 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b15403eb-c8da-43cb-81a2-190226bc5aec tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.164851 Aug 24 01:57:38.354521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 963/1955] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:38 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:38.358994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:38.359943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:38.365745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.366288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.367051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.367821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.368340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.368851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.500551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:38.508543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb15b48b-e363-4749-995e-61db5569c752 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.152989 Aug 24 01:57:38.509137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 964/1956] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:38 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:38.519395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c869dee-3f6d-4c0e-893d-de07eb7e3d96 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Calling method '.version_select at 0x7f6b9262e9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:38.684558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c869dee-3f6d-4c0e-893d-de07eb7e3d96 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 371 microversion: 2.1 time: 0.174394 Aug 24 01:57:38.685176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 965/1957] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 01:57:38 2022] GET /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:38.689673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:38.690286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:38.696116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.696594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.697053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.697733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:38.698184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:38.698599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:38.886295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:38.896735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:38.898238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:38.899382 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-505b5ee3-84b0-4603-b9b0-aa0b27e4d22d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.213303 Aug 24 01:57:38.899938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 966/1958] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:38 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:38.962592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccdf036c-55d6-4ff6-990f-a5346fded5e6 tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] Calling method '.version_select at 0x7f6b91900af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:38.963405 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:38.963405 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:38.975290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccdf036c-55d6-4ff6-990f-a5346fded5e6 tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.074359 Aug 24 01:57:38.975953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 967/1959] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:57:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:38.980575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-561febd0-ac4b-43ad-8838-a59930170134 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-561febd0-ac4b-43ad-8838-a59930170134 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 416 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.984454 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-561febd0-ac4b-43ad-8838-a59930170134 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-561febd0-ac4b-43ad-8838-a59930170134 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009020 Aug 24 01:57:38.989084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 968/1960] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:38 2022] POST /compute/v2.1/servers => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:38.992410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b9183baf0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:39.052493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.053084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.053593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.054397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.054920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.055412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.103709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db3ef5ee-2969-4429-a677-a6df897d566a tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 325 microversion: 2.1 time: 0.116007 Aug 24 01:57:39.115660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 969/1961] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:38 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 325 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:39.119861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:39.120473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:39.127587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.128973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.129417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.130121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.130582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.131012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.263789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:39.272469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5ebf588-8557-4ea1-b706-ba0462d02ee4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.167103 Aug 24 01:57:39.273175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 970/1962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:39 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:39.277799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-996412ba-5013-4a4b-a98d-996b7c8a9833 tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] Action: 'update', calling method: .version_select at 0x7f6b91745430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:39.281087 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:39.281087 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:39.483214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=90,nova_cell0:UPDATE=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:39.597756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-996412ba-5013-4a4b-a98d-996b7c8a9833 tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.322797 Aug 24 01:57:39.604288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 971/1963] 10.222.0.49 () {60 vars in 1206 bytes} [Wed Aug 24 01:57:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:39.609403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:39.610812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:39.618875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.619496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.620151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.621051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:39.621663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:39.622115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:39.761153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:39.769797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88f1c0d0-2013-40ac-af17-410cf478ebe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.169737 Aug 24 01:57:39.770830 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 972/1964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:39 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:39.787360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1346705617", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:39.841195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:40.040300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:40.040691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:40.041186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:40.041701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:40.042224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:40.051666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.052141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.052647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.053431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.053884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.054491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.074404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:40.076852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=13,nova_api:UPDATE=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:40.080774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Getting quotas for user a85308f636d5482da1a8bb3682af2490 and project 1543201242714e73975fac0624348325. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:40.096876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.utils [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] ram quota exceeded for 1543201242714e73975fac0624348325, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128567) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 24 01:57:40.097510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Request method failure captured: Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 145 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLh-EeaG-FG-1d4QKPN4nroW0YGKTgapWg_OK-0hK0VLjfDIRPKt00F-yiFvnhTj-lavO0jaIhY7JccJt-PbecsNFY6BXL-XgA2et6KUtnH1jc0MoNZAFu6bHHQ4CnBeKFhbhypbLNqviCjVMpo1xmHwv2l_Ezds6Aj2_rFEfF_3I Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1543201242714e73975fac0624348325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1543201242714e73975fac0624348325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a85308f636d5482da1a8bb3682af2490 Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1346705617", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1346705617', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452'}}} Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:40.099682 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af5c3510-ed6f-42e2-afc5-672c8a3caddc tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.328814 Aug 24 01:57:40.104902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 973/1965] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:39 2022] POST /compute/v2.1/servers => generated 110 bytes in 331 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:40.108143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:40.108143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:40.113916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.114562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.115049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.115833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.116283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.116829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.400881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:40.411847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b2ad031-2e07-4c90-94e3-643de592f5dc tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.308898 Aug 24 01:57:40.413051 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 974/1966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:40 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:40.424166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a618b4d-6cc4-4528-80a6-373c7923fa8e tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] Calling method '.version_select at 0x7f6b9201f940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:40.424166 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:40.424166 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:40.432436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a618b4d-6cc4-4528-80a6-373c7923fa8e tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018219 Aug 24 01:57:40.434541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 975/1967] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 01:57:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:40.441877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:40.442598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:40.452753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.454345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.455468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.456360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.457112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.458158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.683401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:40.693445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af6aef03-4c3d-4d27-afc9-ef3189e8114e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.257838 Aug 24 01:57:40.702907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 976/1968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:40 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:40.719476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:40.720103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:40.727783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.728555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.729100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.729816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:40.730315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:40.730808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:40.946769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:40.956213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:40.957752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:40.958950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41f958d9-b725-406a-a5eb-3243cbeee879 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.255173 Aug 24 01:57:40.959628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 977/1969] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:40 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:40.963925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Action: 'update', calling method: .version_select at 0x7f6b92451c10>, body: {"quota_set": {"ram": 51200}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:41.028298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.028860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.029296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.030020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.030504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.030946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.086719 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-544ff1e3-c4bc-4d94-a0fe-0579dfcee384 tempest-QuotasAdminNegativeTest-1785380716 tempest-QuotasAdminNegativeTest-1785380716-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 200 len: 331 microversion: 2.1 time: 0.125896 Aug 24 01:57:41.087231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 978/1970] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:40 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:41.091878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:41.092658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:41.102746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.103244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.103685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.104390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.104893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.105326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.107922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:41.248599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:41.257100 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c8c7739-6e38-4623-ad20-59f5ba00c606 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.168806 Aug 24 01:57:41.257662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 979/1971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:41 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:41.262093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c62cbf2-8911-4d61-9dfd-bf380b556def tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] Action: 'update', calling method: .version_select at 0x7f6b91fb5940>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:41.265171 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:57:41.265171 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:57:41.356754 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c62cbf2-8911-4d61-9dfd-bf380b556def tempest-QuotaClassesAdminTestJSON-193165434 tempest-QuotaClassesAdminTestJSON-193165434-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.097641 Aug 24 01:57:41.357271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 980/1972] 10.222.0.49 () {60 vars in 1206 bytes} [Wed Aug 24 01:57:41 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:41.361924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:41.362410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:41.369038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.369524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.369964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.370981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.371549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.371980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.402744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:57:41.494551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2935346-c0fc-49cf-8cef-49af784ce8bb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 204 len: 0 microversion: 2.1 time: 0.135832 Aug 24 01:57:41.495468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 981/1973] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:57:41 2022] DELETE /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:57:41.502493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb9598e-def6-43ae-8c2b-254e40c7faa2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1343972440", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": -1, "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:41.515143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-eeb9598e-def6-43ae-8c2b-254e40c7faa2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Flavor -1 could not be found. Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb9598e-def6-43ae-8c2b-254e40c7faa2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 206 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1343972440", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": -1, "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: exception: Flavor -1 could not be found. Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1343972440', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': -1, 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:41.518490 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb9598e-def6-43ae-8c2b-254e40c7faa2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeb9598e-def6-43ae-8c2b-254e40c7faa2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.022335 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 982/1974] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:41 2022] POST /compute/v2.1/servers => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4232a40c-af1c-4505-989c-91bf9223f32a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Action: 'update', calling method: .version_select at 0x7f6b9241c670>, body: {"quota_set": {"ram": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4232a40c-af1c-4505-989c-91bf9223f32a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a85308f636d5482da1a8bb3682af2490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1543201242714e73975fac0624348325', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4232a40c-af1c-4505-989c-91bf9223f32a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Request method failure captured: Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 HTTP/1.1 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 25 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWLh-EeaG-FG-1d4QKPN4nroW0YGKTgapWg_OK-0hK0VLjfDIRPKt00F-yiFvnhTj-lavO0jaIhY7JccJt-PbecsNFY6BXL-XgA2et6KUtnH1jc0MoNZAFu6bHHQ4CnBeKFhbhypbLNqviCjVMpo1xmHwv2l_Ezds6Aj2_rFEfF_3I Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:41.543207 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1543201242714e73975fac0624348325"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1543201242714e73975fac0624348325"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1543201242714e73975fac0624348325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1543201242714e73975fac0624348325 Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-177756656 Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a85308f636d5482da1a8bb3682af2490 Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-QuotasAdminNegativeTest-177756656-project Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: {"quota_set": {"ram": 0}} Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1543201242714e73975fac0624348325', 'body': {'quota_set': {'ram': 0}}} Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:41.558139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4232a40c-af1c-4505-989c-91bf9223f32a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4232a40c-af1c-4505-989c-91bf9223f32a tempest-QuotasAdminNegativeTest-177756656 tempest-QuotasAdminNegativeTest-177756656-project] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325" status: 403 len: 116 microversion: 2.1 time: 0.014140 Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 983/1975] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 01:57:41 2022] PUT /compute/v2.1/os-quota-sets/1543201242714e73975fac0624348325 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.582369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.746911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:41.757828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf911fda-c236-40af-9df4-2d810a7dd708 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.216820 Aug 24 01:57:41.773862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 984/1976] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:41 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:41.781023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:41.782053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:41.792258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.793245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.794575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.795848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:41.796624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:41.797367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:41.962009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:41.973405 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d36f9cd-d05a-44d1-855f-2e1c8fafd955 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1555 microversion: 2.1 time: 0.198073 Aug 24 01:57:41.974370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 985/1977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:41 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:41.992362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:41.993276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:42.000799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.001617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.003154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.004705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.005508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.006093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.203790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:42.221099 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fee74c6d-3255-4a59-9f7e-f647d2085326 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.245252 Aug 24 01:57:42.221791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 986/1978] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:41 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:42.226239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad", "name": "network-vif-plugged", "status": "completed", "tag": "e67c4267-ad7a-455d-a020-b89842be4979"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:42.248465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.249207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.249810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.267295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] Creating event network-vif-plugged:e67c4267-ad7a-455d-a020-b89842be4979 for instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad on n-h2-854121-3 Aug 24 01:57:42.272634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-60e58fc9-1b7a-4827-860f-93fa0c77c36c req-4498cd8d-e9d0-4697-a4e1-e5deaf054962 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049775 Aug 24 01:57:42.273738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 987/1979] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:42.280594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:42.287339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:42.294405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.294901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.295348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.296051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.296667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.297640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.576482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:42.588109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:42.589749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:42.591072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74994583-0102-41d1-bc6d-dd28e17bac4d tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.315876 Aug 24 01:57:42.604885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 988/1980] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:42 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:42.620064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:42.622090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:42.630219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.631081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.631876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.632603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.633080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.633650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.805287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:42.818022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23c25d1e-04d6-4e85-aa34-925bab9120e5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.210438 Aug 24 01:57:42.820884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 989/1981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:42 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:42.837193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:42.837815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:42.847323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.848080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.849386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:42.850111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:42.850569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:42.851132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.052956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:43.068245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54b1f7a3-c13b-40df-b464-a526d38fbcd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.245271 Aug 24 01:57:43.069524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 990/1982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:42 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:43.077057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:43.078233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:43.103494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.105311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.108476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.110445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.111132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.111740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.385445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:43.397856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-129c108e-290f-49bb-a1c4-c163f9f7a3ab tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.327141 Aug 24 01:57:43.398969 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 991/1983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:43 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:43.403728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:43.404351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:43.413989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.414485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.414925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.416359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.417365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.417810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.604434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:43.616336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ca47319-9d6f-40d2-98f8-55daa40cb7a7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1555 microversion: 2.1 time: 0.216214 Aug 24 01:57:43.617290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 992/1984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:43 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:43.634138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14a50bc0-f251-4a09-a647-ad8fae4d6bae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688745324", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14a50bc0-f251-4a09-a647-ad8fae4d6bae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 172 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-688745324", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-688745324', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi -1 Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:57:43.651202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:43.658087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14a50bc0-f251-4a09-a647-ad8fae4d6bae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:43.664505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14a50bc0-f251-4a09-a647-ad8fae4d6bae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.045956 Aug 24 01:57:43.665836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 993/1985] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:43.676387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:43.677146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:43.684852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.685718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.686329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.687214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:43.687909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:43.688509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:43.994436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.011812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.013393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.014591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb7123e9-3f61-454e-9b26-e28c67062058 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.344106 Aug 24 01:57:44.015542 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 994/1986] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:43 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:44.026170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:44.030863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:44.043445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.049776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.050536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.051441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.052084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.052889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.249889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.259118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a9d8e8e-1b3e-4cb8-85f8-f86037817fa1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.241734 Aug 24 01:57:44.260295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 995/1987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:44 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:44.269461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:44.270288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:44.281776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.282269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.282707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.283412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.284040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.284801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.499642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.517099 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa21d995-ed4a-4260-b95f-bdcb2414e632 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.251097 Aug 24 01:57:44.519110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 996/1988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:44 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:44.563831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:44.567672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:44.583112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.585128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.585583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.587818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.588302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.589764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.874530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:44.886522 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-042a175f-6d8b-46ac-b6ff-16f8d4e851e2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.355395 Aug 24 01:57:44.897209 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 997/1989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:44 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:44.907323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:44.908006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:44.917810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.919058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.919865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:44.920874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:44.921591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:44.922787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.100286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:45.102998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:45.124104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bced9e4-a203-4590-ac76-351688033e49 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.225720 Aug 24 01:57:45.131141 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 998/1990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:44 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:45.137880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:45.148474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:45.165756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.167848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.169331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.170150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.171677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.172835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.278800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:45.291535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8a38da2-675a-4f63-838b-916918b76ec3 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1346 microversion: 2.1 time: 0.158806 Aug 24 01:57:45.292601 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 999/1991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:45 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:45.306848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53", "name": "network-vif-plugged", "status": "completed", "tag": "646f1064-72d6-4593-995b-825a034bbb1a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:45.320473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.321480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.322814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.340126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] Creating event network-vif-plugged:646f1064-72d6-4593-995b-825a034bbb1a for instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 on n-h2-854121-3 Aug 24 01:57:45.348463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-46beb264-fb81-4e36-aea1-56dc39f220ef req-3ffb30ed-baf4-49d5-93ce-930a6c45bbcd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053869 Aug 24 01:57:45.349463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1000/1992] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:45.357557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0096410f-c55c-4bbe-a2d7-c22f89245511", "name": "network-vif-deleted", "tag": "6abb6483-c100-4d90-92e6-3710a9cc5e8a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:45.366660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1,nova_api:UPDATE=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:45.373428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.374367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.375146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.408456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] Creating event network-vif-deleted:6abb6483-c100-4d90-92e6-3710a9cc5e8a for instance 0096410f-c55c-4bbe-a2d7-c22f89245511 on n-h2-854121-3 Aug 24 01:57:45.425578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0df3d797-d6f6-4c9d-a2b6-4da258ef4885 req-fe7c0ce8-1a1f-4130-9331-1aed9b116143 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068481 Aug 24 01:57:45.429765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1001/1993] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:45.444117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:45.444875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:45.453827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.454429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.454877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.455573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.456483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.457003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.838547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:45.848492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:45.850263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:45.851740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-661a6ead-1078-4eaf-94f7-42b059c222c6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.420707 Aug 24 01:57:45.853061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1002/1994] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:45 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:45.857830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e43cc261-9b04-4420-83d9-670affe01e62 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865149805", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:45.863079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e43cc261-9b04-4420-83d9-670affe01e62 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e43cc261-9b04-4420-83d9-670affe01e62 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 216 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865149805", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1865149805', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:45.864688 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e43cc261-9b04-4420-83d9-670affe01e62 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e43cc261-9b04-4420-83d9-670affe01e62 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012068 Aug 24 01:57:45.870281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1003/1995] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:45.874136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:45.874748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:45.883532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.884034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.884754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:45.885680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:45.886576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:45.888016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:46.156911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:46.169771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da636fa3-aa47-4e0f-87b6-ea2499adecb9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.299086 Aug 24 01:57:46.182351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1004/1996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:45 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:46.193515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:46.194402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:46.201051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:46.201821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:46.202338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:46.203329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:46.203845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:46.204277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:46.781993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:46.796521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2d307c4-ec75-4a84-af4e-5d798e257c92 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.612942 Aug 24 01:57:46.797844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1005/1997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:46 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:46.824853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:46.825492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:46.833392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:46.833970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:46.834409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:46.835106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:46.835580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:46.836001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.030630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.040290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed97d5e7-46f3-47f5-971e-acf4be622289 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1319 microversion: 2.1 time: 0.223716 Aug 24 01:57:47.054011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1006/1998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:46 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:47.054011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:47.054011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:47.059693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.060916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.061692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.063376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.064378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.064941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.145576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.156133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-800d0dd1-444b-408e-9b7d-dd46baddc779 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1346 microversion: 2.1 time: 0.112552 Aug 24 01:57:47.156133 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1007/1999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:47 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:47.160336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd257eeb-782c-4c70-b166-26e5ceed468a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b926cedc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:47.212144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd257eeb-782c-4c70-b166-26e5ceed468a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562" status: 200 len: 661 microversion: 2.1 time: 0.055568 Aug 24 01:57:47.213225 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1008/2000] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:47 2022] GET /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:47.218150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:47.219167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:47.226430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.226959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.227683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.229521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.230849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.232086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.459819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.468616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4395f1ef-09ac-4b91-a6c5-e4ce6b330352 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.253522 Aug 24 01:57:47.485692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1009/2001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:47 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:47.495362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:47.495992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:47.503472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.504442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.505062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.506562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.507245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.507932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.854752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.867902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.869455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:47.870748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47d3306d-14ca-46be-b9bd-d90928479be9 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.383955 Aug 24 01:57:47.871312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1010/2002] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:47 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:47.889435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:47.891819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:47.902883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.904885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.907785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:47.909024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:47.909632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:47.910955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.067381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:48.083444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71b13412-a770-4230-950c-84f0a091715b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1716 microversion: 2.1 time: 0.210519 Aug 24 01:57:48.084230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1011/2003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:47 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1716 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:48.088954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0477dd3b-b276-4604-890e-bcb5f05d80a2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b926ceee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:48.135138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0477dd3b-b276-4604-890e-bcb5f05d80a2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562" status: 200 len: 661 microversion: 2.1 time: 0.049936 Aug 24 01:57:48.143510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1012/2004] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:48 2022] GET /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:48.157773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-197378803", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-key-1841415157", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:48.235471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] validate_networks() for [('123baaa0-ecb4-444d-bb74-daf968f733de', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:48.502484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Invalid key_name provided. Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 246 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-197378803", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-key-1841415157", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid key_name provided. Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-197378803', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'key_name': 'tempest-key-1841415157', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1841415157 not found for user a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:48.504987 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 24 01:57:48.509520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:48.514925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid key_name provided. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:48.516591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bae59575-842c-42af-b796-11014fcb9788 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.371306 Aug 24 01:57:48.517740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1013/2005] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:48 2022] POST /compute/v2.1/servers => generated 70 bytes in 373 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 01:57:48.523393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:48.524304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:48.532021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.532768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.534169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.535355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.535988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.536586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.696309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:48.706550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-770347f7-9fc1-4dc9-8b9b-a07bf7436c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1469 microversion: 2.1 time: 0.187539 Aug 24 01:57:48.707315 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1014/2006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:48 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:48.712180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:48.712812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:48.719558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.720269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.720919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.721801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.722517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.723111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.792534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:48.801516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86e3018b-60d3-4070-9305-6979d3937846 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1346 microversion: 2.1 time: 0.093189 Aug 24 01:57:48.802205 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1015/2007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:48 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:48.806967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:48.807912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:48.819508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.820159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.820700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:48.821542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:48.822177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:48.822803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.004660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.013706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d22da06-e7ef-4378-8e58-0fe004acce6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.210227 Aug 24 01:57:49.014675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1016/2008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:48 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:49.019345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:49.020115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:49.026435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.027057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.027650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.028454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.029180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.029822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.208618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.221056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5977ddca-29d7-4630-84db-46664c5a3c84 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1469 microversion: 2.1 time: 0.205215 Aug 24 01:57:49.238084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1017/2009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:49 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:49.252906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:49.254815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:49.264960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.268408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.268934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.273558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.274177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.274656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.530068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.540370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.542625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.543847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8957e258-e1e7-429c-a02f-762e6a5dbcec tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.304456 Aug 24 01:57:49.544400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1018/2010] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:49 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:49.550407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:49.551353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:49.561763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.562546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.562990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.563697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.564171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.564597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.697115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.705566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-842648dc-55a6-485f-b56a-7f2fa087c809 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.160165 Aug 24 01:57:49.706139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1019/2011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:49 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:49.710924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:49.711523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:49.717533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.718019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.718455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.719776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.720231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.720661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.862230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.864613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:49.872500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2cc0484-f84c-478a-85ba-1d0870714071 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1706 microversion: 2.1 time: 0.165344 Aug 24 01:57:49.873122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1020/2012] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:49 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1706 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:49.877885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:49.893073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:49.893962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Searching by: {'reservation_id': 'r-lon36ell', 'deleted': False, 'project_id': 'd75231c930634323908998c748d5e4dd'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:57:49.899377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.899860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.900298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.901050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:49.901505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:49.901930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:49.998461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:57:50.071740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:50.079400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.079804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.080247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.211974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b489c52-757f-47a4-9b51-e00331c0411c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-lon36ell" status: 200 len: 2931 microversion: 2.1 time: 0.337543 Aug 24 01:57:50.212576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1021/2013] 10.222.0.49 () {58 vars in 1197 bytes} [Wed Aug 24 01:57:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-lon36ell => generated 2931 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:50.220398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c47dcf2-5a62-4ebe-858a-c4774de85caa tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b91709d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.267104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c47dcf2-5a62-4ebe-858a-c4774de85caa tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d" status: 200 len: 637 microversion: 2.1 time: 0.053295 Aug 24 01:57:50.267682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1022/2014] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d => generated 637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:50.272137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fc7b062-b9bb-48c7-8194-f9f863b4891c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b922270d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.313417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fc7b062-b9bb-48c7-8194-f9f863b4891c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a" status: 200 len: 662 microversion: 2.1 time: 0.044158 Aug 24 01:57:50.313977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1023/2015] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a => generated 662 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:50.320617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.321279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:50.327512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.327996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.329035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.329804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.330229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.330655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.361708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.362193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.362627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.363074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'fault' on Instance uuid 0096410f-c55c-4bbe-a2d7-c22f89245511 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:57:50.405152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:50.413555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-388ca90d-c182-49c7-b701-4a89932cf0c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 200 len: 1351 microversion: 2.1 time: 0.098627 Aug 24 01:57:50.414118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1024/2016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:50.418674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-942317620", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:50.507088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Neutron security group does_not_exist not found {{(pid=128567) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 24 01:57:50.507780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 257 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-942317620", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-942317620', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 24 01:57:50.515109 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:50.520449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:50.525334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63c26b7a-bce4-469b-b70c-6154c4c6bf1b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.102816 Aug 24 01:57:50.525334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1025/2017] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:50 2022] POST /compute/v2.1/servers => generated 106 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:57:50.525334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b2e82bf-4bea-4192-9af1-efe0c425c895 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '.version_select at 0x7f6b91fb5430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.527591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b2e82bf-4bea-4192-9af1-efe0c425c895 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.528078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b2e82bf-4bea-4192-9af1-efe0c425c895 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.528521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b2e82bf-4bea-4192-9af1-efe0c425c895 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.538674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b2e82bf-4bea-4192-9af1-efe0c425c895 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2321 microversion: 2.1 time: 0.018171 Aug 24 01:57:50.539119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1026/2018] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/os-migrations => generated 2321 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:50.543491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.560006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_groups [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Querying cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) for 2 instances {{(pid=128567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 01:57:50.560708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.561230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.561693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.590935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4abcfecf-a416-40fa-82f0-eac341edabb5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/12f429fa-dce0-4352-92d6-c30e4ec1277b" status: 200 len: 265 microversion: 2.1 time: 0.050686 Aug 24 01:57:50.591461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1027/2019] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/os-server-groups/12f429fa-dce0-4352-92d6-c30e4ec1277b => generated 265 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:50.595947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff883251-1270-47b6-9c43-616c1b59f384 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b91fb5af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:50.643677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ff883251-1270-47b6-9c43-616c1b59f384 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:50.648579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ff883251-1270-47b6-9c43-616c1b59f384 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:50.916161 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff883251-1270-47b6-9c43-616c1b59f384 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.323478 Aug 24 01:57:50.916776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1028/2020] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:57:50 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:50.922518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55983b04-9868-4039-a0c1-81c01c2a2a49 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91fb5940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.964185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55983b04-9868-4039-a0c1-81c01c2a2a49 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a" status: 200 len: 662 microversion: 2.1 time: 0.046251 Aug 24 01:57:50.964765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1029/2021] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a => generated 662 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:50.969886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:50.970484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:50.986513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.987263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.987699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:50.988413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:50.988918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:50.989349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.125245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:51.132942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fee2ef8-89d6-49c8-948b-cec09dc3c0b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.167163 Aug 24 01:57:51.133513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1030/2022] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:50 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:51.138505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:51.139110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:51.145290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.145772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.146210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.146928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.147380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.147810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.272944 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d809b423-b29b-4e67-844e-8d789a27503c tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1857 microversion: 2.1 time: 0.137670 Aug 24 01:57:51.273590 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1031/2023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:51 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1857 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:51.277984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:51.278583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:51.284692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.285199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.285639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.286319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.286767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.287185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.472482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:51.481639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:51.483137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:51.484270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a49f08cb-4165-4275-a780-355f2194a8c8 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.209782 Aug 24 01:57:51.484839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1032/2024] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:51 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:51.489109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:51.489707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:51.495206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.495681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.496118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.496824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.497321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.497718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.623815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65975098-b36d-46a4-a4dc-ce65e19518fb tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 200 len: 1620 microversion: 2.1 time: 0.137884 Aug 24 01:57:51.624305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1033/2025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:51 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 1620 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:51.629272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c587e1f7-9e00-4cb5-b6b9-5476e865723b tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b91fb5af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:51.862913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c587e1f7-9e00-4cb5-b6b9-5476e865723b tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "DELETE /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.237537 Aug 24 01:57:51.863476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1034/2026] 10.222.0.49 () {58 vars in 1296 bytes} [Wed Aug 24 01:57:51 2022] DELETE /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_version => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:57:51.867948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:51.868555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:51.874814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.875283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.875726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:51.876410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:51.877406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:51.877833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.004275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:52.012128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d443191-7ea1-407f-81c1-1176da1bac0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.147643 Aug 24 01:57:52.012735 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1035/2027] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:51 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:52.017146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.017804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.023426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.023911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.024348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.025054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.025512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.025931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.159831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef5e99f0-7537-48d3-b68d-029318022651 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1857 microversion: 2.1 time: 0.146080 Aug 24 01:57:52.160497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1036/2028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1857 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:52.165058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.165738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.172416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.173010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.173542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.174320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.174846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.175342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.190461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 HTTP/1.1 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0096410f-c55c-4bbe-a2d7-c22f89245511'} Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.192003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a065f024-615f-4477-ae97-5af7227f7d08 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 404 len: 111 microversion: 2.1 time: 0.031883 Aug 24 01:57:52.198400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1037/2029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:52.199252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.199351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.207355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.208109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.208707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.210298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.213297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.213869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.375503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78faf82e-f46d-4544-b438-b4171ac84026 tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1620 microversion: 2.1 time: 0.179958 Aug 24 01:57:52.376181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1038/2030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1620 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:52.380650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-792744d8-2d7b-44fc-915c-462ce018b716 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b915643a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.420554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-792744d8-2d7b-44fc-915c-462ce018b716 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.043241 Aug 24 01:57:52.421389 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1039/2031] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 37 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:52.426557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.427049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 72ba445a-564c-47f0-b6c3-a4642f8d6ac2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.432945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/72ba445a-564c-47f0-b6c3-a4642f8d6ac2 HTTP/1.1 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '72ba445a-564c-47f0-b6c3-a4642f8d6ac2'} Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.434378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 72ba445a-564c-47f0-b6c3-a4642f8d6ac2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50ba13b5-e447-4514-af70-157b5823c90b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/72ba445a-564c-47f0-b6c3-a4642f8d6ac2" status: 404 len: 111 microversion: 2.1 time: 0.012813 Aug 24 01:57:52.439904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1040/2032] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:57:52 2022] DELETE /compute/v2.1/servers/72ba445a-564c-47f0-b6c3-a4642f8d6ac2 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:52.441408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.441408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.447964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.448425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.448953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.449583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.450033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.450458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.533437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'services' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:57:52.605025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13edf6bd-24b5-4a0b-8e41-8291dad9ed8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments/b1b4f1a6-7de3-4905-bf7d-243d3b894985" status: 202 len: 0 microversion: 2.1 time: 0.167192 Aug 24 01:57:52.605613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1041/2033] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 01:57:52 2022] DELETE /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments/b1b4f1a6-7de3-4905-bf7d-243d3b894985 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:57:52.612186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d98281a8-0e4a-4a56-a141-e23145487e88 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b915190d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.655857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d98281a8-0e4a-4a56-a141-e23145487e88 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09" status: 200 len: 661 microversion: 2.1 time: 0.049063 Aug 24 01:57:52.657212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1042/2034] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09 => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:52.662308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:52.664549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:52.672878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.673366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.673808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.674507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:52.674960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:52.675531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:52.687989 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511/os-volume_attachments HTTP/1.1 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '0096410f-c55c-4bbe-a2d7-c22f89245511'} Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:52.690038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a004470-94c3-4306-9408-6aa27b363faa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032926 Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1043/2035] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 01:57:52 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:57:52.698831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: .version_select at 0x7f6b91530820>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-308350384", "policies": ["anti-affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:52.715744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:52.721478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:52.760319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:52.768348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:52.773856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:52.788105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-527df904-fe11-4fae-a6db-d1b0b5dd8137 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.094590 Aug 24 01:57:52.788901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1044/2036] 10.222.0.49 () {60 vars in 1174 bytes} [Wed Aug 24 01:57:52 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:52.796527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4bc89f3-2bdf-4506-a884-24fcf88c9567 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b915308b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:52.854855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d4bc89f3-2bdf-4506-a884-24fcf88c9567 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:52.860183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d4bc89f3-2bdf-4506-a884-24fcf88c9567 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:53.108549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4bc89f3-2bdf-4506-a884-24fcf88c9567 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.318555 Aug 24 01:57:53.109179 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1045/2037] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:57:52 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:53.114155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:53.114765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:53.121014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.121532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.122106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.122941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.123429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.124018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.256590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:53.264485 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-212a13cb-673b-4915-ba7a-4159e999d15e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.154357 Aug 24 01:57:53.265105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1046/2038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:53 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:53.270029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:53.270630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:53.276222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.276738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.277198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.277885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.278338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.278762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.467980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:53.478175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:53.479725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:53.481009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4196e5a9-5dc7-4dd7-a0a8-db6308570b7f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.214339 Aug 24 01:57:53.481574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1047/2039] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:53 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:53.486644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:53.488877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:53.495057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.495610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.496048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.496801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:53.497222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:53.497647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:53.528008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a732203-83ee-4caf-bdd7-e1f875f0c9a5 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045397 Aug 24 01:57:53.528569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1048/2040] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 01:57:53 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:53.536432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4dd4a53a-94bb-4e7b-98a6-83311c2ad117 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91530c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:53.579697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4dd4a53a-94bb-4e7b-98a6-83311c2ad117 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09" status: 200 len: 661 microversion: 2.1 time: 0.050076 Aug 24 01:57:53.580285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1049/2041] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:57:53 2022] GET /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09 => generated 661 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:53.584887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-430442177", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:53.646433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:54.113771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:54.114343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:54.114877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:54.115442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:54.115972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:54.128017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.128704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.129180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:54.130018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.130456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.130898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:54.138621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=29 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:54.139288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:54.154014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.160683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.174322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:54.176866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:54.227155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b696f8a-fbad-4c69-8d11-29382d54c3b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645671 Aug 24 01:57:54.231075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1050/2042] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:57:54.240989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1967050228", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b3aa66de-d603-4446-a6c6-0514b269345d"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:54.313262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:54.576665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:54.577800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:54.578732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:54.579597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:54.580332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:54.598845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.600041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.600768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:54.601820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.602694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.603887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:54.627232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.632739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.646790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 2 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:54.649009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:54.701837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.707364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.746784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.752042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.767066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=70b1433e-00c4-434a-8612-ea0e9d67a263,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:54.818700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.823799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.853014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:57:54.860593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:54.866488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:54.910173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1dd36057-baf5-4425-a63a-4a9f771a96c6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.675649 Aug 24 01:57:54.911039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1051/2043] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 01:57:54.916115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9589bbfe-5f73-4ef6-b5ae-dad6a81140a1 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b91f528b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:54.959652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9589bbfe-5f73-4ef6-b5ae-dad6a81140a1 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047179 Aug 24 01:57:54.960508 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1052/2044] 10.222.0.49 () {58 vars in 1290 bytes} [Wed Aug 24 01:57:54 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:54.965908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:54.966665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:54.974072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.974551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.975061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:54.975793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:54.976289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:54.976748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.137384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:55.146335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e3e79b3-6387-45f7-91b1-43e26b65c9fe tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.184925 Aug 24 01:57:55.147328 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1053/2045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:54 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:55.151738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-943696966", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:55.211722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:55.491333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:55.492076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:55.492869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:55.493685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:55.494358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:55.507604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.508432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.509135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.510175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.510853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.511728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.534111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Getting quotas for project 4cebddd1936244c987047a24fdbbd78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:55.540241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Getting quotas for user 58e8c56d2103491ba90d5c9090782cf3 and project 4cebddd1936244c987047a24fdbbd78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:55.559197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:55.561369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:55.645504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acdaef55-17f9-4b4a-bbcd-6d8c8605367a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495773 Aug 24 01:57:55.647291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1054/2046] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:57:55.663162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:55.663866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:55.677482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.678043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.678431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.679900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.680377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.682927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.837100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:55.854325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea50f382-0247-4652-8bb7-5c0e202e396b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1266 microversion: 2.1 time: 0.204399 Aug 24 01:57:55.859384 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1055/2047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:55 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:55.877978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:55.878846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:55.885507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.886039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.886474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:55.887188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:55.887845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:55.888203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:56.239662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:56.252392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:56.253742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:56.255657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-923b5b4e-5bc2-4336-8241-aa62b6ce1106 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.394755 Aug 24 01:57:56.266772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1056/2048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:55 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:56.279746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:56.282499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:56.290990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:56.292383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:56.293255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:56.294190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:56.295070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:56.296015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:56.339525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fefbfe29-1d7f-4744-8519-6b4ab28e9bd4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071114 Aug 24 01:57:56.345509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1057/2049] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 01:57:56 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:57:56.352808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:56.360423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:56.362913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Searching by: {'deleted': False, 'project_id': 'd75231c930634323908998c748d5e4dd'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:57:56.377667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:56.379596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:56.380166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:56.381894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:56.385529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:56.386315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:56.446137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:57:56.526537 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95016f87-02ac-4447-8b7e-40b891c270e3 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.179036 Aug 24 01:57:56.529096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1058/2050] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 01:57:56 2022] GET /compute/v2.1/servers => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:56.537601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5aead2f-210f-4166-ad11-61ed08bf2f72 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b915195e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:56.634522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b5aead2f-210f-4166-ad11-61ed08bf2f72 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:56.641618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b5aead2f-210f-4166-ad11-61ed08bf2f72 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:56.944675 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5aead2f-210f-4166-ad11-61ed08bf2f72 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.413931 Aug 24 01:57:56.945952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1059/2051] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:57:56 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:56.951878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:56.952695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:57:56.953547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9223372036854775808 could not be found. Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9223372036854775808'} Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:57:56.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a1ec090-a5e6-44dd-88dd-2bcc437250d3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.011484 Aug 24 01:57:56.961531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1060/2052] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 24 01:57:56 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:57:56.970150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1533768456", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:57:57.046340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:57:57.504570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:57:57.510972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:57:57.511857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:57:57.512882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:57:57.513553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:57:57.534164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:57.536776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:57.537637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:57.538642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:57.540265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:57.541020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:57.565422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Getting quotas for project 4cebddd1936244c987047a24fdbbd78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:57:57.572396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Getting quotas for user 58e8c56d2103491ba90d5c9090782cf3 and project 4cebddd1936244c987047a24fdbbd78c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:57:57.590222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:57:57.593903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:57:57.760050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-057ace0f-dd43-4a38-b5b4-0f53b282f395 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.795653 Aug 24 01:57:57.761749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1061/2053] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:57:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:57:57.782793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:57.785486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:57.802251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:57.803331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:57.804000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:57.804987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:57.805685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:57.807115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:57.867356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:57:58.055939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50178ea9-5654-45f9-abbe-832ee0a97503 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 204 len: 0 microversion: 2.1 time: 0.292340 Aug 24 01:57:58.057289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1062/2054] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:57:57 2022] DELETE /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:57:58.064048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:58.066544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:58.086694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:58.087280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:58.089196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:58.089992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:58.091492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:58.091994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:58.417158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:58.431695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37a81659-bcf8-4594-99bb-552b04c09aec tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1277 microversion: 2.1 time: 0.372662 Aug 24 01:57:58.432544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1063/2055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:58 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:58.441049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cba40f8a-ed2e-432b-bfb0-82fd71c236dc tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b914e8820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:58.519937 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cba40f8a-ed2e-432b-bfb0-82fd71c236dc tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.086054 Aug 24 01:57:58.520608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1064/2056] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:57:58 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:58.532190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:58.532960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:58.540591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:58.541492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:58.542208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:58.543755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:58.544477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:58.545203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.028016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:59.040672 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c19dbb49-664c-4c07-a375-8befb72e09c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.513535 Aug 24 01:57:59.041375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1065/2057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:58 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:57:59.058694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:59.060139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:59.071486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.072966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.073612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.074659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.080528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.081272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.631687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:59.659171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:59.661509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:57:59.664384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84309fb4-1ffb-4690-924d-4a392ba47a89 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.621093 Aug 24 01:57:59.666171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1066/2058] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:57:59 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:57:59.673350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:59.677774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:59.686295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.688056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.689007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.690042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.690786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.691441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.743634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdac8ce1-91b7-4681-b2e5-457610ee858a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074984 Aug 24 01:57:59.744661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1067/2059] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 01:57:59 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:57:59.749530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:57:59.750234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:57:59.757697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.758536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.759215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:57:59.760183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:57:59.760932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:57:59.762067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:00.060961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:00.100940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95a3d1c8-de80-4ae9-9853-9972b318df31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1270 microversion: 2.1 time: 0.350449 Aug 24 01:58:00.103617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1068/2060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:57:59 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1270 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:00.113154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:00.113763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:00.121414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:00.121908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:00.122344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:00.123201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:00.123660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:00.124083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:00.749822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:00.765559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e6f46cd-4546-423c-aeb3-67d726736a1b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.658159 Aug 24 01:58:00.766533 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1069/2061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:00 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:00.780420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e833704-8b34-48cb-985d-4e00989c1d4e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b91fb50d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:00.865857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1e833704-8b34-48cb-985d-4e00989c1d4e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:00.876777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1e833704-8b34-48cb-985d-4e00989c1d4e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:01.147769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e833704-8b34-48cb-985d-4e00989c1d4e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.380040 Aug 24 01:58:01.151058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1070/2062] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:58:00 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:01.159566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:01.160417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:01.174806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:01.175749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:01.176431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:01.177262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:01.178567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:01.179360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:01.592503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:01.603440 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18db9749-bb03-48c4-a100-cd8ac171b323 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.450283 Aug 24 01:58:01.604563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1071/2063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:01 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:01.611027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:01.611932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:01.619103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:01.619968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:01.620646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:01.621745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:01.623154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:01.623924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:01.643571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:02.175614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:02.188558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c5dd86f-b8e3-4adc-b4b1-ed84e63a321e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1319 microversion: 2.1 time: 0.582633 Aug 24 01:58:02.191311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1072/2064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:01 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:02.209180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:02.210406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:02.227169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:02.228072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:02.229483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:02.230838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:02.231579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:02.232302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.134625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:03.145788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:03.147314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:03.148474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e29c7d99-47a8-4797-a289-2804a3e7eab6 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.955303 Aug 24 01:58:03.149722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1073/2065] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:02 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:03.154527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd", "tag": "ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:03.165138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.166133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.167373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.183767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] Creating event network-changed:ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef for instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd on n-h1-854121-3 Aug 24 01:58:03.189931 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d103e70b-2898-4e14-96e6-c438520fc7d6 req-1582836e-0ebd-45fb-89e8-306c3fe7029e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038726 Aug 24 01:58:03.190877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1074/2066] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:03.196675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:03.197424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:03.208744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.209259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.209720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.210592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.211221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.212170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.474456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:03.485130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-184380e8-aa00-4ee2-a5c0-572360b16283 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.291981 Aug 24 01:58:03.486001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1075/2067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:03 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:03.490975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aba2f366-47ee-410e-810d-817db1c85478 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b914a6940>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:03.553696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aba2f366-47ee-410e-810d-817db1c85478 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:03.560422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aba2f366-47ee-410e-810d-817db1c85478 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:03.563198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:03.572375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=98,nova_cell0:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:03.891327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aba2f366-47ee-410e-810d-817db1c85478 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.403877 Aug 24 01:58:03.892045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1076/2068] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:58:03 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 64 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:03.899679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc9e330-9e0a-4bb9-996a-6d1ba23898ee", "tag": "f403a146-f0c3-456f-b9a6-1853bfd8798e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:03.910224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.910788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.911218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.922533 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] Creating event network-changed:f403a146-f0c3-456f-b9a6-1853bfd8798e for instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee on n-h2-854121-3 Aug 24 01:58:03.927699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b67a3881-6976-4500-9060-fd69c312afdc req-055adf52-21e5-453e-b332-64c866426299 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034077 Aug 24 01:58:03.928489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1077/2069] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:03.933792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:03.934265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Failed to fetch instance by id -1 {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 01:58:03.934805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance -1 could not be found. Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance -1 could not be found. Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '-1'} Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:03.936569 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a846c8f-7739-49b0-ba1b-17a4ed3216c2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008516 Aug 24 01:58:03.942528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1078/2070] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 01:58:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:58:03.946223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:03.946922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:03.955815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.956302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.956829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:03.957513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:03.957971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:03.958393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.095439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.103580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db16b10c-f74e-49ff-a391-45e37ccbe7fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.160787 Aug 24 01:58:04.104312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1079/2071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:03 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:04.109648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "034ef6c6-396b-407e-948c-b10759a257a8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:04.121931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.122547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.123072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.135071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] Creating event network-vif-plugged:034ef6c6-396b-407e-948c-b10759a257a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:04.141026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-89718672-507d-4ff2-af0c-bb6b37946c9c req-1af4e183-6bd6-4efb-b984-5d5897377108 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Aug 24 01:58:04.141627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1080/2072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:04.147556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:04.148250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:04.154774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.157832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.158430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.159204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.159845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.160445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.301601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.310578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d964c565-4a83-464e-b8c2-053f09b45e27 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1319 microversion: 2.1 time: 0.167621 Aug 24 01:58:04.311149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1081/2073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:04 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:04.317320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-095c2ac4-0f3d-4520-a2fe-e1c5b49aa069 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b91564ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:04.361839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-095c2ac4-0f3d-4520-a2fe-e1c5b49aa069 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.049640 Aug 24 01:58:04.362490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1082/2074] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:58:04 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 64 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:04.368043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:04.368755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:04.375851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.376346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.376811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.377546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.378000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.378428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.758636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.766612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-913493da-2212-4338-93c0-7e89a4848426 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.403110 Aug 24 01:58:04.767188 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1083/2075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:04 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:04.772963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:04.773581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:04.779958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.780457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.780984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.782194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:04.782435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:04.782870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:04.976051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.986861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.988401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:04.989962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2e5b1f6-dbce-4ece-8d72-6e805e5bc8d5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.221848 Aug 24 01:58:04.990524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1084/2076] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:04 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:04.995062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e483712-620f-4292-9530-de305077ed8a tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b91530820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:05.044964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7e483712-620f-4292-9530-de305077ed8a tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:05.050970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7e483712-620f-4292-9530-de305077ed8a tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:05.417703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e483712-620f-4292-9530-de305077ed8a tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.426112 Aug 24 01:58:05.422972 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1085/2077] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:58:04 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:05.423390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:05.424010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:05.433069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:05.433572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:05.434023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:05.434745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:05.435204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:05.435629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:05.782449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:05.796509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7557ad86-e56d-496a-8068-eff46879e976 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.376115 Aug 24 01:58:05.798283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1086/2078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:05 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:05.806263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:05.806914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:05.818544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:05.819311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:05.819773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:05.820964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:05.821283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:05.821715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.189347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:06.197578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c596e984-1a67-483e-808f-de9c8e0aa885 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.398010 Aug 24 01:58:06.198928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1087/2079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:05 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:06.203882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:06.204657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:06.211492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:06.212179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:06.212818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.213675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:06.214296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:06.214720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.440475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:06.451733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48db43b3-031b-4e69-a400-5cae05f984b9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.251235 Aug 24 01:58:06.452396 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1088/2080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:06 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:06.457313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:06.470089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:06.470726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:06.471365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.489592 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] Creating event network-changed:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 01:58:06.496111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-97e31b15-7cc6-4ae6-a4f1-9486685cb44a req-c3d3d2fc-d27f-42d6-afa7-42cdda58cf3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042004 Aug 24 01:58:06.497317 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1089/2081] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:06.505387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:06.506222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:06.512711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:06.513237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:06.513672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.514385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:06.514846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:06.515273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:06.761608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:06.771478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b61fd23a-9b29-4f31-8b09-e3fb4d555f89 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1319 microversion: 2.1 time: 0.272784 Aug 24 01:58:06.785428 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1090/2082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:06 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:06.790784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0e3bfce-f698-41cf-a489-7a5f199794da tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update', calling method: .version_select at 0x7f6b914e8a60>, body: {"meta": {"os_version": "alt"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:06.850656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0e3bfce-f698-41cf-a489-7a5f199794da tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:06.855801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0e3bfce-f698-41cf-a489-7a5f199794da tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:07.128022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0e3bfce-f698-41cf-a489-7a5f199794da tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.341375 Aug 24 01:58:07.128627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1091/2083] 10.222.0.49 () {60 vars in 1313 bytes} [Wed Aug 24 01:58:06 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata/os_version => generated 31 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:07.133510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b1433e-00c4-434a-8612-ea0e9d67a263", "tag": "70e55243-52b6-4db8-8607-d4a0a5b5b6f8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:07.143548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.144022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.144452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.157147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] Creating event network-changed:70e55243-52b6-4db8-8607-d4a0a5b5b6f8 for instance 70b1433e-00c4-434a-8612-ea0e9d67a263 on n-h1-854121-3 Aug 24 01:58:07.164269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2d3004af-563a-4af6-935f-30df33569de1 req-aca44eca-4652-46c6-bbc6-880204118b35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Aug 24 01:58:07.164969 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1092/2084] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:07.170034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:07.170729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:07.177006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.177497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.177936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.178629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.179083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.179510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.388655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.398719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.400317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.401633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acfb3d9c-3d41-4704-8ee4-f1308cd14197 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.235525 Aug 24 01:58:07.402762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1093/2085] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:07 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:07.408732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:07.409304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 76100033-da49-4869-b2a2-37dadcfc3733] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:07.414871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/76100033-da49-4869-b2a2-37dadcfc3733/action HTTP/1.1 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 19 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: {"forceDelete": {}} Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '76100033-da49-4869-b2a2-37dadcfc3733', 'body': {'forceDelete': {}}} Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:07.416799 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 76100033-da49-4869-b2a2-37dadcfc3733 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c8c331b-4663-42c2-aee3-601c687642f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/76100033-da49-4869-b2a2-37dadcfc3733/action" status: 404 len: 111 microversion: 2.1 time: 0.014582 Aug 24 01:58:07.422383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1094/2086] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:07 2022] POST /compute/v2.1/servers/76100033-da49-4869-b2a2-37dadcfc3733/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:07.426337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:07.426947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:07.433533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.435177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.435622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.436338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.437546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.437986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.553868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:07.573467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.581681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa517461-27ca-4138-b95d-f3e700429f6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.158734 Aug 24 01:58:07.582247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1095/2087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:07 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:07.586609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-caff902d-99d4-45e8-8e1f-72ded14aae1d tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b914e8430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:07.627769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-caff902d-99d4-45e8-8e1f-72ded14aae1d tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.044487 Aug 24 01:58:07.628480 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1096/2088] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:58:07 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 58 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:07.633257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:07.633410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:07.640176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.640676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.641156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.641872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.642327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.642757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.778447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.787341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5617ca5e-9b27-4dbb-a2e7-bac7c086904c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.157765 Aug 24 01:58:07.788223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1097/2089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:07 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:07.794668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:07.795546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:07.804447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.804993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.805444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.806159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:07.806623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:07.807052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:07.946561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:07.955009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a89861c3-18e8-47bb-80b9-9a05d11c389f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.165601 Aug 24 01:58:07.955585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1098/2090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:07 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:07.960402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67a3adc1-eb47-4ace-8c99-90c0ad4189b9 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'update_all', calling method: .version_select at 0x7f6b91497700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:08.009819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-67a3adc1-eb47-4ace-8c99-90c0ad4189b9 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:08.015547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-67a3adc1-eb47-4ace-8c99-90c0ad4189b9 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:08.262925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67a3adc1-eb47-4ace-8c99-90c0ad4189b9 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.306281 Aug 24 01:58:08.263535 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1099/2091] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:58:07 2022] PUT /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 61 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:08.268506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:08.269138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:08.275310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:08.275791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:08.276225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:08.276953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:08.277407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:08.277827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:08.292817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:08.423363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:08.432999 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf5c0dfb-2ff0-480a-8fec-c69f186ea747 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1319 microversion: 2.1 time: 0.168460 Aug 24 01:58:08.446578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1100/2092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:08 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:08.446578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:08.446578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:08.446578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:08.446578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:08.447362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:08.447667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:08.448124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:08.448651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:08.585733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:08.594721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71cd9e21-fcf7-4462-b513-25f807f29e9e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.159532 Aug 24 01:58:08.595395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1101/2093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:08 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:08.600733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b9ea0cb-1a6d-4ab7-ae4e-d611049e1889 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Action: 'create', calling method: .version_select at 0x7f6b91709b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:08.653828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8b9ea0cb-1a6d-4ab7-ae4e-d611049e1889 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:08.662955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8b9ea0cb-1a6d-4ab7-ae4e-d611049e1889 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Getting quotas for user 495b36ae0fae495bb4bf1b08041b5be7 and project 7db5a93f6a0c45b686589d7ed6903f0a. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:09.034490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b9ea0cb-1a6d-4ab7-ae4e-d611049e1889 tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "POST /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.437563 Aug 24 01:58:09.039577 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1102/2094] 10.222.0.49 () {60 vars in 1281 bytes} [Wed Aug 24 01:58:08 2022] POST /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 85 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:09.041725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:09.042723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:09.052002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.052517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.053023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.053741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.054199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.054656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.388805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:09.399600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:09.401478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:09.402692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dab84e00-15b0-4a4a-ba48-778ab414b9e5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.366130 Aug 24 01:58:09.403439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1103/2095] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:09 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:09.411979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2", "tag": "d0a66c9a-177b-4812-a22e-2e9332494459"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:09.421681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.422157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.422630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.434558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] Creating event network-changed:d0a66c9a-177b-4812-a22e-2e9332494459 for instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 on n-h2-854121-3 Aug 24 01:58:09.441569 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-906c5399-de00-44c8-b02b-78a4494f2bc4 req-72d36a94-2390-4aa9-83bb-2eb0491575de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033910 Aug 24 01:58:09.442566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1104/2096] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:09.448003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:09.448700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:09.455527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.456023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.456682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.457458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.457910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.458338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.596514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:09.606237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7448d94d-ce41-41bc-b952-c2ba9f9f4f37 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.161397 Aug 24 01:58:09.606874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1105/2097] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:09 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:09.611964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:09.614275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: d1bf4479-88ea-4b66-b14b-818fd00a3567] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:09.619841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/d1bf4479-88ea-4b66-b14b-818fd00a3567/action HTTP/1.1 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 39 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: {"os-getConsoleOutput": {"length": 10}} Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd1bf4479-88ea-4b66-b14b-818fd00a3567', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:09.621815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance d1bf4479-88ea-4b66-b14b-818fd00a3567 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08ef5726-cf0a-4874-b444-45dbf30c4dda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/d1bf4479-88ea-4b66-b14b-818fd00a3567/action" status: 404 len: 111 microversion: 2.1 time: 0.015215 Aug 24 01:58:09.627971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1106/2098] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:09 2022] POST /compute/v2.1/servers/d1bf4479-88ea-4b66-b14b-818fd00a3567/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:09.629680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:09.630294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:09.637281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.637780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.638225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.638937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.639401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.640405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.782295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:09.790695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91c71de9-970a-4c8d-babe-c1c336a0c297 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.164713 Aug 24 01:58:09.791457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1107/2099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:09 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:09.795663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc9e330-9e0a-4bb9-996a-6d1ba23898ee", "name": "network-vif-plugged", "status": "completed", "tag": "f403a146-f0c3-456f-b9a6-1853bfd8798e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:09.804981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.805458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.807212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.819705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] Creating event network-vif-plugged:f403a146-f0c3-456f-b9a6-1853bfd8798e for instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee on n-h2-854121-3 Aug 24 01:58:09.824605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1d5acafc-f37e-4127-9a00-0b156395cbdf req-17039b2b-585e-45ca-8522-620b2bfa5c7a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Aug 24 01:58:09.825376 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1108/2100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:09.831968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5467428c-a4f8-47a5-856a-60b9490e825e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] Calling method '.version_select at 0x7f6b914470d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:09.872817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5467428c-a4f8-47a5-856a-60b9490e825e tempest-ImagesMetadataTestJSON-74652790 tempest-ImagesMetadataTestJSON-74652790-project] 10.222.0.49 "GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.046198 Aug 24 01:58:09.873392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1109/2101] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 01:58:09 2022] GET /compute/v2.1/images/3ac5516c-7815-48a2-974e-88af321b6d7d/metadata => generated 85 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:09.878897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:09.879668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:09.886304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.886795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.887238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:09.887944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:09.888410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:09.888978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.098341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:10.110499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e60fe87a-4a44-4102-baa0-dd6e7ac26c08 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1319 microversion: 2.1 time: 0.236029 Aug 24 01:58:10.128536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1110/2102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:09 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:10.136238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:10.136898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:10.157864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.158868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.159307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.162592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.163111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.164005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.485615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:10.494483 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af690190-b317-48e5-9eed-b505c14e36b7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.364764 Aug 24 01:58:10.495066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1111/2103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:10 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:10.519201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:10.519814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:10.528440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.528969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.529449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.530099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.530991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.531658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.829302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:10.840702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:10.842256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:10.843497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c58a383d-3e26-4a27-a69b-197aa3100757 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.346483 Aug 24 01:58:10.844054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1112/2104] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:10 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:10.865494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:10.866335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:10.872467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.873287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.873924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:10.875549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:10.876212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:10.876868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:11.074298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:11.096780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34372cb7-7418-44fd-847a-313fda2ee1db tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.237420 Aug 24 01:58:11.098157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1113/2105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:10 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:11.125158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:11.126100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:11.134728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:11.135546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:11.136278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:11.137379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:11.138784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:11.139603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:11.349094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:11.359254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8137cde-952a-4ae2-b473-0ac61f88dea1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.241200 Aug 24 01:58:11.360275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1114/2106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:11 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:11.366274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:11.367135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:11.373872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:11.374437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:11.374879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:11.376023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:11.379035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:11.379766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:12.173415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:12.186118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26bfabbd-127d-4093-9961-8409fe6097b7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.824529 Aug 24 01:58:12.189011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1115/2107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:11 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:12.194071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:12.200128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: e4a8bf3f-3fc0-498f-b359-885044e6fbe1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:12.226375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e4a8bf3f-3fc0-498f-b359-885044e6fbe1 HTTP/1.1 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4a8bf3f-3fc0-498f-b359-885044e6fbe1'} Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:12.228048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance e4a8bf3f-3fc0-498f-b359-885044e6fbe1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e63949c-6dd9-41da-8565-c5febc02d4a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/e4a8bf3f-3fc0-498f-b359-885044e6fbe1" status: 404 len: 111 microversion: 2.1 time: 0.039321 Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1116/2108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:12 2022] GET /compute/v2.1/servers/e4a8bf3f-3fc0-498f-b359-885044e6fbe1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:12.238258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:12.256660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:12.260997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:12.264666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:12.266371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:12.268426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:12.273697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:12.274613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:12.627862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:12.638420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b696c79-76dd-47f6-a4b0-c198ee524bf7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1469 microversion: 2.1 time: 0.407326 Aug 24 01:58:12.658630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1117/2109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:12 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:12.664184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "6b6ab3af-bffd-4035-a651-6a36df9542f8"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "cf13d730-863e-41c4-a6c7-d3070eaee9b1"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "efdfe94a-558a-4964-b054-0ee5008b309f"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "388674f5-75f1-4dad-984e-1a85c9e5ed1c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:12.676850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:12.677744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:12.678341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:12.694825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Creating event network-vif-plugged:6b6ab3af-bffd-4035-a651-6a36df9542f8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:12.695779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Creating event network-vif-plugged:cf13d730-863e-41c4-a6c7-d3070eaee9b1 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:12.696877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Creating event network-vif-plugged:efdfe94a-558a-4964-b054-0ee5008b309f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:12.697586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] Creating event network-vif-plugged:388674f5-75f1-4dad-984e-1a85c9e5ed1c for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:12.703550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c6a16a28-890d-4c09-97ea-cd3a415d642a req-420a772d-0768-4d2e-85b7-0363e91387a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043313 Aug 24 01:58:12.704448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1118/2110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:12.713088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:12.714185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:12.721938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:12.722826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:12.723517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:12.724474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:12.725262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:12.726157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.095592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.106736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.108937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.111034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e45341a0-c38c-486e-baa9-2b015b9c33c7 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.404388 Aug 24 01:58:13.113827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1119/2111] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:12 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:13.130882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:13.131635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:13.138787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.139661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.140350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.141364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.141889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.142547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.324975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.336436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b7ba7e4-4c83-4ac0-af46-b93d7759e4d6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.214988 Aug 24 01:58:13.348879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1120/2112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:13 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:13.354671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:13.355310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:13.365362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.365894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.366342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.367328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.367831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.368255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.537548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.545677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd6414f6-77a5-43a8-ad97-a1b049ed7bda tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.195661 Aug 24 01:58:13.546812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1121/2113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:13 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:13.564136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:13.564781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:13.571053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.571547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.571992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.572738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.573184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.573611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.715916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:13.731077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7896593-e503-42d8-8527-59cb4eb5c8ee tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1319 microversion: 2.1 time: 0.170702 Aug 24 01:58:13.731668 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1122/2114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:13 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:13.883713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3150a7cd-8502-41e7-8f53-e677ae4989c4 tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] Calling method '.version_select at 0x7f6b91fb5820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:13.932130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3150a7cd-8502-41e7-8f53-e677ae4989c4 tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] 10.222.0.49 "GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5" status: 200 len: 784 microversion: 2.1 time: 0.198984 Aug 24 01:58:13.933060 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1123/2115] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:13 2022] GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5 => generated 784 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:13.938069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:13.939240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:13.946366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.946861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.947303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.948002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:13.948453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:13.948919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:13.954673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:14.082308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.090166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-504f6a97-bcab-40ea-b691-9329e18a6966 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.155800 Aug 24 01:58:14.090738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1124/2116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:13 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:14.095174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.095788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:14.101923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.102414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.102855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.103576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.104032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.104457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.242130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.250559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ebd5c1b-ac05-40f0-a4c4-a353fda601ae tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.158811 Aug 24 01:58:14.251132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1125/2117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:14.255947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-409719b4-cfb1-4532-85ca-10a3cb62cbac tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] Calling method '.version_select at 0x7f6b91497700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.350033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-409719b4-cfb1-4532-85ca-10a3cb62cbac tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] 10.222.0.49 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.097377 Aug 24 01:58:14.359425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1126/2118] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/images => generated 445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:14.364608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.365370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:14.373177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.373667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.374654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.375352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.376390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.376847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.569414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.584241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.586086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.587923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e96f99b-bfe5-4f16-b591-2dd923d09a9a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.227510 Aug 24 01:58:14.589309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1127/2119] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:14.597428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86f17ede-457d-4390-894e-e3b7bbb9db7b tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] Calling method '.version_select at 0x7f6b91fb5820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.650487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86f17ede-457d-4390-894e-e3b7bbb9db7b tempest-ListImagesTestJSON-1614487892 tempest-ListImagesTestJSON-1614487892-project] 10.222.0.49 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.059831 Aug 24 01:58:14.651073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1128/2120] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:14.656327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4375c52-0240-4465-a9f6-c8ffca57307b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-944825880", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4375c52-0240-4465-a9f6-c8ffca57307b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 237 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-944825880", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-944825880', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.674487 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4375c52-0240-4465-a9f6-c8ffca57307b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4375c52-0240-4465-a9f6-c8ffca57307b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024118 Aug 24 01:58:14.680083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1129/2121] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:58:14.688673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.689340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:14.698083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.698591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.699040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.701386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.702613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.703067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.887345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:14.896020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b16c6a27-7f8f-4ff2-b363-058b77024a31 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.214417 Aug 24 01:58:14.896753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1130/2122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:14.901996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:14.902629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:14.908840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.909509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.910258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:14.911124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:14.911725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:14.912313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.067048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:15.077766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3aaf246-f950-4bcd-a727-bc2a28007322 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.179127 Aug 24 01:58:15.087009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1131/2123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:14 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:15.087009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:15.087009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:15.092079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.092813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.093435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.094297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.094903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.095801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.244768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:15.257622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce9af108-3e14-4cfb-855f-9b0adcbc14b8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1319 microversion: 2.1 time: 0.177655 Aug 24 01:58:15.258732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1132/2124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:15 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:15.275531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "54393e22-36ea-466c-a75d-f21b7d4792a8"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-plugged", "status": "completed", "tag": "957de5bb-22b4-440c-a3f5-be84eac0472f"}, {"server_uuid": "54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2", "name": "network-vif-plugged", "status": "completed", "tag": "d0a66c9a-177b-4812-a22e-2e9332494459"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:15.289742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.290347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.291317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.306167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Creating event network-vif-plugged:54393e22-36ea-466c-a75d-f21b7d4792a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:15.306948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Creating event network-vif-plugged:957de5bb-22b4-440c-a3f5-be84eac0472f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:15.307541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] Creating event network-vif-plugged:d0a66c9a-177b-4812-a22e-2e9332494459 for instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 on n-h2-854121-3 Aug 24 01:58:15.316803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-779e6007-569f-4f65-a2e2-9b763426d79a req-6af66b89-8919-4eb1-9481-fe4affe52c58 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056795 Aug 24 01:58:15.317724 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1133/2125] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:15.323088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:15.323867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:15.330599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.331087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.331525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.332228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.332680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.333150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.588821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:15.598302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa5e4dd1-ad93-4d8f-b44c-f471ca3a0471 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.279614 Aug 24 01:58:15.620230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1134/2126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:15 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:15.636014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:15.636633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:15.649028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.649527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.649961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.652839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.653319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.653757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.812829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:15.821415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d65b402e-2ecb-4c02-9857-597470106552 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.199460 Aug 24 01:58:15.822121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1135/2127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:15 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:15.827956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:15.829519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:15.839990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.840606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.841307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:15.842111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:15.843199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:15.843805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.045820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.056069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.069738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.070916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17401377-620b-4c00-b304-c1b27bb7d96c tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.247636 Aug 24 01:58:16.072243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1136/2128] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:15 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:16.078388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5aec1824-05db-4a4e-92fd-9b78c9ab8560 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-424133047", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5aec1824-05db-4a4e-92fd-9b78c9ab8560 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 234 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-424133047", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-424133047', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.082813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5aec1824-05db-4a4e-92fd-9b78c9ab8560 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5aec1824-05db-4a4e-92fd-9b78c9ab8560 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010174 Aug 24 01:58:16.087765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1137/2129] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:16 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:58:16.093425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.094047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:16.101672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.102166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.102602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.103304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.103759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.104186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.255251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.263244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7255d1bd-304e-4b8f-b427-3a058e1baea8 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1318 microversion: 2.1 time: 0.177496 Aug 24 01:58:16.263977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1138/2130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:16.269531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.270143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:16.277371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.277861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.278302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.279002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.279458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.279879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.431685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.440049 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55cc672f-69d7-44d8-b94c-191f9c4f3777 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.174203 Aug 24 01:58:16.440617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1139/2131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:16.445233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.445863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:16.452737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.453229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.453670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.454350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.454814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.455262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.589024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.596893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4050d087-dfc6-4835-bfe2-e1e4c458c906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1319 microversion: 2.1 time: 0.155264 Aug 24 01:58:16.597466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1140/2132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:16.711723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.713304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.713778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.714206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.714913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.715359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.715771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.739130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3122b3f-7e53-4a39-9b42-1e379211ce2a tempest-AZV2TestJSON-1182336510 tempest-AZV2TestJSON-1182336510-project] 10.222.0.49 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.140656 Aug 24 01:58:16.739697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1141/2133] 10.222.0.49 () {58 vars in 1164 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 01:58:16.750631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.751243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:16.757307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.757897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.758372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.759023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.759473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.759896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.902898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:16.916191 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-388ed0df-6008-4069-a2b8-76030b5e4fb3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.169579 Aug 24 01:58:16.916919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1142/2134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:16.922545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:16.923377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:16.929406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.930106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.930738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:16.931623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:16.932400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:16.933019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.132384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.144656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79e152b5-0705-4fb0-a265-5175efb7bd9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.225959 Aug 24 01:58:17.145419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1143/2135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:16 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:17.150571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:17.151491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 2d920eb2-3f53-477f-a88a-2d418b8e66c7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:17.159939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/2d920eb2-3f53-477f-a88a-2d418b8e66c7/action HTTP/1.1 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 13 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: {"pause": {}} Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2d920eb2-3f53-477f-a88a-2d418b8e66c7', 'body': {'pause': {}}} Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:17.162513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 2d920eb2-3f53-477f-a88a-2d418b8e66c7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce30abca-0985-497d-9733-dddd835ec381 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/2d920eb2-3f53-477f-a88a-2d418b8e66c7/action" status: 404 len: 111 microversion: 2.1 time: 0.018479 Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1144/2136] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:17 2022] POST /compute/v2.1/servers/2d920eb2-3f53-477f-a88a-2d418b8e66c7/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:17.174071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:17.182287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.183003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.183444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.184234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.184865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.185358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.415941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.425487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.427286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.428833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00fa91dc-bb6f-4c64-bed1-73e8fb752ae5 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1874 microversion: 2.32 time: 0.260906 Aug 24 01:58:17.444528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1145/2137] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:17 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1874 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:17.455337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:17.456401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:17.467297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.468496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.469004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.472032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.473326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.473912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.661265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.672890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87158479-77d5-4cfb-ac6d-1071f521aec9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.224496 Aug 24 01:58:17.673544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1146/2138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:17 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:17.678368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:17.679188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:17.696583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.697309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.697949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.698849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.699480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.700213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.708426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:17.861290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:17.873468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7946370f-17c5-4601-8465-023aa81c6645 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1467 microversion: 2.1 time: 0.197512 Aug 24 01:58:17.875249 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1147/2139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:17 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1467 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:17.880755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:17.881566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:17.888183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.888886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.890100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:17.891219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:17.892197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:17.892947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.068570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:18.081916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d52b7dd-0db7-408c-9b40-f61ac01fca8b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1319 microversion: 2.1 time: 0.205295 Aug 24 01:58:18.082500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1148/2140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:17 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:18.099235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:18.100011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:18.129266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.131004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.132860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.134249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.137488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.140598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.367271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:18.375781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbeae2d1-c59c-461c-b70b-98cf284bc0aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.291597 Aug 24 01:58:18.376468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1149/2141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:18 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:18.386553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b1433e-00c4-434a-8612-ea0e9d67a263", "name": "network-vif-plugged", "status": "completed", "tag": "70e55243-52b6-4db8-8607-d4a0a5b5b6f8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:18.397690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.398250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.398762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.410935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] Creating event network-vif-plugged:70e55243-52b6-4db8-8607-d4a0a5b5b6f8 for instance 70b1433e-00c4-434a-8612-ea0e9d67a263 on n-h1-854121-3 Aug 24 01:58:18.416689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f6dabb2b-59b4-4149-aa43-e90b9d220793 req-f4f63b2b-5575-44b2-97fd-554585c2a771 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Aug 24 01:58:18.417912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1150/2142] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:18.422914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:18.423758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:18.430855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.431351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.431789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.432495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.432987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.433698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.661048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:18.669812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20d78691-f383-4704-9a93-2d4e4e90eede tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1317 microversion: 2.1 time: 0.250676 Aug 24 01:58:18.673224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1151/2143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:18 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:18.675776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:18.676454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:18.678616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:18.684209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.684903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.685484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.686828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.687565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.688038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.857116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:18.878211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-505bba62-af82-4a3a-9452-0eacf97c9f8a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.206145 Aug 24 01:58:18.879774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1152/2144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:18 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:18.897736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:18.898298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:18.905532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.906042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.906480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:18.907216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:18.907862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:18.908298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.002153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-859c9c2a-3716-44c0-8d66-99f572feb4e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.119539 Aug 24 01:58:19.003034 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1153/2145] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:18 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:58:19.023093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:19.024550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:19.035525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.036310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.036917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.038444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.040250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.041456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.332204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:19.345242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:19.346738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:19.348151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f97a09e3-0342-492f-b6fa-a1c806c0931b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 2825 microversion: 2.32 time: 0.334436 Aug 24 01:58:19.348787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1154/2146] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:19 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 2825 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:19.353744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:19.354355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:19.362163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.362163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.362552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.363406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.369881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.370724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.588957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:19.604695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72efe4d3-4859-4f10-b015-f3d63d184659 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1509 microversion: 2.1 time: 0.254835 Aug 24 01:58:19.605692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1155/2147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:19 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:19.616414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:19.617046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:19.625256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.625752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.626190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.626923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.627378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.627801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.907587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:19.932424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72b807d1-590f-4f92-821d-330756278424 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1319 microversion: 2.1 time: 0.323760 Aug 24 01:58:19.946122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1156/2148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:19 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:19.947603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:19.948217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:19.957200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.958250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.958702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:19.960192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:19.960692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:19.961168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:20.179413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f9b4bb6-0c09-4862-b3fe-5257be225a59 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.241961 Aug 24 01:58:20.180024 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1157/2149] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 01:58:19 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300/os-interface => generated 1830 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:20.194106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:20.194593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:20.201666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:20.202655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:20.206242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:20.207011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:20.207477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:20.207913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:20.569682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:20.578991 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2ffd872-2d88-4428-8540-71e1e4110ca2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1317 microversion: 2.1 time: 0.397902 Aug 24 01:58:20.579731 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1158/2150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:20 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:20.584475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:20.587120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:20.594370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:20.594868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:20.595422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:20.596323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:20.596791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:20.597227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.079077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:21.087965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50897426-1242-41bc-ba8d-9d08fa7fe57d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.507236 Aug 24 01:58:21.088570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1159/2151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:20 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:21.094676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd", "name": "network-vif-plugged", "status": "completed", "tag": "ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef"}, {"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-plugged", "status": "completed", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:21.105162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:21.105738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:21.106331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.120845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Creating event network-vif-plugged:ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef for instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd on n-h1-854121-3 Aug 24 01:58:21.121638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] Creating event network-vif-plugged:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 01:58:21.128255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0b97503a-8d12-49b9-a504-89147d269ea6 req-2462a01a-ffcb-42b3-a32a-214e34cae0e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037555 Aug 24 01:58:21.129235 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1160/2152] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:21.135913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:21.136629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:21.143495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:21.143981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:21.144650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.145390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:21.146054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:21.146488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.655696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:21.670861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4961a8c9-334d-42a4-84a8-b73fc5f944e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1489 microversion: 2.1 time: 0.539575 Aug 24 01:58:21.675157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1161/2153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:21 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1489 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:21.681602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:21.683209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:21.696397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:21.697166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:21.698327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.700654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:21.704023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:21.705481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:21.982327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:21.992167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22b24d1f-76c9-4f10-9dc6-a0ed3d44d81a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1468 microversion: 2.1 time: 0.315177 Aug 24 01:58:21.992784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1162/2154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:21 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:21.997409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "tag": "54393e22-36ea-466c-a75d-f21b7d4792a8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:22.017548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:22.018609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:22.019296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:22.034071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] Creating event network-changed:54393e22-36ea-466c-a75d-f21b7d4792a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 01:58:22.040498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-57b94176-6885-41f9-a01c-60ce278218d5 req-b5b10149-45d7-4681-a4c4-3ed0efb301c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046519 Aug 24 01:58:22.041809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1163/2155] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:22.049117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2097901114", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8d282946-c6d2-446c-a4ca-e9e99e5e112e"}], "block_device_mapping_v2": [{"uuid": "a394d7f7-967e-4bf9-8ed1-e029d5b3b062", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:22.136092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] validate_networks() for [('8d282946-c6d2-446c-a4ca-e9e99e5e112e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:58:22.698685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:58:22.699110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:58:22.699596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:58:22.701254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:58:22.702262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:58:22.716574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:22.721054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:22.721517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:22.722330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:22.722796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:22.723218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:22.748216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:22.754301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Getting quotas for user 0aa9308751b9454b8d173b034f4b040b and project 9b1ee336634941239acddd6889d6f2ea. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:22.834096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:58:22.837110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a394d7f7-967e-4bf9-8ed1-e029d5b3b062',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:58:22.972115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:22.992476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6bb94934-4507-4f3a-ba24-dd2bcd7a56e8 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949217 Aug 24 01:58:22.994008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1164/2156] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:58:23.001958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:23.002869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:23.009651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.010456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.011176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.012015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.012467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.012928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.168205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:23.170510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:23.180905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9d7d4f4-3633-47d3-8ac0-f86815e572e1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1317 microversion: 2.1 time: 0.185413 Aug 24 01:58:23.184451 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1165/2157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:22 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:23.203620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:23.204513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:23.211869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.212360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.213014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.223339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.223968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.224550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.267234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'pause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state paused Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 13 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: {"pause": {}} Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'pause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state paused Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'pause': {}}} Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state paused. Cannot pause while the instance is in this state. Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state paused Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:23.269717 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state paused Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:23.275244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'pause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state paused {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:23.276435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f77204f-5e95-4219-8cd2-9fc79060300a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 143 microversion: 2.1 time: 0.077935 Aug 24 01:58:23.277625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1166/2158] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:23 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 143 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:58:23.283320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:23.294278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:23.295685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Searching by: {'reservation_id': 'r-0wck2qel', 'deleted': False, 'project_id': 'd75231c930634323908998c748d5e4dd'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 01:58:23.306307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.306307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.306816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.307548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.308005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.309137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.425488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 01:58:23.509249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:23.515989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.516480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.516981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.675997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ef566fe-18e6-4006-b2a5-b559d0959de2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/detail?reservation_id=r-0wck2qel" status: 200 len: 2930 microversion: 2.1 time: 0.397209 Aug 24 01:58:23.690856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1167/2159] 10.222.0.49 () {58 vars in 1197 bytes} [Wed Aug 24 01:58:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0wck2qel => generated 2930 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:23.696154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:23.696840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:23.703193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.704275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.704760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.705488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.705945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.706371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.913529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:23.935471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d9f09db-5224-4019-8b23-f3cba86d0258 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1314 microversion: 2.1 time: 0.243440 Aug 24 01:58:23.949571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1168/2160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:23 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:23.949571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:23.955230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:23.969292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.969661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.970448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:23.970813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:23.971267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:23.971692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.093077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:24.110529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31c269a1-01af-497c-b024-4a9e9e3743c6 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1151 microversion: 2.1 time: 0.171760 Aug 24 01:58:24.125202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1169/2161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:23 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1151 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:24.125202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:24.125202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:24.141791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.142986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.143499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.144601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.146791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.148251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.365166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:24.374462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:24.376121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:24.382996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fff98348-f7d8-41bf-b91b-07cec53abf6e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1475 microversion: 2.25 time: 0.262540 Aug 24 01:58:24.383817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1170/2162] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:24 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1475 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:24.393082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:24.393619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:24.411922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.412412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.412878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.413582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.414032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.414462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.584463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-336c7f81-6340-4efc-a50d-f2e0b0181bb8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.198839 Aug 24 01:58:24.586327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1171/2163] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:24 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:58:24.598606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:24.649309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_groups [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Querying cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) for 2 instances {{(pid=128567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 01:58:24.650043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.651804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.652043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.700524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d65fce0-125f-4c6e-8a9f-954a08ce3681 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/b3aa66de-d603-4446-a6c6-0514b269345d" status: 200 len: 270 microversion: 2.1 time: 0.112112 Aug 24 01:58:24.707137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1172/2164] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 01:58:24 2022] GET /compute/v2.1/os-server-groups/b3aa66de-d603-4446-a6c6-0514b269345d => generated 270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:24.707137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:24.707567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:24.727647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.728139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.728573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:24.738546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:24.739089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:24.739561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:25.437283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:25.449265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d62658df-60ea-4e4b-9a0b-1350d801a967 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1466 microversion: 2.1 time: 0.746344 Aug 24 01:58:25.450175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1173/2165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:24 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1466 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:25.751675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:25.753053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:25.760356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:25.761273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:25.762485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:25.764027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:25.764735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:25.765377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.119413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 3effb318-d8d0-4d2c-80e1-18f95a4a9151 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:58:26.145588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a86ad789-7680-4937-8c50-e307bd932398 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1965 microversion: 2.25 time: 0.693226 Aug 24 01:58:26.146193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1174/2166] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:25 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1965 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:26.157052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:26.160579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:26.172651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.173179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.173623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.174402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.175452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.175888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.440286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:26.456174 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdec49c1-0916-467d-80e5-1c62bbd09283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.305849 Aug 24 01:58:26.456783 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1175/2167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:26 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:26.468874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:26.469502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:26.478703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.479431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.480074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.481783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.482573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.483815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.820782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec63c45e-c949-4e49-bd04-927456a01a0e tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 200 len: 1620 microversion: 2.1 time: 0.358145 Aug 24 01:58:26.824461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1176/2168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:26 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 1620 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:26.835718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:26.838623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:26.854437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.854937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.855380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:26.856123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:26.856533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:26.856986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.023462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:27.042553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-019b255c-d23a-4e93-acf1-0baa0cd3075e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1293 microversion: 2.1 time: 0.210293 Aug 24 01:58:27.043477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1177/2169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:26 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1293 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:27.051073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:27.051684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:27.067992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.068488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.069214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.073718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.074320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.079345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.282428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:27.298737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03bf8495-9f4f-4a0e-b44b-39fe71a80fbc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1211 microversion: 2.1 time: 0.254220 Aug 24 01:58:27.299915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1178/2170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:27 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:27.319157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1400132657"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:27.321905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:27.340419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.341247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.341691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.343075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.343534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.343958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.574400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:27.589809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-defb2dab-021a-4505-b3de-c8b73143894a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "POST /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.288342 Aug 24 01:58:27.595623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1179/2171] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:27 2022] POST /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 01:58:27.669959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35bb7dbc-27bc-41b1-81ad-7a5ce2a64b0c tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Action: 'create', calling method: .version_select at 0x7f6b913185e0>, body: {"keypair": {"name": "tempest-keypair-381427475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIV+w8rgpJ3cO6T7hGzqXG3tWqBXqUv/AqynFxQFPb0Unb24aWcI9yefsjZnqvbvfYW1f8FKz8ZxFGYW/ovo8CajxyIkcw/nZdUP546N9hoCo1wuoGEjpwsODrme7acMg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:27.690348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-35bb7dbc-27bc-41b1-81ad-7a5ce2a64b0c tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for project 1d70e35c621c40f2b0484855a1da7340. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:27.697634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-35bb7dbc-27bc-41b1-81ad-7a5ce2a64b0c tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for user ab8ae36a2e674bb3b0cab433cf834eb9 and project 1d70e35c621c40f2b0484855a1da7340. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:27.728377 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35bb7dbc-27bc-41b1-81ad-7a5ce2a64b0c tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135435 Aug 24 01:58:27.729425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1180/2172] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 01:58:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:27.737257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd", "name": "network-vif-deleted", "tag": "ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:27.748853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.749444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.749742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.761961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] Creating event network-vif-deleted:ddcee27f-2f2d-4ffe-8cd1-a0e4177c44ef for instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd on n-h1-854121-3 Aug 24 01:58:27.768678 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b3d1715f-bf84-40e0-a093-3f753509521c req-28c91288-004a-43e6-beda-4b81926003c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037982 Aug 24 01:58:27.769815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1181/2173] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:27.775861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:27.776643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:27.783072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.783714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.784168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.785010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:27.785573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:27.786470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:27.971824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 3effb318-d8d0-4d2c-80e1-18f95a4a9151 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:58:27.988683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11217359-2670-4153-a6f0-221710b7f66e tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1965 microversion: 2.25 time: 0.217367 Aug 24 01:58:28.005534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1182/2174] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:27 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1965 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:28.010824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:28.011455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:28.019736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.019994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.020257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.021006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.021469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.021903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.220075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:28.230154 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbc0eae2-e416-422a-a22f-4c1c3f24ea6e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.223238 Aug 24 01:58:28.231315 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1183/2175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:28 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:28.260682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:28.261337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:28.269571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.270061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.270529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.275811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.276292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.276759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.533877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b389d1bc-befc-4872-955d-61eaf4f9a1ae tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1619 microversion: 2.1 time: 0.300237 Aug 24 01:58:28.534471 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1184/2176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:28 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1619 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:28.545958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7999602-8784-4cf5-ac70-92a84c698b78", "tag": "ebbff98b-6ec6-461e-b8f1-59dccdf78022"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:28.563411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.574896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.576261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.597536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] Creating event network-changed:ebbff98b-6ec6-461e-b8f1-59dccdf78022 for instance f7999602-8784-4cf5-ac70-92a84c698b78 on n-h2-854121-3 Aug 24 01:58:28.631065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1336fb42-3822-4d0a-b5b3-5fcc91074153 req-a65e9425-2bd9-4e92-8d1d-9ef3ea80dd47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094590 Aug 24 01:58:28.633934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1185/2177] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:28.648915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-550c4250-d44a-483f-b699-19bd37072192 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913eea60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:28.759566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-550c4250-d44a-483f-b699-19bd37072192 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.123874 Aug 24 01:58:28.760356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1186/2178] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:28 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:28.768204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:28.779577 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:58:28.779577 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:58:28.785105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.785838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.786286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.787316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.789084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.789528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.835908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d59525c2-e244-4cfb-a818-7f311e9abf5f tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.074193 Aug 24 01:58:28.836977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1187/2179] 10.222.0.49 () {60 vars in 1217 bytes} [Wed Aug 24 01:58:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 01:58:28.841753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:28.843327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:28.851193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.851709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.852317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.853097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.853561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.853982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.953279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:28.964950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-092384af-fc32-4ef0-96f2-98677bdf5197 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 200 len: 1293 microversion: 2.1 time: 0.126544 Aug 24 01:58:28.965620 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1188/2180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:28 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:28.975447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:28.978073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:28.984658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.985192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.985700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:28.986709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:28.987766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:28.988260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.004106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action HTTP/1.1 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 28 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: {"reboot": {"type": "SOFT"}} Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7d660cab-5e97-47a1-bfc9-1fcf2254e486', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:29.006080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a7752a0-fbd3-4f5b-a09a-0576712ded7e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action" status: 404 len: 111 microversion: 2.1 time: 0.038765 Aug 24 01:58:29.011400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1189/2181] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:28 2022] POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:29.015945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:29.016560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:29.024562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.025374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.025826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.026599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.027229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.030626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.259754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:29.272028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b37fa192-1976-469e-92bc-d38c06f9542e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1211 microversion: 2.1 time: 0.262756 Aug 24 01:58:29.273175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1190/2182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:29 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1211 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:29.284166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1981052316", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "958ebf3c-bb2f-4596-bc40-d6335ff442ba"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:29.361575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:58:29.732303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:58:29.733699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:58:29.734023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:58:29.734492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:58:29.734924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:58:29.747046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.747881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.748525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.749818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.750651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.753844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.779001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:29.785966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:29.805448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:58:29.808378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:58:29.872540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4baa538-bdcf-4a18-97c1-01340ff942c4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597738 Aug 24 01:58:29.874097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1191/2183] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:58:29.879890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-3", "block_migration": "auto"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:29.884295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:29.891455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.892661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.893378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.894096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:29.894562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:29.895095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:29.928859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'flavor' on Instance uuid 3effb318-d8d0-4d2c-80e1-18f95a4a9151 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:58:29.945130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Going to try to live migrate instance to n-h2-854121-3 {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:58:31.458582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64f82dff-8e05-4ded-82eb-b7abcdc3e9eb tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151/action" status: 202 len: 0 microversion: 2.25 time: 1.583015 Aug 24 01:58:31.459391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1192/2184] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 01:58:29 2022] POST /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151/action => generated 0 bytes in 1585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:58:31.463902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:31.464513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:31.472968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.473448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.473882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.474568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.475021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.475445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.610097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:31.617881 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c06e768e-da92-4f85-8a41-843550634948 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.157506 Aug 24 01:58:31.618463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1193/2185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:31 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:31.623084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b90609e3-01e8-4b5a-af87-c1ede57b9ef4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9132a790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:31.675096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b90609e3-01e8-4b5a-af87-c1ede57b9ef4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.055448 Aug 24 01:58:31.675742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1194/2186] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:31 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:31.681814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:31.682683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:31.690582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.691080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.691596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.692293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.692956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.693606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.774953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:31.783779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-538bf64f-41e6-4ca7-8c6e-1939a326fad0 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1269 microversion: 2.1 time: 0.106853 Aug 24 01:58:31.789420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1195/2187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:31 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:31.789541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:31.790137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:31.805031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.805817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.806511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.807525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.808292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.809709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.827199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd HTTP/1.1 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd'} Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:31.829957 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:31.835493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca8a6ba2-06db-458d-9b13-ede499f6c8de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 404 len: 111 microversion: 2.1 time: 0.045763 Aug 24 01:58:31.841216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1196/2188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:31 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:31.848101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:31.849171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:31.856418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.857277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.858266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:31.859543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:31.861482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:31.862147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:32.130375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:32.138075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd9a63ea-bafb-4c10-905a-748119e09463 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1211 microversion: 2.1 time: 0.294479 Aug 24 01:58:32.138632 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1197/2189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:31 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1211 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:32.144619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1894897330", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ed949689-39ae-4575-8294-6b97b4a372b3"}], "security_groups": [{"name": "tempest-securitygroup--1531504979"}], "key_name": "tempest-keypair-381427475", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:32.305383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] validate_networks() for [('ed949689-39ae-4575-8294-6b97b4a372b3', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:58:32.923102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:32.929877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for project 1d70e35c621c40f2b0484855a1da7340. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:32.935732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for user ab8ae36a2e674bb3b0cab433cf834eb9 and project 1d70e35c621c40f2b0484855a1da7340. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:32.950148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:58:32.950567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:58:32.951055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:58:32.951461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:58:32.951874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:58:32.960670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:32.961228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:32.961657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:32.962382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:32.962839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:32.963263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:32.984235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for project 1d70e35c621c40f2b0484855a1da7340. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:32.989561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Getting quotas for user ab8ae36a2e674bb3b0cab433cf834eb9 and project 1d70e35c621c40f2b0484855a1da7340. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:33.004405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:58:33.006494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:58:33.066277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b873664-ba35-4766-90cc-cf958ecc4f2b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.925258 Aug 24 01:58:33.067374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1198/2190] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:58:33.074684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:33.075378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:33.086643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:33.087204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:33.088342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:33.089587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:33.090222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:33.090823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:33.438079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:33.447211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:33.448879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:33.450085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6576f8ce-a34c-4f4b-9e30-ccd517102908 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.381685 Aug 24 01:58:33.450700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1199/2191] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:33 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:33.471653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:33.472273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:33.482598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:33.483088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:33.484100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:33.484835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:33.485293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:33.485710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:33.994084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:34.013756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdff4175-c7af-4503-a127-8cf1af176a08 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.547659 Aug 24 01:58:34.045575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1200/2192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:33 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:34.051730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-213862913", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:34.209926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:58:34.913830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:58:34.914543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:58:34.915082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:58:34.915732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:58:34.916402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:58:34.927049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:34.928016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:34.928996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:34.929977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:34.930673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:34.931327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:34.955720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:34.962816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:34.982163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:58:34.985379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:58:35.042441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50a5934c-8761-429f-93bd-69f5a9ffe443 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994314 Aug 24 01:58:35.043270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1201/2193] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:58:35.050174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-049a6033-2ede-4e2f-9a34-4a67c7b68236 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913070d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:35.122777 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-049a6033-2ede-4e2f-9a34-4a67c7b68236 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.078263 Aug 24 01:58:35.123967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1202/2194] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:35 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:35.130003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:35.130851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:35.140906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.142461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.143126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.144542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.145490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.146081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.163970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:35.353434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:35.362887 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f4d7dff-6223-4685-91a3-4400f21a3697 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.237310 Aug 24 01:58:35.373305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1203/2195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:35 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:35.381653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:35.382536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:35.390269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.391011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.391620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.392849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.393473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.394106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.467126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:35.477386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89dd2ccb-4e79-40dd-832a-4c2ad6451fe1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1335 microversion: 2.1 time: 0.102742 Aug 24 01:58:35.478171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1204/2196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:35 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:35.482798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:35.484236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:35.490357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.490843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.491468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.492614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.493300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.493907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.658080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:35.678869 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a6fa089-4904-44e4-ba19-8852e0819bff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.199833 Aug 24 01:58:35.679777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1205/2197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:35 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:35.689050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:35.694793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:35.709805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d/action HTTP/1.1 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 28 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: {"reboot": {"type": "SOFT"}} Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d', 'body': {'reboot': {'type': 'SOFT'}}} Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. Aug 24 01:58:35.711391 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-216c7792-0fbb-45f5-a355-8c04175ae7dd tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d/action" status: 404 len: 111 microversion: 2.1 time: 0.031878 Aug 24 01:58:35.716143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1206/2198] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:35 2022] POST /compute/v2.1/servers/0d235e2c-1bea-4e0d-9deb-5ec6f3f0ab9d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:35.727579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-plugged", "status": "completed", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:35.738799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.739107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.739761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.751756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] Creating event network-vif-plugged:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 01:58:35.757198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8dca0a60-bf73-42d2-bdad-f9a536d2c0e8 req-72a6ced5-199d-4640-92c7-0829d276dafc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042702 Aug 24 01:58:35.758008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1207/2199] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:35.764768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a228e2c0-b381-4ac3-b084-82e5367511a6", "tag": "f819dab9-06c6-4c08-b91b-a1a339a95bb2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:35.775882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.776686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.777358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.791241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] Creating event network-changed:f819dab9-06c6-4c08-b91b-a1a339a95bb2 for instance a228e2c0-b381-4ac3-b084-82e5367511a6 on n-h1-854121-3 Aug 24 01:58:35.798544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-49f19125-2fd2-43db-a2a3-2506d816ab3e req-e662ac10-cb33-43a4-83cd-15b1e17c852a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038788 Aug 24 01:58:35.799433 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1208/2200] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:35.806371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:35.807061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:35.813434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.813914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.814496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.815194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:35.815645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:35.816064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:35.992177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.003536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.005540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.007278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f958c51-0aec-4569-95d2-b81713540a01 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.206148 Aug 24 01:58:36.016761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1209/2201] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:35 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:36.016761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.016761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:36.023696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.024287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.025044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.025814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.026408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.027330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.113832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.122441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce5dca2f-46b9-497f-9897-5db1902a84c9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1266 microversion: 2.1 time: 0.113060 Aug 24 01:58:36.123028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1210/2202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:36.137846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.137846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:36.157274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.157936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.158376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.159754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.160230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.160938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.379667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.406101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5827655a-f865-44cd-884c-dc684abf88e0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.281073 Aug 24 01:58:36.420741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1211/2203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:36.420741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b00d72d5-6f62-4bbd-bf03-9cb4721fc807 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91307b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.475505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b00d72d5-6f62-4bbd-bf03-9cb4721fc807 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.066159 Aug 24 01:58:36.476216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1212/2204] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:36.480933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.481677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:36.488985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.489553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.490079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.490854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.491383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.491884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.647568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.657103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fef30ce-4b31-468c-a028-e93c6f7d5899 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.179563 Aug 24 01:58:36.657788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1213/2205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:36.663445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.664480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:36.681377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.683106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.683763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.684687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.685385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.685961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.835713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:36.845910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f12ec980-6292-4da2-a7cf-08941fef7bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.186350 Aug 24 01:58:36.846505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1214/2206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:36.859702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:36.866485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:36.874892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.875988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.876775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:36.877779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:36.878295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:36.878677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.113100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.125204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1008f0fa-dd40-4f7c-b2b5-1772cf09e494 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.269654 Aug 24 01:58:37.125860 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1215/2207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:36 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:37.141502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:37.142483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:37.149744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.150432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.150881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.151891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.152097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.152487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.374798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.386704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85249036-2735-4930-817f-c9c4020f4edc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.259863 Aug 24 01:58:37.396748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1216/2208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:37 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:37.396748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aeced63-b65a-4093-9bd2-e41114150cd3", "tag": "57670ca8-2837-4bc3-bc78-704d5acd1b46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:37.409518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.410214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.411293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.428469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] Creating event network-changed:57670ca8-2837-4bc3-bc78-704d5acd1b46 for instance 1aeced63-b65a-4093-9bd2-e41114150cd3 on n-h2-854121-3 Aug 24 01:58:37.433502 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0512f8ce-e50a-4255-8584-5274b54d5aab req-64d8ad01-74de-4610-9d43-a2ae19663ffe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044251 Aug 24 01:58:37.434115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1217/2209] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:37.439960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:37.443233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:37.450092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.450584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.451023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.451721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.452206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.452631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.473102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action HTTP/1.1 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 65 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7d660cab-5e97-47a1-bfc9-1fcf2254e486', 'body': {'rebuild': {'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5'}}} Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 01:58:37.475566 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43a5c717-aa2a-41bb-b228-e8c2131102dc tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action" status: 404 len: 111 microversion: 2.1 time: 0.044232 Aug 24 01:58:37.481133 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1218/2210] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:37 2022] POST /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:37.490358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:37.491046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:37.498140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.498736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.499449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.500175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.500695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.501589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.709553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.719663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.721220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.722390 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97b88435-2606-4ca6-b02f-10071d9f87e0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.236242 Aug 24 01:58:37.723147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1219/2211] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:37 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:37.727582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:37.728185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:37.734478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.734970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.735743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.736504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.737107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.737734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.820691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:37.829096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4893c7d1-71b3-445c-ba75-367997307398 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1272 microversion: 2.1 time: 0.105027 Aug 24 01:58:37.829908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1220/2212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:37 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:37.834435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45203475-6935-4332-9d44-c7899cc57567 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912ca1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:37.882329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45203475-6935-4332-9d44-c7899cc57567 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.051313 Aug 24 01:58:37.883083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1221/2213] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:37 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:37.887690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:37.888338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:37.900490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.901543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.902160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:37.903425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:37.904237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:37.904933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:38.382029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:38.391696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e165a36e-7692-4e71-9c29-54029ff74a3d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.507410 Aug 24 01:58:38.406670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1222/2214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:37 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:38.416762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:38.417635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:38.424083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:38.424568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:38.425106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:38.425817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:38.426964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:38.427925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:38.686912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:38.696536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a159529-085d-4eb7-89e6-49adc0d42d2d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.288668 Aug 24 01:58:38.697879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1223/2215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:38 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:38.704229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:38.705208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:38.718327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:38.718847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:38.719301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:38.724848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:38.725755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:38.726649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:38.942081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:38.954241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b073bcfb-7476-4615-881c-5838900848dd tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.252614 Aug 24 01:58:38.956035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1224/2216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:38 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:38.994550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:38.995252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:39.005483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.016643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.017518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.018633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.019409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.020061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.245145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.256656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:39.261528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88e22e47-e91a-4862-976f-9e6d4de9c71e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.286488 Aug 24 01:58:39.264776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1225/2217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:38 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:39.271716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:39.272793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:39.287233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.288438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.289242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.290330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.291066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.292264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.493675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.505267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59bdc11c-ddec-42c7-b253-8995f88db541 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.237910 Aug 24 01:58:39.506162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1226/2218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:39 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:39.521216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:39.521985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:39.534871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.537293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.537866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.538697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.540429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.543226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.703766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.713766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.715567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.716906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca078ee0-803e-49af-a0e4-2188bac9bfd4 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.209644 Aug 24 01:58:39.717961 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1227/2219] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:39 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:39.722831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:39.723565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:39.729949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.730554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.731096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.732055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:39.732620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:39.733241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:39.891372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:39.900179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cef34c2-d192-45f0-a6c8-fdd2fe6af854 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.181026 Aug 24 01:58:39.901783 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1228/2220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:39 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:39.906961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d728564-c3c8-40f0-b355-f0d686dab09e tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91318dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:39.969475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d728564-c3c8-40f0-b355-f0d686dab09e tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.064084 Aug 24 01:58:39.969475 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1229/2221] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:39 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:39.976020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:39.978664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 250b1722-586c-4c11-9d7b-50b648ffa306] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:40.006302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/250b1722-586c-4c11-9d7b-50b648ffa306/action HTTP/1.1 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 65 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '250b1722-586c-4c11-9d7b-50b648ffa306', 'body': {'rebuild': {'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5'}}} Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 24 01:58:40.008051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 250b1722-586c-4c11-9d7b-50b648ffa306 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:40.012685 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f01ca595-9c42-4f61-bd82-ca8b39e07ab2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/250b1722-586c-4c11-9d7b-50b648ffa306/action" status: 404 len: 111 microversion: 2.1 time: 0.039459 Aug 24 01:58:40.013891 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1230/2222] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:39 2022] POST /compute/v2.1/servers/250b1722-586c-4c11-9d7b-50b648ffa306/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:40.018481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:40.019825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:40.034093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.035412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.036605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.037715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.038413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.039072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.263771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:40.276976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d9d06bb-d68e-49b8-8e4d-fa1b564e3131 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.262398 Aug 24 01:58:40.277870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1231/2223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:40 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:40.285284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:40.286701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:40.299072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.301444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.301929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.302689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.303165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.303599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.518386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:40.528303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f706196-01c8-4710-a366-4ec0af89b8e9 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.245981 Aug 24 01:58:40.528303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1232/2224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:40 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:40.533857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:40.534471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:40.540633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.541145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.541582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.542367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.542943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.543369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.737835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:40.758357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05f6d578-360f-4d0d-93ba-2f2e80e98851 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.228828 Aug 24 01:58:40.760575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1233/2225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:40 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:40.782082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:40.782082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:40.782082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.782082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.782795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.783417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:40.783987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:40.784288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:40.990808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.003770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c52765b4-c40e-4475-995e-d579413d0420 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.241469 Aug 24 01:58:41.004873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1234/2226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:40 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:41.009641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:41.010439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:41.013503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:41.023041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.023546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.023989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.024705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.025186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.025625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.312609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.329773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.335607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.338239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e17db823-a0cc-40c5-84ec-ecac746cd12e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.332210 Aug 24 01:58:41.339069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1235/2227] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:41 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:41.346151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:41.347107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:41.368596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.370648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.371182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.371977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.375249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.381225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.672030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.685900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b550ac68-9f21-4913-9c51-2342cd876bba tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.344753 Aug 24 01:58:41.687960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1236/2228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:41 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:41.694807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:41.695719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:41.709252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.710613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.711118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.712341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:41.712857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:41.713313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:41.943219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:41.953705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b76daa9-7ea7-413f-8476-b5f37d0c760b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.263731 Aug 24 01:58:41.967400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1237/2229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:41 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:41.974316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0b292a8-1bc0-49bc-95bd-9cf5103e438f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913ee430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:42.049010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0b292a8-1bc0-49bc-95bd-9cf5103e438f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.078818 Aug 24 01:58:42.056437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1238/2230] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:41 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:42.056437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a228e2c0-b381-4ac3-b084-82e5367511a6", "name": "network-vif-plugged", "status": "completed", "tag": "f819dab9-06c6-4c08-b91b-a1a339a95bb2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:42.074583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.075071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.075506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.092325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] Creating event network-vif-plugged:f819dab9-06c6-4c08-b91b-a1a339a95bb2 for instance a228e2c0-b381-4ac3-b084-82e5367511a6 on n-h1-854121-3 Aug 24 01:58:42.099082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bece2513-adeb-44d3-bc7b-806532dd391f req-4530f8a9-cb6f-42ea-b17b-45397d754aec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047505 Aug 24 01:58:42.099693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1239/2231] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:42.104944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:42.105658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:42.113431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.114506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.115137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.117238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.117502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.118311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.459052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:42.471931 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22ed8851-8a2a-4868-9cbf-502dcf399897 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.370591 Aug 24 01:58:42.476324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1240/2232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:42 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:42.486345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:42.489396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:42.509689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.510481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.511282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.512182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.512913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.513511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.746004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:42.758599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02309da9-f1de-4f25-8876-da27ba9a43b7 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.280482 Aug 24 01:58:42.759474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1241/2233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:42 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:42.766368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:42.766896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:42.777138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074/action HTTP/1.1 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: {"restore": {}} Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074', 'body': {'restore': {}}} Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:42.779633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-479d2a2c-19aa-4741-bc06-b41df45bf81d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074/action" status: 404 len: 111 microversion: 2.1 time: 0.020460 Aug 24 01:58:42.785959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1242/2234] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:42 2022] POST /compute/v2.1/servers/5198baf0-a7c0-4b8e-a0ab-03f4ab0b8074/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:42.789867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:42.790939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:42.800606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.801144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.801586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:42.802309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:42.802762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:42.803187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.283413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.294941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7438aec-b470-4c33-b148-dde0b61f964e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.509203 Aug 24 01:58:43.295827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1243/2235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:42 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:43.302391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b722ee50-5b9c-4349-84b8-43caee2c5063", "tag": "28bd65b6-cd95-4982-b637-156eded8ee07"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:43.315200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.315782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.316460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.334880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] Creating event network-changed:28bd65b6-cd95-4982-b637-156eded8ee07 for instance b722ee50-5b9c-4349-84b8-43caee2c5063 on n-h2-854121-3 Aug 24 01:58:43.340997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c1034aed-e27b-48b7-bcaa-549b1762a65f req-1b05e343-3ddf-4be1-b69b-5f0c31172118 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043237 Aug 24 01:58:43.342767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1244/2236] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:43.348053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:43.348961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:43.356501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.357190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.357702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.358524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.359053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.359558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.529290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.538058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.539603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.540806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bf52844-32c5-4d7f-acfa-028e0f389099 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.197276 Aug 24 01:58:43.541944 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1245/2237] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:43 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:43.549697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:43.550336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:43.556912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.557534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.557965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.558669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.559115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.559550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.723756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.732544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cec28311-5de9-4a12-a915-9bccdb83d692 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.189349 Aug 24 01:58:43.734077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1246/2238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:43 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:43.738933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:43.741903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:43.746330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.747562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.747562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.748235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:43.749460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:43.750352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:43.916295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:43.918739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:43.927151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09b95518-57af-4369-963f-f5dc8d815e09 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.191709 Aug 24 01:58:43.940495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1247/2239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:43 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:43.948077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25b80e89-f0cd-4949-a2fa-263be8a2d631 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912e91f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.000613 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25b80e89-f0cd-4949-a2fa-263be8a2d631 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.058819 Aug 24 01:58:44.001409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1248/2240] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:43 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:44.006241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.006849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.016051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.016633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.017292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.018090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.018548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.018992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.171830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:44.198206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e05c791-4875-4044-888b-9df3195c1fc8 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1317 microversion: 2.1 time: 0.195462 Aug 24 01:58:44.211668 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1249/2241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:44 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:44.216655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.217327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.236098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.236515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.236982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.237694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.238150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.238576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.423859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:44.435521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6430de14-04f0-4cc1-bdc7-6fc04c5e34aa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.222624 Aug 24 01:58:44.437195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1250/2242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:44 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:44.442583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.443199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.451842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.452372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.452840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.453736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.454197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.454622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.641155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:44.655765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52dfdd58-2700-4326-841b-9daa24c7fac1 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.214040 Aug 24 01:58:44.656897 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1251/2243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:44 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:44.662949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.663766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.671689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.672111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.672550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.673276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.673761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.674176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.840898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:44.849113 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe3ea178-11db-4064-9eeb-d970962a00df tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.191155 Aug 24 01:58:44.849676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1252/2244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:44 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:44.868653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:44.869246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.879732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.880219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.880652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.881447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.881904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.882323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.909008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'restore' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: {"restore": {}} Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'restore' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'restore': {}}} Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state active. Cannot restore while the instance is in this state. Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:44.911352 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'restore' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b14e2ce8-75b1-4634-a7c9-6667c22430f0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 145 microversion: 2.1 time: 0.048379 Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1253/2245] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:44 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 145 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:44.920068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:44.925928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.926403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.926948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.927821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:44.928377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:44.929003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:44.946722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:44.977547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=34 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:45.089165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.099933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.102234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.103854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4ec795e-91cf-4f3e-a55c-5dd8a9e7e231 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.189116 Aug 24 01:58:45.104633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1254/2246] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:44 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:45.110133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aeced63-b65a-4093-9bd2-e41114150cd3", "name": "network-vif-plugged", "status": "completed", "tag": "57670ca8-2837-4bc3-bc78-704d5acd1b46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:45.121688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.122161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.122594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.137427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] Creating event network-vif-plugged:57670ca8-2837-4bc3-bc78-704d5acd1b46 for instance 1aeced63-b65a-4093-9bd2-e41114150cd3 on n-h2-854121-3 Aug 24 01:58:45.142749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-20ff8890-13d0-4574-b067-e773881cbcbb req-a71d3a97-ce0b-46a8-87c3-2132b9a1bd82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Aug 24 01:58:45.143359 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1255/2247] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:45.148751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:45.149458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:45.157434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.157965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.158411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.159139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.159584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.160010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.327332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.338682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-827aef95-f260-4b0c-8951-efd933bd51ad tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.193950 Aug 24 01:58:45.339607 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1256/2248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:45 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:45.344692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:45.345662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:45.357292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.360143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.360826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.361762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.362299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.365529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.575488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.590987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-310cca47-c808-49b7-b374-560b8ec2c72a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.249601 Aug 24 01:58:45.609695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1257/2249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:45 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:45.625637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1d850a2-9334-45fa-b7f5-83be59677b53 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913381f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:45.700942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1d850a2-9334-45fa-b7f5-83be59677b53 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.086989 Aug 24 01:58:45.713933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1258/2250] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:45 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:45.720441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:45.721890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:45.730591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.731450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.732339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.733368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.733961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.734941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.909720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:45.921709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fab13d4-4452-4603-896e-bdc33c129ee6 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1467 microversion: 2.1 time: 0.206046 Aug 24 01:58:45.922550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1259/2251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:45 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1467 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:45.930760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:45.931368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:45.942799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.943406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.944231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:45.945079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:45.945602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:45.946102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.097394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.105866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0efbe071-fde7-4c65-8597-e1e3c7e428d5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.182250 Aug 24 01:58:46.106740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1260/2252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:45 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:46.111262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:46.111852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.119525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.120112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.120630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.122518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.122518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.122766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.272228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.281169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60827634-5364-4a0a-9087-1cb934b477df tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.173597 Aug 24 01:58:46.281969 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1261/2253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:46 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:46.286797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:46.287512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.294060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.294655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.295159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.296568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.297137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.297648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.547309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.559767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f494a667-728f-4027-acbf-72aed9325724 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.276458 Aug 24 01:58:46.560381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1262/2254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:46 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:46.564978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:46.565591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.574841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.575226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.575800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.577436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.577614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.578264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.726232 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d87c8fe-2f04-4f64-bcc8-79fe575a7c6c tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1618 microversion: 2.1 time: 0.164715 Aug 24 01:58:46.726920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1263/2255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:46 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1618 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:46.732013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:46.732970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.739629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.740263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.740846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.742129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.745341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.745893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.907471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.916997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.918715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:46.919750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47c4d13c-ff81-4853-8d0c-b5b7c9dfe852 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.191778 Aug 24 01:58:46.920297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1264/2256] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:46 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:46.925242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:46.925854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: efaf99a9-d3f9-4ce8-a176-982e4f62f136] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.932638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/efaf99a9-d3f9-4ce8-a176-982e4f62f136/action HTTP/1.1 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: {"resume": {}} Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'efaf99a9-d3f9-4ce8-a176-982e4f62f136', 'body': {'resume': {}}} Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:46.933148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance efaf99a9-d3f9-4ce8-a176-982e4f62f136 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95c72efe-5581-49e9-8ab6-12338d5f1f6c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/efaf99a9-d3f9-4ce8-a176-982e4f62f136/action" status: 404 len: 111 microversion: 2.1 time: 0.013297 Aug 24 01:58:46.940306 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1265/2257] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:46 2022] POST /compute/v2.1/servers/efaf99a9-d3f9-4ce8-a176-982e4f62f136/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:46.944837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:46.945450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:46.953239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.953748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.954185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:46.955126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:46.955654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:46.956030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:47.179913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:47.202491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3add9fe6-9ecf-490b-80af-a19480bf96cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.260864 Aug 24 01:58:47.219074 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1266/2258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:46 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:47.224230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5138652f-b9bc-4e9a-9d35-f8f882a99882 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91338310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:47.301234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5138652f-b9bc-4e9a-9d35-f8f882a99882 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.080575 Aug 24 01:58:47.302951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1267/2259] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:47 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:47.308090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1417612987", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["958ebf3c-bb2f-4596-bc40-d6335ff442ba"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:47.369588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:58:47.622469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:58:47.623170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:58:47.625096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:58:47.625790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:58:47.626232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:58:47.638618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:47.639154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:47.639755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:47.640594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:47.641222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:47.641665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:47.666530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:58:47.673518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:58:47.690863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:58:47.693273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:58:47.743226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3f71894-d7a4-4b25-8e97-9b3bdac84ece tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439286 Aug 24 01:58:47.744520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1268/2260] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:58:47.750983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:47.760170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:47.775564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:47.776544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:47.777196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:47.778110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:47.778739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:47.779341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.066025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.082493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cd9b925-105e-47ce-90dc-e8b38ce31888 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.336331 Aug 24 01:58:48.084920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1269/2261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:47 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:48.090278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7999602-8784-4cf5-ac70-92a84c698b78", "name": "network-vif-plugged", "status": "completed", "tag": "ebbff98b-6ec6-461e-b8f1-59dccdf78022"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:48.111671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.112151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.112610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.129435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:48.131765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] Creating event network-vif-plugged:ebbff98b-6ec6-461e-b8f1-59dccdf78022 for instance f7999602-8784-4cf5-ac70-92a84c698b78 on n-h2-854121-3 Aug 24 01:58:48.137287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9cc20506-2066-42c3-b492-654a2dda6857 req-a45e2fe8-cc70-4eca-a501-d431d5785557 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052837 Aug 24 01:58:48.137898 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1270/2262] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:48.143934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:48.144491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:48.152780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.152780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.152780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.153681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.153681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.154141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.412634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.426610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92ede587-dc32-4876-8a51-f4af1c4c53ad tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1403 microversion: 2.1 time: 0.286866 Aug 24 01:58:48.427772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1271/2263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:48 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1403 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:48.434807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:48.435293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:48.444807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.445438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.446022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.446814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.447529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.448032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.607983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.618193 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdaae071-3eae-4344-a322-aa61092d80be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.188795 Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1272/2264] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:48 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.631888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.632613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.633036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.633460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.706797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.715112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7863d472-2111-4a37-a830-2b4253f2f1c7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1213 microversion: 2.1 time: 0.095245 Aug 24 01:58:48.719559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1273/2265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:48 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:48.728087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:48.728788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:48.735203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.735709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.736155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.737090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.737656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.738055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.916209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.928547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.931176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:48.932968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2b23521-0759-41eb-a076-d0e3428a3397 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.212549 Aug 24 01:58:48.946121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1274/2266] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:48 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:48.946121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:48.946121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:48.953333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.954217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.954723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:48.955595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:48.956100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:48.956566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.151723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:49.163981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0c80c81-1f22-4fa1-bce7-9d4ff1d3a22d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.229171 Aug 24 01:58:49.177370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1275/2267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:48 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:49.192222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:49.197852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:49.209357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.210485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.210954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.212233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.212750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.213266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.461050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:49.470428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3288cd88-7165-4a9b-a720-4a936b38d636 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.291514 Aug 24 01:58:49.471197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1276/2268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:49 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:49.477558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-189a002e-2286-4787-aecb-ddd47d67edbe tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912e6f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:49.527420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-189a002e-2286-4787-aecb-ddd47d67edbe tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1453 microversion: 2.1 time: 0.055007 Aug 24 01:58:49.535378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1277/2269] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:49 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:49.540862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:49.541416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:49.548604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.549746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.550243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.550933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.551395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.551841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.579467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'resume' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: {"resume": {}} Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'resume' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'resume': {}}} Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state active. Cannot resume while the instance is in this state. Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:49.581095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:49.585837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'resume' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:49.597371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb17a6ff-eb13-4680-a2f8-4bea9c6022e7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 144 microversion: 2.1 time: 0.060429 Aug 24 01:58:49.602397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1278/2270] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:49 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 01:58:49.607378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:49.608058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:49.647240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.647784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.648289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.649691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.650166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.650599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.900443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:49.920957 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75f552a4-f761-4771-9b2b-d398e4529fdb tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1589 microversion: 2.1 time: 0.317211 Aug 24 01:58:49.923166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1279/2271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:49 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1589 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:49.932476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:49.933126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:49.961224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.961742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.962200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:49.962980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:49.966803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:49.966803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.263787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:50.278012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cff1c68e-f47e-47d6-88fe-f0d79c9bfac1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.352266 Aug 24 01:58:50.289867 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1280/2272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:49 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:50.290853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:50.295732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:50.324001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.324237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.324758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.325703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.326083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.333196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.538256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:50.551329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8be32a16-3c5d-4588-a85a-58908675dc5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1199 microversion: 2.1 time: 0.269183 Aug 24 01:58:50.556765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1281/2273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:50 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1199 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:50.564438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:50.565876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:50.578576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.579172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.579519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.580682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.581187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.581291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.676514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:50.686661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2adc3407-fcda-455f-85e0-ea6cc1e7b689 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1275 microversion: 2.1 time: 0.131353 Aug 24 01:58:50.687695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1282/2274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:50 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1275 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:50.692765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:50.693805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:50.699903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:50.702606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.703546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.704290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.705233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.705860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.706449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.821966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df5ec921-2b1e-4e62-a48c-a67c44158bca tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132752 Aug 24 01:58:50.822937 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1283/2275] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 01:58:50 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:50.828455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:50.829059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:50.835438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.835934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.836371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:50.837114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:50.837575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:50.838046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:51.226362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:51.261593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:51.265074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:51.266313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ab7620e-ac4e-4456-a7a0-7cb28d551761 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.442368 Aug 24 01:58:51.289761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1284/2276] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:50 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:51.303736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:51.306819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:51.318927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:51.319912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:51.321277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:51.336632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:51.338710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:51.340106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.043034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:52.050967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25e800b6-3551-4e4d-a01a-eb8942d3bb0c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.759923 Aug 24 01:58:52.080513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1285/2277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:51 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:52.101198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3effb318-d8d0-4d2c-80e1-18f95a4a9151", "name": "network-vif-unplugged", "status": "completed", "tag": "8a5a216a-6187-4d02-9bea-0ba1be5be92a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:52.125079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.125567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.126020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.156149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] Creating event network-vif-unplugged:8a5a216a-6187-4d02-9bea-0ba1be5be92a for instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 on n-h1-854121-3 Aug 24 01:58:52.171818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c5c488d1-399a-4c47-a567-d36eb7a6eada req-6b33051e-70cc-44e5-bbbd-319abfb9b42e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080284 Aug 24 01:58:52.175606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1286/2278] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:52.190995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:52.191753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:52.204701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.205574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.206209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.207113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.207914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.208702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.512171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:52.521603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8df244e-111e-47aa-845a-c2ba56f5431b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.344729 Aug 24 01:58:52.535283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1287/2279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:52 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:52.535283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cde18903-aafa-4145-9ee6-6cfbc2192eb9 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912e6d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:52.588284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cde18903-aafa-4145-9ee6-6cfbc2192eb9 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1462 microversion: 2.1 time: 0.060268 Aug 24 01:58:52.589057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1288/2280] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:52 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1462 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:52.596907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:52.598165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:52.605375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.606560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.607240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.608742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.609983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.610849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.891044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:52.910387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1022e3d-f0b5-484b-a91b-fe94510703b1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1381 microversion: 2.1 time: 0.320210 Aug 24 01:58:52.911216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1289/2281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:52 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1381 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:52.916526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:52.917375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:52.924982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.925706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.926314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:52.927246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:52.927858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:52.928451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.216258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:53.219649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:53.226621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14a3121b-ab1d-4a16-b63e-034a7b5a1291 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.314197 Aug 24 01:58:53.227213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1290/2282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:52 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:53.245663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52b91508-7825-4e69-969e-bba49e45ecd5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52b91508-7825-4e69-969e-bba49e45ecd5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 160 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "123baaa0-ecb4-444d-bb74-daf968f733de"}]}} Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': '', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'networks': [{'uuid': '123baaa0-ecb4-444d-bb74-daf968f733de'}]}}} Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '' Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 01:58:53.250020 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52b91508-7825-4e69-969e-bba49e45ecd5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52b91508-7825-4e69-969e-bba49e45ecd5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.022386 Aug 24 01:58:53.256058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1291/2283] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:58:53 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:58:53.260022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:53.260638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:53.268024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.268514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.269065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.269765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.270223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.270865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.473801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:53.483814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:53.485442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:53.486694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-805a930e-f75d-4efe-8c3d-721c1c314a10 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.230512 Aug 24 01:58:53.496801 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1292/2284] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:53 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:53.496801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c91076f8-66df-4265-8eab-5343344a59e9 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91375b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:53.541419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c91076f8-66df-4265-8eab-5343344a59e9 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 200 len: 1462 microversion: 2.1 time: 0.052990 Aug 24 01:58:53.542463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1293/2285] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:53 2022] GET /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 1462 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:53.548173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b722ee50-5b9c-4349-84b8-43caee2c5063", "name": "network-vif-plugged", "status": "completed", "tag": "28bd65b6-cd95-4982-b637-156eded8ee07"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:53.558039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.558787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.559530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.571358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] Creating event network-vif-plugged:28bd65b6-cd95-4982-b637-156eded8ee07 for instance b722ee50-5b9c-4349-84b8-43caee2c5063 on n-h2-854121-3 Aug 24 01:58:53.576794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fdf85e30-b052-41b5-af56-6adb8ed27564 req-8e6a5afa-9edf-4b3f-bd72-944a1b02d62d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Aug 24 01:58:53.577340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1294/2286] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:53.741505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:53.742362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:53.750476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.751264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.752050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.752996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.753447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.754476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.975821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbce4633-581c-4872-975a-7b8ea6268d26 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1532 microversion: 2.1 time: 0.396889 Aug 24 01:58:53.976707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1295/2287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:53 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1532 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:53.981590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:53.982396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:53.989001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.989489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.990012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:53.990883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:53.991292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:53.991720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.161357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:54.169819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-255431ce-da3e-4fbb-81a6-e4321172595b tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1589 microversion: 2.1 time: 0.191691 Aug 24 01:58:54.171004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1296/2288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:53 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1589 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:54.179415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aeced63-b65a-4093-9bd2-e41114150cd3", "tag": "57670ca8-2837-4bc3-bc78-704d5acd1b46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:54.190258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.190742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.191180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.204372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] Creating event network-changed:57670ca8-2837-4bc3-bc78-704d5acd1b46 for instance 1aeced63-b65a-4093-9bd2-e41114150cd3 on n-h2-854121-3 Aug 24 01:58:54.209734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d41fcff5-e346-478e-b6ce-7743eacd1465 req-1b21098b-cabb-46cb-9f90-a39228d071e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034051 Aug 24 01:58:54.210751 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1297/2289] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:54.216231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:54.217014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:54.223541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.224034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.224473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.225216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.225677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.226108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.362800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:54.370661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cff6155-f416-4fb7-a99f-919b8b7abeed tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.158757 Aug 24 01:58:54.371244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1298/2290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:54 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:54.376647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:54.377271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:54.384980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.386014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.386868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.388109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.388468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.388973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.518303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:54.525976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f4a36aa-104c-4eb6-9387-f2656a520012 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.153461 Aug 24 01:58:54.526544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1299/2291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:54 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:54.531460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:54.532057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:54.537580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.538055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.538487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.539175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.539623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.540044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.670301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:54.678652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0553de87-be8c-48ef-908a-b67707cf8d06 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1466 microversion: 2.1 time: 0.151170 Aug 24 01:58:54.679224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1300/2292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:54 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:54.683402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:54.684002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:54.689588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.690075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.690511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.691197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.691649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.692073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.818247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40dc65f4-16f2-4b8f-9fdc-4faa74cf995f tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1532 microversion: 2.1 time: 0.138007 Aug 24 01:58:54.819082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1301/2293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:54 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1532 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:54.823302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3effb318-d8d0-4d2c-80e1-18f95a4a9151", "tag": "8a5a216a-6187-4d02-9bea-0ba1be5be92a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:54.832871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.833339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.833764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.845006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] Creating event network-changed:8a5a216a-6187-4d02-9bea-0ba1be5be92a for instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 on n-h1-854121-3 Aug 24 01:58:54.850004 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3027f182-b24f-4e8b-aea4-2fb107cac849 req-56efd38b-1918-4086-883d-743f029f7f41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029840 Aug 24 01:58:54.850570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1302/2294] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:54.855303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:54.855977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:54.861765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.862235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.862660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.863323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:54.863770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:54.864184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:54.995199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.002759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46a831d0-cd0c-4fc4-93f3-790974eb5c52 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.151097 Aug 24 01:58:55.003322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1303/2295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:54 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:55.007604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:55.008206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.014237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.014719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.015149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.015827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.016277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.016696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.144253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.151885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11cb115b-bc24-452a-94b0-df7b014b25b5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.147630 Aug 24 01:58:55.152451 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1304/2296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:55 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:55.157742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:55.158417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.163923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.164409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.164959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.165643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.166100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.166528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.303381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.312062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.313540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.314707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff0d2f7c-a371-4dca-8d0d-020b66acc5f6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.161310 Aug 24 01:58:55.315272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1305/2297] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:58:55 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:58:55.324709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1594658903"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:55.327788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.333712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.334204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.334634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.335321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.335773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.336206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.520152 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-034e459a-9803-4c05-9d3e-6b96ec836ac0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "POST /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2/action" status: 202 len: 0 microversion: 2.1 time: 0.199617 Aug 24 01:58:55.520810 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1306/2298] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:55 2022] POST /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 01:58:55.525579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:55.528124 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 01:58:55.528124 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 01:58:55.529298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.529781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.530217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.530935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.531384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.531805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.556934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-661b54cf-9cbf-4a0b-9347-e6b9c7ede6c1 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034925 Aug 24 01:58:55.557530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1307/2299] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 01:58:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:58:55.562059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:55.562687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: f6b07f0b-0da0-485d-b751-374f84d0adaa] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.569443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/f6b07f0b-0da0-485d-b751-374f84d0adaa/action HTTP/1.1 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: {"shelve": {}} Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f6b07f0b-0da0-485d-b751-374f84d0adaa', 'body': {'shelve': {}}} Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:58:55.571218 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance f6b07f0b-0da0-485d-b751-374f84d0adaa could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-445ebbd5-fba2-4993-8b07-33a16489222b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/f6b07f0b-0da0-485d-b751-374f84d0adaa/action" status: 404 len: 111 microversion: 2.1 time: 0.014142 Aug 24 01:58:55.576906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1308/2300] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:55 2022] POST /compute/v2.1/servers/f6b07f0b-0da0-485d-b751-374f84d0adaa/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:58:55.577592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6035171-598e-4642-bd36-5ba412491c12 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913759d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:55.620040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6035171-598e-4642-bd36-5ba412491c12 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.045954 Aug 24 01:58:55.620609 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1309/2301] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:58:55 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:55.625598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:58:55.626201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.632362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.632877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.633315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.633998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.634451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.634878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.768439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:58:55.776667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25195b03-63c0-4bfa-8d07-db8a7869d161 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1314 microversion: 2.1 time: 0.155020 Aug 24 01:58:55.777500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1310/2302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:58:55 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:58:55.781762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-3", "block_migration": false, "disk_over_commit": false}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:58:55.784257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:58:55.790098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.790589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.791029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.791920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:58:55.792238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:58:55.792677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:58:55.819701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lazy-loading 'flavor' on Instance uuid f7999602-8784-4cf5-ac70-92a84c698b78 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:58:55.831418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Going to try to live migrate instance to n-h1-854121-3 {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 01:58:55.858642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:58:57.682254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:05.538117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:05.841687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=52 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:05.890888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:10.371164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a933e73c-b7f5-4bc6-90c0-f6dc9d257319 tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78/action" status: 202 len: 0 microversion: 2.1 time: 14.592775 Aug 24 01:59:10.371864 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1311/2303] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:58:55 2022] POST /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78/action => generated 0 bytes in 14594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:59:10.376653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:10.377280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:10.384896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.385323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.385749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.386435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.386954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.387443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.519828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:10.528329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32738460-d221-4b74-8901-0c88bb2f022f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.155555 Aug 24 01:59:10.528933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1312/2304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:10 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:10.533274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-unplugged", "status": "completed", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:10.542212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.542715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.543149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.555236 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] Creating event network-vif-unplugged:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 01:59:10.561757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c8596a09-b28f-46ce-bb39-ac7eea661693 req-30caf9a5-dc42-48d5-8750-1d9232be7984 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031732 Aug 24 01:59:10.562336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1313/2305] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:10.567786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:10.569151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:10.575566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.576222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.576745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.577547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.577995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.578413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.718302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:10.728300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0736c0b4-f4bb-42f8-9138-39fa7d017c0c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.163903 Aug 24 01:59:10.728300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1314/2306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:10 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:10.733210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6", "tag": "8f46be7f-0fa1-40c7-8815-fdf156f91ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:10.743672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.744152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.744865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.757319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] Creating event network-changed:8f46be7f-0fa1-40c7-8815-fdf156f91ac7 for instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 on n-h1-854121-3 Aug 24 01:59:10.762643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c2e73532-4ccc-48ed-aa61-89b785288d98 req-b625937d-70c2-4a27-ac04-1e3cf08b69a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Aug 24 01:59:10.763419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1315/2307] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:10.768788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:10.769610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:10.775986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.776472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.776945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:10.777642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:10.778098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:10.778527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:11.197376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:11.209816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:11.213741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:11.215720 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-193d9b42-c56f-4bfd-a38e-dd400496754c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1485 microversion: 2.25 time: 0.451034 Aug 24 01:59:11.216810 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1316/2308] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:10 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1485 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:11.224738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88ea393a-3103-434c-8cf4-6cf7ed9d00cb tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9125e8b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:11.293128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88ea393a-3103-434c-8cf4-6cf7ed9d00cb tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.074679 Aug 24 01:59:11.294095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1317/2309] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:11 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:11.299936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:11.300565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:11.316115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:11.316668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:11.317143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:11.317856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:11.318310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:11.319004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:11.704435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:11.714013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1580bbc-9003-4133-a3c3-a517a9107469 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1502 microversion: 2.1 time: 0.418624 Aug 24 01:59:11.714836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1318/2310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:11 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:11.719600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:11.720206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:11.727871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:11.728363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:11.728861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:11.729568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:11.730581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:11.730795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.172330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:12.185706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-798cf70e-b96a-43d8-bc59-74de945eff27 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.469722 Aug 24 01:59:12.186622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1319/2311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:11 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:12.193179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:12.194331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:12.202216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.203049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.203847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.205280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.205785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.206408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.726401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:12.736924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0d4d928-30d9-4374-83a0-302b223894c1 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.548964 Aug 24 01:59:12.739012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1320/2312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:12 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:12.757846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:12.758966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:12.779036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.779542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.780000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.780793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.781249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.781747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.890936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7af174f6-dd66-4c64-a274-9e92a65cbb39 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063/action" status: 202 len: 0 microversion: 2.1 time: 0.149406 Aug 24 01:59:12.892909 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1321/2313] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:59:12 2022] POST /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:59:12.901218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:12.902431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:12.909853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.910644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.911186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:12.912079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:12.912612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:12.913146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.098450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:13.106280 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a92b6119-00f6-45a6-96a2-ed1bc24393ad tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.212053 Aug 24 01:59:13.106888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1322/2314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:12 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:13.111430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:13.112041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:13.118680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.119168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.119606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.120300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.120806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.121236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.340737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:13.350352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:13.352127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:13.353857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49ab5a74-4590-4a4e-b7c5-58e5adf6bc6f tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1475 microversion: 2.25 time: 0.246032 Aug 24 01:59:13.368748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1323/2315] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:13 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:13.411971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bb47bf8-7e1c-4b13-ae90-ee3a5b9fb1dc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9126d1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:13.452806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bb47bf8-7e1c-4b13-ae90-ee3a5b9fb1dc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.083656 Aug 24 01:59:13.460550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1324/2316] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:13 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:13.465512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6", "name": "network-vif-plugged", "status": "completed", "tag": "8f46be7f-0fa1-40c7-8815-fdf156f91ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:13.476037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.476523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.477002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.488960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] Creating event network-vif-plugged:8f46be7f-0fa1-40c7-8815-fdf156f91ac7 for instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 on n-h1-854121-3 Aug 24 01:59:13.493976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-52fc89f9-1d57-4483-80df-e92f3a9ef752 req-614e93eb-10f1-4d88-9167-15d2c9351f45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Aug 24 01:59:13.494585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1325/2317] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:13.501501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:13.502128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:13.509439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.510103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.510367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.511067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.511521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.511953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.536989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'flavor' on Instance uuid 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:13.762057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ba9061e-b7d8-4870-8794-db3e15fc255f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.265269 Aug 24 01:59:13.763233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1326/2318] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:59:13 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:59:13.768867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:13.769562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:13.775972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.776646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.777278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.778123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.778717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.779276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.926974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:13.935052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96f0114e-f3a0-4a75-bacb-3d6f573674fc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1487 microversion: 2.1 time: 0.170450 Aug 24 01:59:13.936154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1327/2319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:13 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1487 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:13.941282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:13.943308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:13.952390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.953025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.953677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:13.954933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:13.955547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:13.956033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.175511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:14.185735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-024a5b0c-0f1a-41b1-a9e0-8092099cf530 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.248203 Aug 24 01:59:14.197208 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1328/2320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:13 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:14.202108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5da8be0-cfe5-4296-8e2e-e4d9fd45233c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '.version_select at 0x7f6b9125aaf0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.205829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5da8be0-cfe5-4296-8e2e-e4d9fd45233c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.206314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5da8be0-cfe5-4296-8e2e-e4d9fd45233c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.206753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5da8be0-cfe5-4296-8e2e-e4d9fd45233c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.218657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5da8be0-cfe5-4296-8e2e-e4d9fd45233c tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 3873 microversion: 2.25 time: 0.020370 Aug 24 01:59:14.219421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1329/2321] 10.222.0.49 () {60 vars in 1184 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/os-migrations => generated 3873 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:14.223578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.224188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:14.232135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.232629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.233099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.233803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.240694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.240694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.240694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:14.374264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:14.382704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19ee1f6b-7e28-43ab-9251-89c588d04eab tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.162512 Aug 24 01:59:14.383271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1330/2322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:14.402251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.402759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:14.409055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.409552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.409998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.410708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.411169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.411615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.442425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:14.528689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34e49b6c-9584-4ef1-8ae0-955885ea1162 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 204 len: 0 microversion: 2.1 time: 0.144108 Aug 24 01:59:14.529762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1331/2323] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:59:14 2022] DELETE /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:59:14.535851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.536842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:14.543217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.543708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.544146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.544889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.545338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.545761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.684847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:14.692901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-371b27f3-ca82-497d-af99-66d050570e38 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.161654 Aug 24 01:59:14.693415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1332/2324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:14.697964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.698566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:14.704233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.704755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.705195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.705890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.706343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.706767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.832450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] Lazy-loading 'services' on Instance uuid 3effb318-d8d0-4d2c-80e1-18f95a4a9151 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:14.846324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a22a66df-32b5-46dd-bc8a-b8dbdb068570 tempest-LiveAutoBlockMigrationV225Test-160871736 tempest-LiveAutoBlockMigrationV225Test-160871736-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1965 microversion: 2.25 time: 0.151609 Aug 24 01:59:14.846912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1333/2325] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1965 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:14.851833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95483ee4-2990-4b1f-bbcb-c2f1a08880cb tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913759d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.899399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95483ee4-2990-4b1f-bbcb-c2f1a08880cb tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.051422 Aug 24 01:59:14.899967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1334/2326] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:14.904420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:14.905058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:14.911670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.912151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.912586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:14.913312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:14.913755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:14.914180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.046898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.054800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6b1304b-9013-474b-ac21-5aa108c3e8aa tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1493 microversion: 2.1 time: 0.153896 Aug 24 01:59:15.055369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1335/2327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:14 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1493 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:15.068654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.069599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:15.075622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.076102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.076545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.077254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.077716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.078138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.104077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:15.178898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0075be88-70a0-4c06-8033-bcdbed22050a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 204 len: 0 microversion: 2.25 time: 0.122036 Aug 24 01:59:15.179492 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1336/2328] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:59:15 2022] DELETE /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:59:15.187819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.188513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:15.195545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.196030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.196467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.197243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.197648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.198108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.352874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.362242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.364502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.366542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-481e5eee-6207-4739-8d68-86bb151938c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1481 microversion: 2.25 time: 0.181857 Aug 24 01:59:15.367116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1337/2329] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:15 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1481 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:59:15.376949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.376949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:15.379666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.380154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.380595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.381322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.381781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.382209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.526806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.536090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84f824f1-275d-4a2c-ad81-601a0fae860c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.167244 Aug 24 01:59:15.536795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1338/2330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:15 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:15.541419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.542025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:15.548388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.548917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.549378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.550063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.550513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.551509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.690496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.698645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ada2251-8697-4f69-980e-21696a9fd912 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.160777 Aug 24 01:59:15.699238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1339/2331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:15 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:15.703595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2", "name": "network-vif-plugged", "status": "completed", "tag": "d0a66c9a-177b-4812-a22e-2e9332494459"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:15.714209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.714687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.715120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.726921 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] Creating event network-vif-plugged:d0a66c9a-177b-4812-a22e-2e9332494459 for instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 on n-h2-854121-3 Aug 24 01:59:15.732359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ebb7d60d-2ef2-4a25-9922-d57b2e5bd389 req-2a22ea36-7833-4b32-9ee3-5cd00e361fff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031900 Aug 24 01:59:15.732993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1340/2332] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:15.738072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.738805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:15.745548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.746031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.746473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.747166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:15.747661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:15.748107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:15.907161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:15.915915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fc1587b-3437-4254-8b3b-4f97b241853b tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1317 microversion: 2.1 time: 0.181776 Aug 24 01:59:15.916498 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1341/2333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:15 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:15.921043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad9f5fbc-01f2-4f3a-b499-8a5864edbada tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91280820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:15.970001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad9f5fbc-01f2-4f3a-b499-8a5864edbada tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.052388 Aug 24 01:59:15.970905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1342/2334] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:15 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:16.075771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:16.076693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:16.083686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.084291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.084875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.085640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.086171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.086674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.251786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.262583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c5119f5-26d8-4f0f-9d67-dea359aeb7b4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1493 microversion: 2.1 time: 0.190615 Aug 24 01:59:16.263435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1343/2335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:16 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1493 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:16.392862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:16.393608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:16.400842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.401464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.402049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.402870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.403583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.404426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.545257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.554410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.556183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.557503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a48334b-143e-4a3c-8feb-17fdc80cde1b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1481 microversion: 2.25 time: 0.169749 Aug 24 01:59:16.558189 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1344/2336] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:16 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1481 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:59:16.562943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:16.563561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:16.569987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.570546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.570917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.571889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.572324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.572791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.713888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.717498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:16.722743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9c321d8-5031-43ec-8c11-a06405271625 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.163565 Aug 24 01:59:16.723489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1345/2337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:16 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:16.729121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:16.729711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:16.736524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.737064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.737596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.738904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.739338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.739762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.873070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:16.880867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b162f821-3ace-4f1a-9451-e9ecfc017636 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.156572 Aug 24 01:59:16.881454 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1346/2338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:16 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:16.885862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:16.886471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:16.892310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.892842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.893296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:16.893980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:16.894435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:16.894938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.086855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:17.096276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:17.098323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:17.099583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2609ba75-4242-461f-8a45-8d3c4194188b tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 2944 microversion: 2.32 time: 0.217196 Aug 24 01:59:17.100177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1347/2339] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:16 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 2944 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:17.104803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:17.105402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:17.111324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.111801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.112236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.112948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.113976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.114397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.261013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:17.270393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d271fc21-5412-4927-a825-26c6c80fb81f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1466 microversion: 2.1 time: 0.168350 Aug 24 01:59:17.271040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1348/2340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:17 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:17.275792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01f46075-4bf0-426b-af77-551bfdc42e17 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91239820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:17.324997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01f46075-4bf0-426b-af77-551bfdc42e17 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.052683 Aug 24 01:59:17.325697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1349/2341] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:17 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:17.330518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:17.331014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:17.338245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.341268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.341268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.341268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.341268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.341268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.715374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-614d5c49-cc40-4a2c-b134-4c808707b97f tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.388379 Aug 24 01:59:17.716625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1350/2342] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 01:59:17 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300/os-interface => generated 1830 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:17.725660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:17.725660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:17.728138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.728699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.729262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.730031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.730554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.731048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.864195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:17.872215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0da66bee-06ba-445a-980d-63db936319c4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1493 microversion: 2.1 time: 0.154378 Aug 24 01:59:17.872811 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1351/2343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:17 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1493 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:17.877217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:17.877822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:17.884526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.886381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.886381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:17.886381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:17.886920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:17.887338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.018489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ac3c138-0633-45dc-9ec1-4a8f761c0cfc tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1617 microversion: 2.1 time: 0.144604 Aug 24 01:59:18.019054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1352/2344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:17 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1617 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:18.024079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:18.024079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:18.029766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.030260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.030711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.031404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.032707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.033334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.172521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:18.181548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:18.183029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:18.184202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e680a7c5-8507-4f0d-bb46-ca146fe17ba0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1481 microversion: 2.25 time: 0.164222 Aug 24 01:59:18.190338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1353/2345] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:18 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1481 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:18.190338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:18.190338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:18.199181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.199793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.200247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.200993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.201453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.201889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.336962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:18.345132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-644e8455-00d6-4bdd-8eaa-e1519b2b01fb tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.159336 Aug 24 01:59:18.345726 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1354/2346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:18 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:18.350965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:18.351685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:18.357594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.358090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.358538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.359243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.359700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:18.360217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:18.496367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:18.504070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf3fce31-8a2f-46fd-a0d4-c915b0edfea6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.157428 Aug 24 01:59:18.504637 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1355/2347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:18 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:18.509556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-815384576", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "958ebf3c-bb2f-4596-bc40-d6335ff442ba"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:18.563307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:59:18.978701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:59:18.979124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:59:18.979596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:59:18.980004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:59:18.980417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:59:18.996069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:18.997258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.007209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.008309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:19.009048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.009730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.055283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:59:19.066884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Getting quotas for user 45ad722eead04f7980bff23dde84f1e2 and project d75231c930634323908998c748d5e4dd. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:59:19.096689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:19.109047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:59:19.115013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:59:19.233636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9362daf3-f051-4193-b54d-b05422061b31 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726885 Aug 24 01:59:19.234219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1356/2348] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:59:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:59:19.247390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5a90cf0-fdea-4917-9db5-0b49a9a48805 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912393a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:19.384176 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5a90cf0-fdea-4917-9db5-0b49a9a48805 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.148800 Aug 24 01:59:19.385731 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1357/2349] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:19 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:19.398775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:19.399701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:19.414820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:19.415564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.416212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.417885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:19.418574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.419232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.638724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:19.650453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7cb7aa1-984c-4202-894d-69e18e8599cd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1284 microversion: 2.1 time: 0.260151 Aug 24 01:59:19.651440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1358/2350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:19 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:19.669890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:19.670836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:19.690385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:19.691134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.694335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.695438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:19.696190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:19.701444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:19.834826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:19.849788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:19.851289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:19.852510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7ae66ee-0807-4b15-a430-f4ea26ec786a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1439 microversion: 2.25 time: 0.199833 Aug 24 01:59:19.882096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1359/2351] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:19 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1439 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:19.902556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c69556c-4e95-42a8-b77e-eeb070630052 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:19.903121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c69556c-4e95-42a8-b77e-eeb070630052 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:20.024103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c69556c-4e95-42a8-b77e-eeb070630052 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:20.033131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c69556c-4e95-42a8-b77e-eeb070630052 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1216 microversion: 2.1 time: 0.149772 Aug 24 01:59:20.034665 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1360/2352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:19 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:20.041087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b722ee50-5b9c-4349-84b8-43caee2c5063", "name": "network-vif-deleted", "tag": "28bd65b6-cd95-4982-b637-156eded8ee07"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:20.053724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.054880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.055596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.075455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] Creating event network-vif-deleted:28bd65b6-cd95-4982-b637-156eded8ee07 for instance b722ee50-5b9c-4349-84b8-43caee2c5063 on n-h2-854121-3 Aug 24 01:59:20.086602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7de1b5f0-a3dc-4f8a-b2ac-b99f51f2572e req-ef3eb852-03a3-46e9-8897-14327b59f1d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049865 Aug 24 01:59:20.087501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1361/2353] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:20.098535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:20.099553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:20.107793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.108658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.109394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.110175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.110905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.111329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.317302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:20.325927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-563869fb-97c1-47bf-afa4-cc08acf46ce7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.232348 Aug 24 01:59:20.340177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1362/2354] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:20 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:20.351660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:20.353378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:20.362756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.364012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.364682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.365913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.367761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.368933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.587623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:20.599021 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b4b275e-28f2-4633-8228-6d33c3f10eda tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.260863 Aug 24 01:59:20.599689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1363/2355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:20 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:20.618840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3effb318-d8d0-4d2c-80e1-18f95a4a9151", "name": "network-vif-deleted", "tag": "8a5a216a-6187-4d02-9bea-0ba1be5be92a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:20.631419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.632245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.632776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.650515 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] Creating event network-vif-deleted:8a5a216a-6187-4d02-9bea-0ba1be5be92a for instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 on n-h2-854121-3 Aug 24 01:59:20.655476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fe91e501-79ad-4f83-8ea0-9a03a2ee1cf6 req-3a15cfeb-b80c-41b4-90f4-9784a90efa4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054538 Aug 24 01:59:20.656229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1364/2356] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:20.669522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76c7de07-1225-441b-a36a-2a5141be2cf6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91271dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:20.732858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76c7de07-1225-441b-a36a-2a5141be2cf6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.067939 Aug 24 01:59:20.741046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1365/2357] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:20 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:20.748415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:20.750062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:20.759939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.761203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.761793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.763262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.764535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.765419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.810746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.811717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.812682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.813524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'fault' on Instance uuid b722ee50-5b9c-4349-84b8-43caee2c5063 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:20.865043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:20.875490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82b072c8-faf9-4c80-8ac0-f3525486b838 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 200 len: 1304 microversion: 2.1 time: 0.133023 Aug 24 01:59:20.876310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1366/2358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:20 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:20.899555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:20.900557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:20.919431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.920677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.921362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:20.922313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:20.923143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:20.923786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.034694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.045637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.047608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.050214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-422f8ee4-1e01-4c75-afe9-ba3706a491aa tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1263 microversion: 2.25 time: 0.164294 Aug 24 01:59:21.052549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1367/2359] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:20 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:59:21.074006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:21.075527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:21.084223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.085647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.086890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.089493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.090259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.090919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.127834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:21.185152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.195642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bb1cb63-578f-4d87-9f0a-45cd9a87c727 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1268 microversion: 2.1 time: 0.127911 Aug 24 01:59:21.196574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1368/2360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:21 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:21.369681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:21.370574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:21.390493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.393402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.394180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.396401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.397055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.398760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.669771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.683696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df2be511-30ed-4784-9c87-894deb6c2904 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.320109 Aug 24 01:59:21.684857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1369/2361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:21 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:21.706602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:21.707743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:21.723836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.724635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.725244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.726138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:21.726743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:21.727402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:21.918007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:21.930471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5b12fc7-2ada-43c4-9592-61fff947e386 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.244293 Aug 24 01:59:21.932761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1370/2362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:21 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:21.946326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3113d68a-9116-4dbd-b905-e0ac31860539 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912570d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:22.131711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3113d68a-9116-4dbd-b905-e0ac31860539 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.199144 Aug 24 01:59:22.136986 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1371/2363] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:21 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:22.142909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:22.144217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:22.155880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.156883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.156883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.157608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.158208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.158579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.183360 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 HTTP/1.1 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b722ee50-5b9c-4349-84b8-43caee2c5063'} Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:22.185089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:22.189814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db1b31a4-2628-447d-bf4e-ef511a79ba58 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 404 len: 111 microversion: 2.1 time: 0.052973 Aug 24 01:59:22.200859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1372/2364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:22 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:59:22.205808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:22.206441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:22.223796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.224302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.224981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.225547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.226182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.234064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.381531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:22.404591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:22.414439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:22.418369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50fbfe8c-8e2c-433f-a27f-20815a528eb9 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1263 microversion: 2.25 time: 0.216311 Aug 24 01:59:22.419346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1373/2365] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:22 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1263 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:22.425200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:22.426053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:22.433197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.433838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.434462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.435289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:22.435987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:22.436487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:22.524479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:22.533592 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2742876-c0f0-44a5-b271-68f6399a6c64 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1286 microversion: 2.1 time: 0.113073 Aug 24 01:59:22.534466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1374/2366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:22 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:22.539446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1161494623", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:22.610562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 01:59:23.271413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 01:59:23.271842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 01:59:23.272324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 01:59:23.272775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 01:59:23.273200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 01:59:23.285692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.286299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.286770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:23.287626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.288288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.288669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:23.317962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 01:59:23.324917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 01:59:23.353687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 01:59:23.356503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 01:59:23.513106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5058e9e3-4ca3-453a-8a09-70edf46bee11 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976210 Aug 24 01:59:23.513106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1375/2367] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 01:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 01:59:23.533298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:23.534130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:23.543876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.544564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.545464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:23.546428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.547180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.547677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:23.867576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:23.887784 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-146c8edb-a31e-4290-a212-cf95b78cec9f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.370765 Aug 24 01:59:23.905004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1376/2368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:23 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:23.914061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:23.921319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:23.947349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.950251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.952435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:23.955449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:23.957089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:23.958719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:24.299151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:24.359380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28627645-4785-4714-a391-10aaadbcbaa8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.453003 Aug 24 01:59:24.360216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1377/2369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:23 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:24.376279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdfb38fc-40d4-46b6-8f8f-e767c6f58765 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9143bca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:24.494608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fdfb38fc-40d4-46b6-8f8f-e767c6f58765 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.122112 Aug 24 01:59:24.495403 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1378/2370] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:24 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:24.535743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:24.536481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:24.557453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:24.557966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:24.564790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:24.565985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:24.566515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:24.566969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:24.763843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:24.778208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:24.779738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:24.780954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9eaa4bf8-324b-47dc-bc0e-d4d9aeee94e1 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1263 microversion: 2.25 time: 0.276977 Aug 24 01:59:24.795408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1379/2371] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:24 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1263 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:24.811056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:24.811683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:24.827767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:24.829294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:24.830384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:24.835111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:24.837939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:24.840415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:24.991818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:25.005901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9528bd5f-0fd8-4cd0-922f-1198980017dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1219 microversion: 2.1 time: 0.208965 Aug 24 01:59:25.006734 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1380/2372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:24 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:25.011736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:25.012588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:25.020164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.020912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.021603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.022500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.023553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.023553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.439576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:25.452583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52c4a1bb-30f4-410e-a9a3-f3517183e33f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.444487 Aug 24 01:59:25.453659 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1381/2373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:25 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:25.460648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42291bf2-8359-428f-94da-4f6d0b79979a", "tag": "e4b71291-6326-4552-8b52-77b358798b0f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:25.474295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.475021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.475719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.492551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] Creating event network-changed:e4b71291-6326-4552-8b52-77b358798b0f for instance 42291bf2-8359-428f-94da-4f6d0b79979a on n-h2-854121-3 Aug 24 01:59:25.499064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e4e24bca-bedd-4087-aa3b-98fede7beb32 req-f378434b-7cb0-404e-a19d-b7aacddf4113 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043819 Aug 24 01:59:25.501497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1382/2374] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:25.508343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:25.509573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:25.516573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.517243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.517754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.519030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.519642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.520133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.813423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:25.825356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3733bb4-d26c-41b5-b0ea-c483e86dcb9c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.321531 Aug 24 01:59:25.828947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1383/2375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:25 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:25.835712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:25.836762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:25.861559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.864990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.866580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:25.868073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:25.869609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:25.870357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.221211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:26.233052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d42a853e-253c-4eca-9a28-3879c8252083 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.402754 Aug 24 01:59:26.250605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1384/2376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:25 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:26.255603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d210f6d-da92-4d45-87b9-e6ed5e6dc9b6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913ee3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:26.313393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d210f6d-da92-4d45-87b9-e6ed5e6dc9b6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.061566 Aug 24 01:59:26.314130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1385/2377] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:26 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:26.331498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:26.331498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:26.339351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.345063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.345550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.346292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.346765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.347220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.502341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:26.514996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:26.516851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:26.518141 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82720a6d-e303-4511-900f-0e1a6e216000 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1263 microversion: 2.25 time: 0.194971 Aug 24 01:59:26.529650 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1386/2378] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:26 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:26.540656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7999602-8784-4cf5-ac70-92a84c698b78", "name": "network-vif-unplugged", "status": "completed", "tag": "ebbff98b-6ec6-461e-b8f1-59dccdf78022"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:26.550455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.551024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.551606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.569611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] Creating event network-vif-unplugged:ebbff98b-6ec6-461e-b8f1-59dccdf78022 for instance f7999602-8784-4cf5-ac70-92a84c698b78 on n-h2-854121-3 Aug 24 01:59:26.574654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1eb987b7-1f46-4f01-9bd2-65969775c4bb req-b4e754db-204e-49f1-a1b7-84766b8ebd73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043679 Aug 24 01:59:26.575692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1387/2379] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:26.581080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:26.581890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:26.589004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.589916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.590033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.590806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.591403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.591905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.700967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:26.715427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7579f614-ea54-455e-bb4c-eb7c5eb1b48e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1275 microversion: 2.1 time: 0.138426 Aug 24 01:59:26.716477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1388/2380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:26 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1275 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:26.721225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:26.722204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:26.728652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.729323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.729861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.730693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:26.731308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:26.731985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:26.991310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.005036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b644d130-d0fb-41e2-a384-92d592392f94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.286561 Aug 24 01:59:27.021813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1389/2381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:26 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:27.034165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:27.035953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:27.055488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.056432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.057188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.058949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.059803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.062176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.302789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.307202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:27.313267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65fb82ef-57e2-4ca5-a879-3e71d79161d0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.289470 Aug 24 01:59:27.314348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1390/2382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:27 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:27.336015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:27.336668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:27.344079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.344596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.345099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.345866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.346483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.346927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.585132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.599981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c88a089-d16f-411b-a40f-ee15e3cea283 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.266960 Aug 24 01:59:27.608027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1391/2383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:27 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:27.614322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cab4b086-e973-4d79-be3c-668ebe730706 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91271c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:27.673615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cab4b086-e973-4d79-be3c-668ebe730706 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.064537 Aug 24 01:59:27.674315 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1392/2384] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:27 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:27.685965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:27.686592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:27.694014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.694936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.695608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.696530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.697284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.697989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.813025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.827087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.829486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:27.831078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e229bf77-ab89-4376-b5a5-fa36be9fc582 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1263 microversion: 2.25 time: 0.155308 Aug 24 01:59:27.832472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1393/2385] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:27 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:27.852276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:27.852962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:27.860199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.860770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.861216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:27.861881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:27.862344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:27.862778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.087413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:28.097437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f63a2b6-c812-47cb-bfa2-224b3980a8a1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.249618 Aug 24 01:59:28.103838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1394/2386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:27 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:28.114917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:28.115868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:28.124697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.125534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.126245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.127274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.127879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.128423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.589080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:28.597877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51cc1889-f782-48f8-b5f3-55e08d330eb7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.492317 Aug 24 01:59:28.598742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1395/2387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:28 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.638519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.872791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:28.886748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8140c50f-129d-4c30-a42b-ea9ed7f1b069 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.277437 Aug 24 01:59:28.898247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1396/2388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:28 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:28.907215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:28.907849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:28.914821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.915319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.915935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:28.916461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:28.919434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:28.919434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.264159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:29.280009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03a8d435-2b04-4335-953c-4bc93fb5c1f5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.377610 Aug 24 01:59:29.286460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1397/2389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:28 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:29.292784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7999602-8784-4cf5-ac70-92a84c698b78", "tag": "ebbff98b-6ec6-461e-b8f1-59dccdf78022"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:29.343169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.345920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.346551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.376580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] Creating event network-changed:ebbff98b-6ec6-461e-b8f1-59dccdf78022 for instance f7999602-8784-4cf5-ac70-92a84c698b78 on n-h2-854121-3 Aug 24 01:59:29.391614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98f3c9b3-6ec6-4eb5-ac5a-aa17d99bdc54 req-111f8505-deff-4917-8a4d-ce7f3f38de65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102641 Aug 24 01:59:29.393269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1398/2390] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:29.400212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3de3a43-9fd1-4f81-96cd-a57da333712c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b913ee3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:29.462370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3de3a43-9fd1-4f81-96cd-a57da333712c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.067675 Aug 24 01:59:29.471012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1399/2391] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:29 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:29.476622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:29.477497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:29.489202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.489703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.492470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.496010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.496551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.497112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.587831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.590499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.592175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.594009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lazy-loading 'fault' on Instance uuid 3effb318-d8d0-4d2c-80e1-18f95a4a9151 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:29.705976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:29.718320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:29.723314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:29.724503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4719f5ff-45f2-4080-ac03-bc7a347c09b2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 200 len: 1191 microversion: 2.25 time: 0.252436 Aug 24 01:59:29.728905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1400/2392] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:29 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 1191 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:29.741042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:29.741794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:29.751700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:29.770695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.771414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.772085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:29.772932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:29.775520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:29.775520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.091536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:30.100159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf6385a5-f20a-44f3-9290-ed9f68289c48 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.370216 Aug 24 01:59:30.104945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1401/2393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:29 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:30.109808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:30.114030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:30.130202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.131032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.132479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.135249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.135924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.136554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.464691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:30.478195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-231dfbdf-f2c1-4b80-a0a1-341b1bb366ce tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.371820 Aug 24 01:59:30.479373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1402/2394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:30 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:30.484988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:30.485811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:30.497075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.497684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.498230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.499163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.499877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.500411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.794531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:30.804077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1dbeb950-c576-44eb-896f-c75ccf129a92 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.323172 Aug 24 01:59:30.804882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1403/2395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:30 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:30.823758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:30.824401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:30.831618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.833591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.835035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:30.835788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:30.836257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:30.836692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.055483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:31.064517 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c4aa5ec-9374-4e25-802a-3ff73300d8c5 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.246014 Aug 24 01:59:31.066803 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1404/2396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:30 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:31.071878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dcdf0330-e606-4a9c-ac24-bc08a15faef7 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912f2160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:31.123409 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dcdf0330-e606-4a9c-ac24-bc08a15faef7 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.055348 Aug 24 01:59:31.130224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1405/2397] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:31 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:31.130757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:31.131371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 3effb318-d8d0-4d2c-80e1-18f95a4a9151] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:31.137770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.138368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.139009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.139776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.140235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.140659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.156417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] HTTP exception thrown: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Request method failure captured: Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 HTTP/1.1 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQS28zytDL5oEzr9H21NTO1-GeBc4g-F4KRkgZdtTXpjb06FH8bWOUdbBZb6Z1tfaS2ocCNeFCB_hz27Q8Y2QOHOrJ0rlRijkx47OOGEiL8Q6y9htUUWtjIhv6Z8jFOJm3MHD_mPZzhJmJbLSPBj1qctp9PkMy9EymBLBFYwrDjrOE Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6223af42e4e34d7cb4f327824ac148af Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3effb318-d8d0-4d2c-80e1-18f95a4a9151'} Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. Aug 24 01:59:31.158332 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Returning 404 to user: Instance 3effb318-d8d0-4d2c-80e1-18f95a4a9151 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2242ba5-7d7d-4c93-ac4d-b57ede2d57fe tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151" status: 404 len: 111 microversion: 2.25 time: 0.033780 Aug 24 01:59:31.162624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1406/2398] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:31 2022] GET /compute/v2.1/servers/3effb318-d8d0-4d2c-80e1-18f95a4a9151 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:59:31.166116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:31.166701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:31.172781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.173254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.173729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.174445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.175161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.175373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.537347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:31.546540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8272f15e-1aa4-45d9-b46e-727bf2b19ab1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.384171 Aug 24 01:59:31.553052 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1407/2399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:31 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:31.575048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:31.575682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:31.583689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.583871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.584211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.584960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.585483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.585910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.735966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:31.746751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a965e7d-e950-434b-a0e2-209387bd5c95 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.180083 Aug 24 01:59:31.762526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1408/2400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:31 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:31.768154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b365bb-3263-4136-919b-ce4d33c67ef7", "tag": "ad93bb3b-d7c6-4add-a08a-298b7e040c2b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:31.778715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.779508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.780099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.811516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] Creating event network-changed:ad93bb3b-d7c6-4add-a08a-298b7e040c2b for instance 70b365bb-3263-4136-919b-ce4d33c67ef7 on n-h1-854121-3 Aug 24 01:59:31.820003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fc10b20e-7ece-4578-ba14-c3cba4af428a req-cfab022e-5261-4c1e-8b6f-3d1f35cded2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055316 Aug 24 01:59:31.821500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1409/2401] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:31.828789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:31.829905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:31.838582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.839382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.840214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:31.841407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:31.842065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:31.842696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.056003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:32.065692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03650515-b43c-4ecb-80c5-5ba29f8f0c8f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.242462 Aug 24 01:59:32.068705 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1410/2402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:31 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:32.073712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "name": "network-vif-plugged", "status": "completed", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:32.085820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.086528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.087347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.103823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] Creating event network-vif-plugged:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h1-854121-3 Aug 24 01:59:32.110682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-524b685c-80fe-4c18-a2f4-2057e37a933f req-6ba9fb58-a86f-4c65-9a53-46cc80832709 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040306 Aug 24 01:59:32.115006 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1411/2403] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:32.121550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:32.122490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:32.131766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.132532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.133159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.134012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.134670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.135475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.336883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:32.340892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:32.346626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94b26e73-e62e-4751-957b-c547ffecfa15 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.230205 Aug 24 01:59:32.360745 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1412/2404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:32 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:32.360745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33d8bbb2-673b-4d0a-89c7-449878b2e085 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9143b820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:32.446319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33d8bbb2-673b-4d0a-89c7-449878b2e085 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.096402 Aug 24 01:59:32.457140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1413/2405] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:32 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:32.575929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:32.577429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:32.587400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.591406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.592200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.603425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.604257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.604951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.805187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:32.816914 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d35282b-68d2-445b-b763-b7695d02231b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.244234 Aug 24 01:59:32.833424 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1414/2406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:32 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:32.838678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:32.839508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:32.846545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.847327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.848445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:32.849341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:32.849934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:32.850566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.043611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:33.052598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee32dfd5-6155-4cbb-b516-7a4fdca3b2d1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.217733 Aug 24 01:59:33.066633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1415/2407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:32 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:33.093968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:33.094663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:33.109183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.109855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.110406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.111979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.112582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.113257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.310341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:33.344952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:33.347636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:33.355914 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b04553c6-8bfc-4b3f-ab07-7731d2cc6b5a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.266997 Aug 24 01:59:33.357013 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1416/2408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:33 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:33.380385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:33.381606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:33.388384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.389018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.390800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.391654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.392237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.392793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.646381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:33.683495 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27a14f27-e7dd-4471-aae4-530c73abecf4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.314670 Aug 24 01:59:33.687395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1417/2409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:33 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:33.693783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1dbe26e3-1160-4f62-9dde-f3d9f18cba20 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912fc430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:33.793254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1dbe26e3-1160-4f62-9dde-f3d9f18cba20 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1453 microversion: 2.1 time: 0.100017 Aug 24 01:59:33.794090 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1418/2410] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:33 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:33.853387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:33.853690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:33.874318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.875629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.876192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:33.884479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:33.889568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:33.893801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.072358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:34.080929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54eff738-4040-4053-a293-0c58779d8550 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.244574 Aug 24 01:59:34.083951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1419/2411] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:33 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:34.087217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:34.087902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:34.094128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.094628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.095122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.095841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.096304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.096756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.249695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:34.258947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41eb20f0-2042-47d4-b4d1-62d358f0c05a tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.175727 Aug 24 01:59:34.259921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1420/2412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:34 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:34.389899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:34.391652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:34.412838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.413661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.416701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.417846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.418464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.419144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.761807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:34.772954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9125eb03-7a0c-429e-b50d-2db2b56eefd0 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.386778 Aug 24 01:59:34.786110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1421/2413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:34 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:34.793719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:34.794727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:34.804805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.805267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.805764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.807117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:34.807628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:34.808360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:34.968792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:34.989821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-323f9ce2-d821-413b-a401-fc4d5d0a6158 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.200211 Aug 24 01:59:34.990687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1422/2414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:34 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:34.998610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b25878d6-0e89-4d42-935f-56ee387b57ac tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912fc430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:35.088485 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b25878d6-0e89-4d42-935f-56ee387b57ac tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1462 microversion: 2.1 time: 0.095386 Aug 24 01:59:35.090269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1423/2415] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:34 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:35.102996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42291bf2-8359-428f-94da-4f6d0b79979a", "name": "network-vif-plugged", "status": "completed", "tag": "e4b71291-6326-4552-8b52-77b358798b0f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:35.116056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.116545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.117006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.132042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] Creating event network-vif-plugged:e4b71291-6326-4552-8b52-77b358798b0f for instance 42291bf2-8359-428f-94da-4f6d0b79979a on n-h2-854121-3 Aug 24 01:59:35.138250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9251ce7b-783e-4649-bf08-81d3785f1e2f req-df3bba1b-afbe-4437-b158-d1be3db00755 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046734 Aug 24 01:59:35.139313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1424/2416] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:35.145767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f9939a9-4f04-46a2-8313-85978582f55a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91271820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:35.202116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f9939a9-4f04-46a2-8313-85978582f55a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 200 len: 1462 microversion: 2.1 time: 0.060757 Aug 24 01:59:35.211198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1425/2417] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:35 2022] GET /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 1462 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:35.211198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:35.211198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:35.217801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.218273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.218824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.219698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.220166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.220955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.462503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:35.475673 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e922927-eaac-4fd6-afa5-6df3a32fe5dd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.270800 Aug 24 01:59:35.489928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1426/2418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:35 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:35.489928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:35.489928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:35.495212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.495706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.496144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.496906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.497354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.497780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.786869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:35.799615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d1d6dc2-76bb-4511-a8fd-dba9fba1cdf3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1480 microversion: 2.1 time: 0.317761 Aug 24 01:59:35.800866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1427/2419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:35 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1480 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:35.807744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:35.809126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:35.819096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.820055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.820657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:35.822333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:35.822793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:35.823255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.078194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.090715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82bf5faa-0607-49a3-b37c-b4237d76f668 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.287984 Aug 24 01:59:36.103303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1428/2420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:35 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:36.110261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:36.110901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:36.118081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.118477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.119025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.119936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.121079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.121079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.150867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:36.243233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee525ddd-4b42-49dd-8fae-eba4c8b77d5a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 204 len: 0 microversion: 2.25 time: 0.134273 Aug 24 01:59:36.244601 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1429/2421] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:59:36 2022] DELETE /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:59:36.251141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:36.252263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:36.260218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.261007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.261744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.262745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.263448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.264384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.408831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.418380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a538ddbf-3940-4d5b-9a60-a512d4360f0c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.172143 Aug 24 01:59:36.419185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1430/2422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:36 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:36.439905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:36.440657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:36.448784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.449705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.449887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.450803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.451273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.451708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.599834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.609550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb6d95d9-4957-4b49-ab56-864788ac4b9b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1531 microversion: 2.1 time: 0.173687 Aug 24 01:59:36.624259 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1431/2423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1531 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:36.629959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:36.630592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:36.637452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.637962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.638425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.639140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.639601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.640103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.664073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:36.796590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.808248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.811449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:36.813353 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d5f4cae-50ff-4abc-9e42-ab4f0e6469d2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1731 microversion: 2.25 time: 0.187948 Aug 24 01:59:36.831669 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1432/2424] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:36 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:36.837201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:36.838948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:36.845944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.846443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.846875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:36.847624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:36.848096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:36.848528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.027629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:37.036658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1fd8e6b-6dee-4a3f-bc0c-ca9e25cac696 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.203961 Aug 24 01:59:37.037310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1433/2425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:36 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:37.042454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:37.043124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:37.055442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.056216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.056796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.057963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.058729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.059239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.226267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:37.236065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d3e5e54-8182-4bb8-a915-a7e362ceb8bc tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1467 microversion: 2.1 time: 0.197379 Aug 24 01:59:37.256270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1434/2426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:37 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1467 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:37.262208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:37.262835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:37.269343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.269916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.270378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.271083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.271594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.272153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.612501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:37.622376 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51f5241b-1d8e-498b-857a-17ce03ff885c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1316 microversion: 2.1 time: 0.364473 Aug 24 01:59:37.623270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1435/2427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:37 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:37.630435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-733426827"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:37.632985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:37.639942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.640440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.640928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.641616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.642065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.642496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.938374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf5bb704-fb53-4e12-b2c6-645ef3c6e8cf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "POST /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4/action" status: 202 len: 0 microversion: 2.1 time: 0.313557 Aug 24 01:59:37.940368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1436/2428] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:59:37 2022] POST /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 01:59:37.952548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:37.953636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:37.961849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.962642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.963587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:37.964312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:37.965053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:37.965708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:38.365586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:38.375952 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bffe3e25-4c4e-4676-a7fb-265617472b83 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.433225 Aug 24 01:59:38.376752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1437/2429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:37 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:38.386035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:38.386662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:38.404037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:38.404518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:38.405084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:38.405703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:38.406162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:38.406591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:38.745104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:38.755786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fb8b870-29b5-435a-ad2a-28d321647f93 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.374775 Aug 24 01:59:38.765924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1438/2430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:38 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:38.773467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:38.775830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:38.784200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:38.785065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:38.785734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:38.786576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:38.787246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:38.787786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:39.166330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:39.175189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:39.177323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:39.178540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9447edfa-2e9a-44f4-86ac-0e18c5495573 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1731 microversion: 2.25 time: 0.419540 Aug 24 01:59:39.184475 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1439/2431] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:38 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1731 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:39.190010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6adb74a-fcf4-4e7e-9880-b77425aea097 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912fcf70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:39.247406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6adb74a-fcf4-4e7e-9880-b77425aea097 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.061286 Aug 24 01:59:39.255414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1440/2432] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:39 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:39.255414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:39.255414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:39.260921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:39.261422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:39.261939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:39.263090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:39.263090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:39.263576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:39.688198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:39.704034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3337d6bd-f45d-415c-8ca2-8d030f40301d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.454775 Aug 24 01:59:39.717905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1441/2433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:39 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:39.717905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2", "name": "network-vif-unplugged", "status": "completed", "tag": "d0a66c9a-177b-4812-a22e-2e9332494459"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:39.730089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:39.730570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:39.731003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:39.752400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] Creating event network-vif-unplugged:d0a66c9a-177b-4812-a22e-2e9332494459 for instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 on n-h2-854121-3 Aug 24 01:59:39.763401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-28e9a524-7ab4-4bbc-8866-8342200f5ac6 req-006d2da5-6bd8-4d56-be74-13099bb73c3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056999 Aug 24 01:59:39.776846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1442/2434] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:39.782299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:39.782994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:39.803007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:39.803428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:39.803878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:39.804588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:39.805075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:39.805504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.179883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:40.188053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e731ef43-afe4-41ff-b06d-7deb61a85b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1466 microversion: 2.1 time: 0.409854 Aug 24 01:59:40.198676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1443/2435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:39 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1466 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:40.223214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:40.223874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:40.235169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.235585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.236033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.238051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.238745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.239245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.681221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:40.693263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-316fa1ce-e939-4df7-a4c3-51263843e01f tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1391 microversion: 2.1 time: 0.491417 Aug 24 01:59:40.694883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1444/2436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:40 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1391 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:40.701613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:40.702542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:40.711631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.712330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.713576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.714486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.714995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.715637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.928239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:40.938062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-327f3f38-5013-44f7-998b-3a253718e6ac tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.241888 Aug 24 01:59:40.946176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1445/2437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:40 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:40.953909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:40.954529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:40.964375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.964910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.966298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:40.967730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:40.968205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:40.968643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.012291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.012804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.013245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.013700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lazy-loading 'fault' on Instance uuid 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:41.086293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:41.095680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:41.097710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:41.099083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb25c3fd-3cdb-4f3e-8151-4ac17ccfd9d0 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 200 len: 1374 microversion: 2.25 time: 0.151713 Aug 24 01:59:41.099798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1446/2438] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:40 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:41.104700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:41.105490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:41.113665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.114166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.114977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.115587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.116101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.116543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.285998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f17217a1-af72-4a1a-bfc9-f454f52f7acd tempest-ServersOnMultiNodesTest-1609888160 tempest-ServersOnMultiNodesTest-1609888160-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1617 microversion: 2.1 time: 0.184718 Aug 24 01:59:41.286983 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1447/2439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:41 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1617 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:41.298648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1093d80f-be6f-4389-95ac-2646f497371c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b914a8c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:41.352261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1093d80f-be6f-4389-95ac-2646f497371c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.064270 Aug 24 01:59:41.360867 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1448/2440] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:41 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:41.377191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdeb47c-aec8-4c03-884f-070b5cb0bf20", "name": "network-vif-deleted", "tag": "6c9b733c-65c5-4948-81a5-5748d5222141"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:41.395292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.395951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.396505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.408586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] Creating event network-vif-deleted:6c9b733c-65c5-4948-81a5-5748d5222141 for instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 on n-h1-854121-3 Aug 24 01:59:41.419057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e0867153-69cd-4eae-a326-b163d4d5e5b1 req-46d0fade-ef07-4c6b-8d08-97d2e123d356 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056706 Aug 24 01:59:41.420166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1449/2441] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:41.430891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:41.431444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:41.439249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.439729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.440175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.441803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.442259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.442689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.693300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:41.699314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:41.707039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64ba2841-7fd0-4c10-8023-e6c2a2ea21c5 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.285289 Aug 24 01:59:41.718570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1450/2442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:41 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:41.724400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:41.725113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:41.732836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.733465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.733996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.734877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.735548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.736069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.786085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:41.917128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:41.929031 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5500033-7960-4015-bdba-ab7436203944 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 204 len: 0 microversion: 2.1 time: 0.218609 Aug 24 01:59:41.930193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1451/2443] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:59:41 2022] DELETE /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:59:41.935836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:41.936681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:41.943588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.944244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.945054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:41.946662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:41.946662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:41.946906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.113027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:42.121674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81a0d2c6-fe1a-43ec-b681-16e3e5a3464b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1381 microversion: 2.1 time: 0.190348 Aug 24 01:59:42.122525 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1452/2444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:41 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1381 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:42.127124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b365bb-3263-4136-919b-ce4d33c67ef7", "name": "network-vif-plugged", "status": "completed", "tag": "ad93bb3b-d7c6-4add-a08a-298b7e040c2b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:42.154066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.154713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.155137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.168656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] Creating event network-vif-plugged:ad93bb3b-d7c6-4add-a08a-298b7e040c2b for instance 70b365bb-3263-4136-919b-ce4d33c67ef7 on n-h1-854121-3 Aug 24 01:59:42.173929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-049cee70-c3a9-418c-8b77-c8e045e707d1 req-5249fa3c-01f7-4da3-a826-7fbd7c819884 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050249 Aug 24 01:59:42.174695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1453/2445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:42.179865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:42.180883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:42.187306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.188081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.188532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.189267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.189731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.190164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.360074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:42.395290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b942b30-7bd7-436d-9d69-4ef0de6c0b8d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1472 microversion: 2.1 time: 0.218516 Aug 24 01:59:42.395885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1454/2446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:42 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1472 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:42.413310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:42.414096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:42.434531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.435337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.436221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.438361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.439177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.439776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.941324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:42.954160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1c4d363-8e67-4cdc-8002-5978161711eb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.556438 Aug 24 01:59:42.954642 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1455/2447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:42 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:42.973818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:42.974437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 4cdeb47c-aec8-4c03-884f-070b5cb0bf20] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:42.980753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.981324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.981768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.982490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:42.983019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:42.983522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:42.998947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] HTTP exception thrown: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Request method failure captured: Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 HTTP/1.1 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQS28zytDL5oEzr9H21NTO1-GeBc4g-F4KRkgZdtTXpjb06FH8bWOUdbBZb6Z1tfaS2ocCNeFCB_hz27Q8Y2QOHOrJ0rlRijkx47OOGEiL8Q6y9htUUWtjIhv6Z8jFOJm3MHD_mPZzhJmJbLSPBj1qctp9PkMy9EymBLBFYwrDjrOE Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6223af42e4e34d7cb4f327824ac148af Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4cdeb47c-aec8-4c03-884f-070b5cb0bf20'} Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. Aug 24 01:59:43.001462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Returning 404 to user: Instance 4cdeb47c-aec8-4c03-884f-070b5cb0bf20 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff03e35d-87d1-43a9-8b63-58e436852635 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20" status: 404 len: 111 microversion: 2.25 time: 0.033599 Aug 24 01:59:43.005126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1456/2448] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:42 2022] GET /compute/v2.1/servers/4cdeb47c-aec8-4c03-884f-070b5cb0bf20 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:59:43.008229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e205e5cb-7d06-4dd9-a05f-5befc3ba869a tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '.version_select at 0x7f6b914a61f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.012137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e205e5cb-7d06-4dd9-a05f-5befc3ba869a tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.012624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e205e5cb-7d06-4dd9-a05f-5befc3ba869a tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.013136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e205e5cb-7d06-4dd9-a05f-5befc3ba869a tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.024956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e205e5cb-7d06-4dd9-a05f-5befc3ba869a tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/os-migrations" status: 200 len: 2320 microversion: 2.1 time: 0.020313 Aug 24 01:59:43.025716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1457/2449] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 01:59:43 2022] GET /compute/v2.1/os-migrations => generated 2320 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:43.030449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c3e136a-ff9f-4951-9899-9bbf82ac1eb4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b914a89d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.081292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c3e136a-ff9f-4951-9899-9bbf82ac1eb4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.054578 Aug 24 01:59:43.089178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1458/2450] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:43 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:43.089178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.089178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:43.094591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.095181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.095688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.096470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.097025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.097524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.241442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:43.250556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea5e9da7-c4c7-4c23-9633-5b41a322a5fd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.166713 Aug 24 01:59:43.251383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1459/2451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:43 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:43.260966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbccfaf3-5a7f-4a5f-8ec1-50716f2e6d6b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '.version_select at 0x7f6b912fc3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.292971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbccfaf3-5a7f-4a5f-8ec1-50716f2e6d6b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-110667041" status: 204 len: 0 microversion: 2.25 time: 0.038819 Aug 24 01:59:43.293855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1460/2452] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 01:59:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-110667041 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:59:43.298759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.299397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:43.306266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.306816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.307172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.308086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.308391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.309076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.513229 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab865ef7-04b1-4f5f-b622-7f27221d03ad tempest-LiveMigrationTest-1326705635 tempest-LiveMigrationTest-1326705635-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1532 microversion: 2.1 time: 0.217889 Aug 24 01:59:43.513886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1461/2453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:43 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1532 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:43.518626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.519294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:43.544163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.544824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.545387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.546340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.548751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.549330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.824746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:43.838373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d361a414-aca0-40eb-9949-675ea9d0d0bb tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1472 microversion: 2.1 time: 0.323240 Aug 24 01:59:43.851827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1462/2454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:43 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:43.860532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:43.862062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:43.872618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.873463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.874342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.875298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:43.876051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:43.876598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:43.939946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:44.153460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d23b363-8cbc-4bdb-a437-c96ea20c7c4c tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 204 len: 0 microversion: 2.1 time: 0.299543 Aug 24 01:59:44.154464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1463/2455] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:59:43 2022] DELETE /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:59:44.164428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:44.165190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:44.171609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:44.172104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:44.172843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:44.173845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:44.174392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:44.174834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:44.630493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:44.644166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b376741-0198-4dd2-a0cd-52536c09c499 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.488245 Aug 24 01:59:44.662886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1464/2456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:44 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:44.695501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b281995a-4790-4084-be4a-e78e48df7fc5 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9143b040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:44.838365 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b281995a-4790-4084-be4a-e78e48df7fc5 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.163902 Aug 24 01:59:44.840555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1465/2457] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:44 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:44.854041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:44.854417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:44.863540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:44.864053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:44.864703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:44.865508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:44.866028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:44.866524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.204416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:45.215415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01c28499-fc70-4327-b0a3-c1f42743402d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1387 microversion: 2.1 time: 0.366238 Aug 24 01:59:45.216479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1466/2458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:44 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1387 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:45.221862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:45.223268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:45.250273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.251019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.251583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.252482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.253145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.255005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.558691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:45.573436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aeda20cf-a4ee-48bc-850e-292c67462883 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1315 microversion: 2.1 time: 0.355011 Aug 24 01:59:45.574591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1467/2459] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:45 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:45.581319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:45.582464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:45.593748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.594247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.594681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.595388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.595843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.596390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.641537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:45.685686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:45.774064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-761545c5-ade7-47e0-91f6-348ebcdf756c tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 204 len: 0 microversion: 2.25 time: 0.197623 Aug 24 01:59:45.774719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1468/2460] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:59:45 2022] DELETE /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:59:45.780422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:45.781258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:45.787864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.788350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.789716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.790442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.790903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.791380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.837578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.838060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.838584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.838943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lazy-loading 'fault' on Instance uuid 42291bf2-8359-428f-94da-4f6d0b79979a {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:45.896993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:45.907314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35e72f11-ac1a-47fd-8dd5-ffeb83f5606e tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 200 len: 1306 microversion: 2.1 time: 0.130928 Aug 24 01:59:45.908122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1469/2461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:45 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:45.915537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42291bf2-8359-428f-94da-4f6d0b79979a", "name": "network-vif-deleted", "tag": "e4b71291-6326-4552-8b52-77b358798b0f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:45.931525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.931525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.931862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.957606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] Creating event network-vif-deleted:e4b71291-6326-4552-8b52-77b358798b0f for instance 42291bf2-8359-428f-94da-4f6d0b79979a on n-h2-854121-3 Aug 24 01:59:45.963350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-68b20343-0293-4c79-aaf6-b570f9626c21 req-07b76958-1dd2-4679-8473-c5bb700857e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053919 Aug 24 01:59:45.964417 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1470/2462] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:45.969956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:45.971175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:45.977661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.978160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.978582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:45.979589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:45.979731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:45.980161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.127456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:46.136373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3547d274-bdf9-4aae-9be2-7df736c91a18 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.170778 Aug 24 01:59:46.145801 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1471/2463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:45 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:46.150981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:46.151618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:46.158493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.158923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.159362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.160778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.161254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.161686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.345725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:46.356210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:46.358032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:46.359239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b42aebdd-4131-44a6-8c31-4388f12d9169 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1548 microversion: 2.25 time: 0.212420 Aug 24 01:59:46.359791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1472/2464] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:46 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:46.364764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-295953f5-7171-4338-b30c-ed60c216f849 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9146f310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:46.430725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-295953f5-7171-4338-b30c-ed60c216f849 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.069859 Aug 24 01:59:46.431494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1473/2465] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:46 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:46.435937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:46.444446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:46.452100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.452555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.453131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.453901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.454244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.454729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.705001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:46.715448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d6dfd1e-3454-4394-a042-3d683181799a tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1387 microversion: 2.1 time: 0.282899 Aug 24 01:59:46.716107 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1474/2466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:46 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1387 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:46.721641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:46.722973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:46.742250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.742738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.743181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:46.743904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:46.744366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:46.744837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.018879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:47.027545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bdda85f-600b-48d5-b67a-dc6c0de7061e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1503 microversion: 2.1 time: 0.309869 Aug 24 01:59:47.041638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1475/2467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:46 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:47.050617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:47.051299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 42291bf2-8359-428f-94da-4f6d0b79979a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:47.060090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.060587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.061073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.061837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.062303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.062790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.080189 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a HTTP/1.1 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '42291bf2-8359-428f-94da-4f6d0b79979a'} Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:47.082546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 42291bf2-8359-428f-94da-4f6d0b79979a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:47.086608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54321ca8-693b-45b3-b52a-834456496d9f tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a" status: 404 len: 111 microversion: 2.1 time: 0.041002 Aug 24 01:59:47.087977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1476/2468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:47 2022] GET /compute/v2.1/servers/42291bf2-8359-428f-94da-4f6d0b79979a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:59:47.095329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:47.096129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:47.103580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.104322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.104962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.105840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.106443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.107123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.172178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'flavor' on Instance uuid 70b365bb-3263-4136-919b-ce4d33c67ef7 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:47.473569 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a08d723f-ca11-4a6b-bbd6-ee2a9499d3da tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7/action" status: 202 len: 0 microversion: 2.1 time: 0.383253 Aug 24 01:59:47.477654 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1477/2469] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 01:59:47 2022] POST /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 01:59:47.488890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:47.490046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:47.500752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.501301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.502164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.502894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.503365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.504368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.544072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:47.697870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ac8e590-83fb-49b2-9d1b-85ad7235917c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 204 len: 0 microversion: 2.1 time: 0.218323 Aug 24 01:59:47.704902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1478/2470] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:59:47 2022] DELETE /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:59:47.720544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:47.721219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:47.749518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.750891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.752062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:47.756463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:47.757012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:47.757452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.040472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.050147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31b57d13-3c08-4a9d-9fa6-0d16f2f5c32d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.343561 Aug 24 01:59:48.051703 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1479/2471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:47 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:48.062708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-plugged", "status": "completed", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:48.077181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.077793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.078865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.093800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] Creating event network-vif-plugged:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 01:59:48.099095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-89364f37-8ff4-4adf-bd78-20f7901e0610 req-7479b088-b8a9-4127-9e78-6ce6ea755744 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046137 Aug 24 01:59:48.103429 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1480/2472] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:48.108735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:48.109552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:48.116679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.117282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.117795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.118576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.119302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.119798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.236447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.251107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.252974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.255738 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-891c698c-b87b-4706-a2c7-b6fa6a3a7f3e tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1506 microversion: 2.25 time: 0.150350 Aug 24 01:59:48.270077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1481/2473] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:48 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:48.280065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d089c276-bf5c-4ee7-8e9c-a44f26327807 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b914e8f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:48.338889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d089c276-bf5c-4ee7-8e9c-a44f26327807 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.067528 Aug 24 01:59:48.340618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1482/2474] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:48 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:48.347100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:48.348265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:48.356348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.356880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.357332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.358056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.358522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.358961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.564124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.579876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eafff638-ddcb-4dbd-ba86-6f62c1512f0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.236609 Aug 24 01:59:48.592746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1483/2475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:48 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:48.592746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:48.592746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:48.611394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.611981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.612427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.613732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.614197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.614627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.620402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:48.827383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.838008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5c43ed8-7eda-420a-a65d-f0a4d5d92018 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1472 microversion: 2.1 time: 0.254580 Aug 24 01:59:48.838784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1484/2476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:48 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:48.843873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:48.844618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:48.851838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.852499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.853168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.853950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.854414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.854845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.926275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:48.936205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16ba8eea-7f6f-4877-ad48-401f3e9cdcd7 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.096226 Aug 24 01:59:48.937003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1485/2477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:48 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:48.947146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7999602-8784-4cf5-ac70-92a84c698b78", "name": "network-vif-deleted", "tag": "ebbff98b-6ec6-461e-b8f1-59dccdf78022"}, {"server_uuid": "dae3c136-7568-495f-b0af-a52d224de1ef", "name": "network-vif-deleted", "tag": "29ec5588-fd93-4bde-abed-db7b9c317973"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:48.958926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:48.959409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:48.959859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:48.973861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Creating event network-vif-deleted:ebbff98b-6ec6-461e-b8f1-59dccdf78022 for instance f7999602-8784-4cf5-ac70-92a84c698b78 on n-h1-854121-3 Aug 24 01:59:48.974375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] Creating event network-vif-deleted:29ec5588-fd93-4bde-abed-db7b9c317973 for instance dae3c136-7568-495f-b0af-a52d224de1ef on n-h1-854121-3 Aug 24 01:59:48.981124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-945b3587-14c2-4068-bb71-b410f4941592 req-a3a1c7fc-ca38-435f-8268-1ac23f980747 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037840 Aug 24 01:59:48.981908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1486/2478] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:49.075021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:49.075349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:49.083334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.084757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.084757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.085194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.086507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.086507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.260446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:49.302418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31ca4c6b-7100-4d2b-b73d-885b0406a0d9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.232981 Aug 24 01:59:49.311500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1487/2479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:49 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:49.339064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:49.339859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:49.354190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.355073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.356015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.357493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.358206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.358946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.475537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:49.484487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:49.487285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:49.489227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b965f807-5981-4f98-9887-9010f5e312c2 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1331 microversion: 2.25 time: 0.173343 Aug 24 01:59:49.490276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1488/2480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:49 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1331 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:49.496012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8fd3a14-6644-4772-9520-38940af24ca4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b914bf820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:49.574962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8fd3a14-6644-4772-9520-38940af24ca4 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.083258 Aug 24 01:59:49.575449 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1489/2481] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:49 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:49.606773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:49.607407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:49.614700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.615206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.616753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.616753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.616942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.617816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.827256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:49.841809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d83db274-575a-4fbf-9ee3-6fd351c0f9d9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.238497 Aug 24 01:59:49.843533 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1490/2482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:49 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:49.859487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:49.860213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:49.872920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.873516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.873965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:49.874692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:49.875154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:49.875587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.220334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:50.233984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b78346e6-8f2e-4a91-8ba2-933eef0d9770 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1472 microversion: 2.1 time: 0.378412 Aug 24 01:59:50.261505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1491/2483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:49 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:50.280627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:50.286140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:50.306253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.307472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.307472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.308225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.309118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.310039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.420852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:50.436076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00496adf-0eab-45fd-a9f6-447427455c88 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.160437 Aug 24 01:59:50.439914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1492/2484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:50 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:50.457760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:50.459655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:50.474783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.478213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.478838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.479669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.481393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.482456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.815153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:50.829228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d46fae4c-f272-4598-bc9c-223741b167ea tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1526 microversion: 2.1 time: 0.387789 Aug 24 01:59:50.830268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1493/2485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:50 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1526 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:50.834946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:50.835563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:50.841748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.842297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.842868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.843436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.843970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.844319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.898651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:50.899196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:50.899682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:50.900149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lazy-loading 'fault' on Instance uuid dae3c136-7568-495f-b0af-a52d224de1ef {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:51.020206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.035615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.041219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.045321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e3ac84b-322c-46d6-9122-a63f4f5dfa75 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 200 len: 1351 microversion: 2.25 time: 0.213272 Aug 24 01:59:51.060780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1494/2486] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:50 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 1351 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:51.067460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f498b417-ce1a-4bfc-8725-ae35c6cab47a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9146f670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:51.141751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f498b417-ce1a-4bfc-8725-ae35c6cab47a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.090938 Aug 24 01:59:51.142655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1495/2487] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:51 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:51.148406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:51.149063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:51.152247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:51.176450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.176976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.177428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.178154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.178618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.179055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.414775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.424795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-313eedea-1e6b-4e52-a845-73aef7f936e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.280807 Aug 24 01:59:51.427169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1496/2488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:51 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:51.448283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6", "name": "network-vif-deleted", "tag": "8f46be7f-0fa1-40c7-8815-fdf156f91ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:51.478926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.480780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.482672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.515722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] Creating event network-vif-deleted:8f46be7f-0fa1-40c7-8815-fdf156f91ac7 for instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 on n-h1-854121-3 Aug 24 01:59:51.529352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fdc4aca2-3d30-4da1-abf0-5ec42f4f24b8 req-0d09b689-0845-488c-8a18-23329eadc470 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100632 Aug 24 01:59:51.532643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1497/2489] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:51.547028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:51.548433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:51.554913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.555416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.556012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.556955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.557419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.557856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.598806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.599370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.599783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.600248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lazy-loading 'fault' on Instance uuid 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:51.653732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.665574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a18ef3f-460e-4621-9891-5a53eae970d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 200 len: 1307 microversion: 2.1 time: 0.130574 Aug 24 01:59:51.674566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1498/2490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:51 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:51.681935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:51.682892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:51.688667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.689186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.689625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.690493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.691799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.692235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.803615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:51.820755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8030ac9c-4a2c-49a1-9fbe-dd440ca1b637 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.141249 Aug 24 01:59:51.821224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1499/2491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:51 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:51.852163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:51.852812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:51.875501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.880326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.880839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:51.881593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:51.882071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:51.882524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.442499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:52.450714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9339fc7-06a0-4104-b632-328f8b620985 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1508 microversion: 2.1 time: 0.602378 Aug 24 01:59:52.464753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1500/2492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:51 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:52.464753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:52.464753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: dae3c136-7568-495f-b0af-a52d224de1ef] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:52.466706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.466706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.472059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.475207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.475707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.476220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.500970 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] HTTP exception thrown: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Request method failure captured: Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef HTTP/1.1 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQS28zytDL5oEzr9H21NTO1-GeBc4g-F4KRkgZdtTXpjb06FH8bWOUdbBZb6Z1tfaS2ocCNeFCB_hz27Q8Y2QOHOrJ0rlRijkx47OOGEiL8Q6y9htUUWtjIhv6Z8jFOJm3MHD_mPZzhJmJbLSPBj1qctp9PkMy9EymBLBFYwrDjrOE Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6223af42e4e34d7cb4f327824ac148af Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'dae3c136-7568-495f-b0af-a52d224de1ef'} Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. Aug 24 01:59:52.502670 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Returning 404 to user: Instance dae3c136-7568-495f-b0af-a52d224de1ef could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c5499f1-aaca-46d7-9433-58f090d9ca59 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef" status: 404 len: 111 microversion: 2.25 time: 0.051985 Aug 24 01:59:52.506871 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1501/2493] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:52 2022] GET /compute/v2.1/servers/dae3c136-7568-495f-b0af-a52d224de1ef => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 01:59:52.537293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e16dcee7-d173-49d2-96be-c3b12a609357 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b916e2dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:52.627515 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e16dcee7-d173-49d2-96be-c3b12a609357 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.121204 Aug 24 01:59:52.636326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1502/2494] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:52 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:52.648977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:52.649432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:52.665535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.669529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.669529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.669800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.670117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.670550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.919834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:52.928794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c01971e-7a6c-4908-a2dd-eb05e95f9232 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.291234 Aug 24 01:59:52.929600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1503/2495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:52 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:52.944600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:52.945406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:52.957650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.958157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.958604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:52.961325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:52.961325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:52.961325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.009708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:53.043379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:53.142661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eaf57476-a36d-4a26-8acc-26cfb55eb256 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 204 len: 0 microversion: 2.25 time: 0.211255 Aug 24 01:59:53.143673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1504/2496] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 01:59:52 2022] DELETE /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 01:59:53.150444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.151434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.162148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.163079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.163765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.164684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.165432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.166219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.182463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 HTTP/1.1 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6'} Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:53.184494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:53.188064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccfb99b5-e783-4fc9-bb9a-731cd39b0aa1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6" status: 404 len: 111 microversion: 2.1 time: 0.040386 Aug 24 01:59:53.190284 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1505/2497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/servers/83f6ceeb-2e26-4f38-a8fd-f016e9e17fd6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:59:53.196028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.196919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.203754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.204348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.204920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.205744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.206276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.207336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.286635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:53.295341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d3ba104-94a5-4e99-91ba-3f4452113496 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.103658 Aug 24 01:59:53.296062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1506/2498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:53.312810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.313443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.320273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.321026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.321344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.322064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.322529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.322969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.483332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:53.493322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:53.495078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:53.496341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac4f1cf1-d708-4155-93f0-3d649bc60227 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1565 microversion: 2.25 time: 0.199152 Aug 24 01:59:53.497326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1507/2499] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:53.501746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.502304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.508394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.511812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.511812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.511812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.511812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.511812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.543234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 01:59:53.638770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ccc6f00-fa2f-420d-9091-5a294ca96263 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 204 len: 0 microversion: 2.1 time: 0.140042 Aug 24 01:59:53.639615 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1508/2500] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 01:59:53 2022] DELETE /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 01:59:53.645009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.646268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.652684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.653217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.653661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.654380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.654825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.655259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.799696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:53.807785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe57e67b-c2d4-43d0-acc5-b035d432fbe0 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1508 microversion: 2.1 time: 0.167137 Aug 24 01:59:53.808381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1509/2501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:53.821496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62e4df50-28da-45ee-a9ba-3b5ef7512170 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91564af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.864577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62e4df50-28da-45ee-a9ba-3b5ef7512170 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.055134 Aug 24 01:59:53.871926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1510/2502] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:53.877281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:53.877909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:53.884989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.885481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.885917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:53.886651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:53.887106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:53.887532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.051697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.060365 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ffd7330-4781-455c-9378-f3767c914e94 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1473 microversion: 2.1 time: 0.187339 Aug 24 01:59:54.061015 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1511/2503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:53 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:54.076317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:54.077010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:54.084149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.084645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.085112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.085818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.086276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.086707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.225393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.233504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dfd6826-aa10-4c50-8af2-53f07d73656f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.160896 Aug 24 01:59:54.234383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1512/2504] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:54 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:54.318567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:54.318949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:54.325911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.326398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.326834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.328260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.328748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.329248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.475982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.484562 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7dabe160-f440-4428-96fd-e8712d923c77 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.170100 Aug 24 01:59:54.485186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1513/2505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:54 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:54.520393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:54.520490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:54.527950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.528462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.528953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.529679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.530144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.530580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.703161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.712766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.714351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:54.715697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c55398ce-eef2-4cee-9ff0-6f35c916c679 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1565 microversion: 2.25 time: 0.199975 Aug 24 01:59:54.716565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1514/2506] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:54 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:59:54.724705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "name": "network-vif-unplugged", "status": "completed", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:54.734743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.735255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.735693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.748215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] Creating event network-vif-unplugged:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h1-854121-3 Aug 24 01:59:54.755379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dccb3f29-5f19-472a-bc4c-d7bee3764b70 req-9776a833-da46-4f91-91cc-7b906a667e9c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037069 Aug 24 01:59:54.756295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1515/2507] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:54.835338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:54.836148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:54.845170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.845812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.846263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:54.846976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:54.847995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:54.848428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.008678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.018019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f71c4941-9a59-4ca1-9007-dea65a594633 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1508 microversion: 2.1 time: 0.187843 Aug 24 01:59:55.031946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1516/2508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:54 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:55.035114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8df79f38-df23-4274-b7de-485cc79f32d6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9148f1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:55.091864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8df79f38-df23-4274-b7de-485cc79f32d6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.063732 Aug 24 01:59:55.099576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1517/2509] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:55 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:55.104499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:55.105152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:55.111853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.112354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.112859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.113574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.114035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.114526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.284239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.293938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c14d279-0e8d-4a8c-b9b8-37f8e0b87384 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1473 microversion: 2.1 time: 0.192257 Aug 24 01:59:55.303349 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1518/2510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:55 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1473 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:55.308428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:55.309284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:55.316814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.317417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.317961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.319019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.320118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.320450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.466411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.474525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49954b8c-1a19-41e3-ae27-cc4f79aa91e2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.169957 Aug 24 01:59:55.488742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1519/2511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:55 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:55.506697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:55.507330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:55.514059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.514575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.515010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.515874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.516343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.516806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.582651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.590586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-126dd991-b3bc-41e2-8050-6d8596b00a40 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.088696 Aug 24 01:59:55.603353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1520/2512] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:55 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:55.740097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:55.742694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:55.749087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.751475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.751995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.752756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:55.753307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:55.754343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:55.899508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.903340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 01:59:55.909580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.912150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:55.913350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3a36b76-b8d1-4d15-b70a-ccdfca38f8e6 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1565 microversion: 2.25 time: 0.178142 Aug 24 01:59:55.914085 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1521/2513] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:55 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:56.040437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.041230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:56.051862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.052532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.053037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.053812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.054360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.054854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.215010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:56.224652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9196df84-da5d-49fc-95b8-ce3c4bc8d399 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1508 microversion: 2.1 time: 0.188510 Aug 24 01:59:56.225474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1522/2514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:56.245224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40432d17-3f15-4411-be9f-8e93b5119c4d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912f29d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.296542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40432d17-3f15-4411-be9f-8e93b5119c4d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.057788 Aug 24 01:59:56.299247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1523/2515] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:56.313747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.315876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:56.322668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.323164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.323604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.324323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.324793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.325243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.483993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:56.494831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-544fab8b-5635-4b84-b185-14e655110b4d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1473 microversion: 2.1 time: 0.184873 Aug 24 01:59:56.495658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1524/2516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 01:59:56.507212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.507834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:56.516317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.516949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.517581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.518316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.518889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.519932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.684759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:56.696091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5be14b21-72c0-4591-80e0-5f44721c966f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.193373 Aug 24 01:59:56.708748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1525/2517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:56.708748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.708748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:56.716359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.716894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.717402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.718323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.718991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.719423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.794466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:56.803774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1292da69-d5e7-4007-bffe-81e256251a5d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 200 len: 1184 microversion: 2.1 time: 0.105656 Aug 24 01:59:56.804363 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1526/2518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 1184 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:56.936636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:56.937449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:56.948488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.949091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.949540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:56.950258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:56.950722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:56.951299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:57.126705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:57.186916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:57.186916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:57.186916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2e4b74d-a634-45b8-bd50-36b34a349403 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1565 microversion: 2.25 time: 0.228032 Aug 24 01:59:57.186916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1527/2519] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:56 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:57.267988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:57.487114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:57.501263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec353ff0-0d8c-4553-8a91-6268cea44848 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1508 microversion: 2.1 time: 0.257414 Aug 24 01:59:57.514921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1528/2520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:57 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:57.514921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a0048a9-6dab-4662-a8ac-c10fdfd7db9e tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912f2820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:57.590254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a0048a9-6dab-4662-a8ac-c10fdfd7db9e tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.087341 Aug 24 01:59:57.590846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1529/2521] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:57 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:57.595573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:57.596373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:57.603639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:57.604358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:57.604992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:57.605849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:57.606461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:57.607042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.103375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:58.118078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93d63b2b-7574-45c7-83b6-fde445f62051 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1473 microversion: 2.1 time: 0.523284 Aug 24 01:59:58.119207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1530/2522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:57 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1473 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:58.129044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:58.129702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:58.141986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.142867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.147295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.147864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.148327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.148802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.522561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:58.530530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a9fa8c5-576a-41c0-a4a8-c6ab9a19ea63 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.410187 Aug 24 01:59:58.541847 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1531/2523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:58 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:58.546847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:58.547659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: f7999602-8784-4cf5-ac70-92a84c698b78] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:58.564848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.565597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.566276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.567742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.568210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.568644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.603209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] HTTP exception thrown: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Request method failure captured: Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 HTTP/1.1 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYR1bLRc5Id1CpQkTITJQPPnvcLDBxk-2xssQ0cBbJxhSwWdS3QoYXwfLcdtQQikLXU2lCx6e-FO4ka4cFq1QD1rUM1iaeCIspAQt3cHyOSjQ4oDdRPRxjQMDQaKyJws-L3jxQe7a0sDPfvI10RF3JpzeVBmX4_bz3BHrw0YDVOefko Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveMigrationTest-752149381 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveMigrationTest-752149381 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveMigrationTest-752149381 Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveMigrationTest-752149381-project Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aa9308751b9454b8d173b034f4b040b Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveMigrationTest-752149381-project Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f7999602-8784-4cf5-ac70-92a84c698b78'} Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 01:59:58.605239 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Returning 404 to user: Instance f7999602-8784-4cf5-ac70-92a84c698b78 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b8e7898-8b7b-4578-a253-1b0b164600be tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78" status: 404 len: 111 microversion: 2.1 time: 0.063670 Aug 24 01:59:58.609826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1532/2524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:58 2022] GET /compute/v2.1/servers/f7999602-8784-4cf5-ac70-92a84c698b78 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 01:59:58.616113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:58.616756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:58.644430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.644983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.645421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:58.646357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:58.646976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:58.647564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.096998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:59.107898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:59.122780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:59.124694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-614a7929-9320-4566-b53a-ca24496a9b4b tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1565 microversion: 2.25 time: 0.513111 Aug 24 01:59:59.125901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1533/2525] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 01:59:58 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1565 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 01:59:59.131292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:59.132164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:59.143916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.145012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.148011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.149081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.149663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.151028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.480828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:59.490223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b23ba28-3a98-44a2-92c8-cce558d913b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1451 microversion: 2.1 time: 0.362220 Aug 24 01:59:59.514837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1534/2526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:59 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1451 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:59.521086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6f69caa-af23-40cb-9b49-941cac661f42 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912f2a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:59.620277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6f69caa-af23-40cb-9b49-941cac661f42 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.104089 Aug 24 01:59:59.621706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1535/2527] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 01:59:59 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:59.627195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:59.631160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:59.644305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.645187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.653726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.655381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.656030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.656579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.749573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.750393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.751063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.751735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lazy-loading 'fault' on Instance uuid a228e2c0-b381-4ac3-b084-82e5367511a6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 01:59:59.846288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 01:59:59.855319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-088218a9-9ad2-422c-b75f-2f899ddad8a2 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 200 len: 1307 microversion: 2.1 time: 0.232220 Aug 24 01:59:59.856388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1536/2528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:59 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 01:59:59.863476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a228e2c0-b381-4ac3-b084-82e5367511a6", "name": "network-vif-deleted", "tag": "f819dab9-06c6-4c08-b91b-a1a339a95bb2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 01:59:59.874485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.875223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.875884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.890418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] Creating event network-vif-deleted:f819dab9-06c6-4c08-b91b-a1a339a95bb2 for instance a228e2c0-b381-4ac3-b084-82e5367511a6 on n-h1-854121-3 Aug 24 01:59:59.904796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f6a5f4e6-23ab-4a2e-9adf-65dc4c20e637 req-ddf99605-ba67-418d-8fed-b7816e9ef242 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046422 Aug 24 01:59:59.909782 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1537/2529] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 01:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 01:59:59.922040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 01:59:59.925760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 01:59:59.933157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.933925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.934593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 01:59:59.935534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 01:59:59.936216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 01:59:59.937002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.147412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:00.155710 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96e9e156-afa4-4305-ae54-f40b6dbfbaa4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1451 microversion: 2.1 time: 0.244492 Aug 24 02:00:00.173503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1538/2530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 01:59:59 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1451 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:00.201147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:00.201795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:00.218976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.219573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.220023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.220760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.221317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.221750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.422223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:00.432511 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b93490b-4a12-4f16-b20b-03368b3ca405 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.249871 Aug 24 02:00:00.441824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1539/2531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:00 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:00.449450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:00.450068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:00.456851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.457341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.457778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.458477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.458927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.459364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.519513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.519999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.520546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.521040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lazy-loading 'fault' on Instance uuid 96a9043c-8cda-43e7-97be-1345fefa5e8d {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:00.605039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:00.616068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:00.617941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6223af42e4e34d7cb4f327824ac148af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a49d21a3bf48cda64bd438f11e6363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:00.620547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91b14048-9da7-4a83-b295-8e6cf3a01277 tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 200 len: 1352 microversion: 2.25 time: 0.176257 Aug 24 02:00:00.634513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1540/2532] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:00:00 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 1352 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:00:00.645604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:00.646149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:00.653012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.654602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.655197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.656132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.656760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.657346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.689314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'flavor' on Instance uuid 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:00.703484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'shelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state shelved_offloaded Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: {"shelve": {}} Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'shelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state shelved_offloaded Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'shelve': {}}} Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:00:00.706973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state shelved_offloaded Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state shelved_offloaded Aug 24 02:00:00.710933 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:00.712282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'shelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state shelved_offloaded {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:00.713332 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e23e0a0-cd13-421c-bf6c-86d20cb52ecb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 155 microversion: 2.1 time: 0.077734 Aug 24 02:00:00.714452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1541/2533] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:00 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 155 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:00:00.720211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89e43b6b-7ea5-43c9-af3f-a4e3a163bc93 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91f52b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:00.791840 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89e43b6b-7ea5-43c9-af3f-a4e3a163bc93 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.075265 Aug 24 02:00:00.792403 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1542/2534] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:00:00 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:00.807091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:00.809049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:00.830518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.831016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.832157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.832910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:00.833372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:00.833798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:00.880200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:00.911443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:00.915967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128567) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 02:00:01.037706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c331b57-e8ba-4e3e-ab0d-90630651086d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.240591 Aug 24 02:00:01.040251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1543/2535] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:00 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:01.051137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:01.059359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: a228e2c0-b381-4ac3-b084-82e5367511a6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:01.083792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.086917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.091091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.093943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.094438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.094887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.137967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 HTTP/1.1 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a228e2c0-b381-4ac3-b084-82e5367511a6'} Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:01.139800 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance a228e2c0-b381-4ac3-b084-82e5367511a6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62e4c589-31e2-4bd0-a77f-07165c44962c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6" status: 404 len: 111 microversion: 2.1 time: 0.099190 Aug 24 02:00:01.143028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1544/2536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:01 2022] GET /compute/v2.1/servers/a228e2c0-b381-4ac3-b084-82e5367511a6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:01.148048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:01.148771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:01.161009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.161731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.162172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.162931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.163375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.163800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.457197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:01.477201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72497302-37a0-4ffe-8d05-b7c3ed141a79 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1459 microversion: 2.1 time: 0.331712 Aug 24 02:00:01.479121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1545/2537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:01 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1459 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:01.493769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:01.506128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:01.521231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.523951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.525251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.528456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.529066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.529913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.577968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:01.705510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9af972c-0062-4eaf-9be3-e1c54b8e1d12 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 204 len: 0 microversion: 2.1 time: 0.223957 Aug 24 02:00:01.710159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1546/2538] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:01 2022] DELETE /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:01.716693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:01.717693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:01.725081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.725869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.726575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:01.727569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:01.728308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:01.729005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.065538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:02.077251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37063419-686c-4ad7-82e7-be6746fb05f7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.365412 Aug 24 02:00:02.090654 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1547/2539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:01 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:02.106163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:02.111253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] [instance: 96a9043c-8cda-43e7-97be-1345fefa5e8d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:02.137318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.138063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.142498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.143489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.145424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.150516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.208420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] HTTP exception thrown: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Request method failure captured: Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d HTTP/1.1 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYQS28zytDL5oEzr9H21NTO1-GeBc4g-F4KRkgZdtTXpjb06FH8bWOUdbBZb6Z1tfaS2ocCNeFCB_hz27Q8Y2QOHOrJ0rlRijkx47OOGEiL8Q6y9htUUWtjIhv6Z8jFOJm3MHD_mPZzhJmJbLSPBj1qctp9PkMy9EymBLBFYwrDjrOE Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.25 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_74a49d21a3bf48cda64bd438f11e6363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 74a49d21a3bf48cda64bd438f11e6363 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153 Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6223af42e4e34d7cb4f327824ac148af Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2131059153-project Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '96a9043c-8cda-43e7-97be-1345fefa5e8d'} Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. Aug 24 02:00:02.214342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. Aug 24 02:00:02.219669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:02.221729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] Returning 404 to user: Instance 96a9043c-8cda-43e7-97be-1345fefa5e8d could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:02.223835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ef58e0f-a4b1-4f84-8fe9-8c1806ec7c0a tempest-LiveAutoBlockMigrationV225Test-2131059153 tempest-LiveAutoBlockMigrationV225Test-2131059153-project] 10.222.0.49 "GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d" status: 404 len: 111 microversion: 2.25 time: 0.131967 Aug 24 02:00:02.233881 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1548/2540] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:00:02 2022] GET /compute/v2.1/servers/96a9043c-8cda-43e7-97be-1345fefa5e8d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:00:02.241131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:02.254502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:02.275410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.276638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.278357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.280446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.281149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.282090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.333738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:02.539028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16a929bf-ed51-46dc-9cb2-f4d4c51b3028 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 204 len: 0 microversion: 2.1 time: 0.306152 Aug 24 02:00:02.545641 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1549/2541] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:02 2022] DELETE /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:02.554654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-facfa995-e840-46a0-a2d9-18386a574c29 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91239d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:02.621360 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-facfa995-e840-46a0-a2d9-18386a574c29 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1452 microversion: 2.1 time: 0.074198 Aug 24 02:00:02.633340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1550/2542] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:00:02 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1452 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:02.633340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a9043c-8cda-43e7-97be-1345fefa5e8d", "name": "network-vif-deleted", "tag": "601fde78-de20-487b-ba11-2b5778ebefcd"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:02.659644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.660072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.665267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.683178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] Creating event network-vif-deleted:601fde78-de20-487b-ba11-2b5778ebefcd for instance 96a9043c-8cda-43e7-97be-1345fefa5e8d on n-h1-854121-3 Aug 24 02:00:02.690065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-09ec990a-7f28-499c-b42c-69cd40361eac req-7250c3ce-ace4-496e-9d6d-5684daf6433b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061350 Aug 24 02:00:02.691790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1551/2543] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:02.697896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:02.698621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:02.705554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.706106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.706536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:02.708049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:02.708607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:02.708968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:03.169049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:03.211611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ad66bb4-fccd-4e77-b485-5cdf092bbf42 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1459 microversion: 2.1 time: 0.518395 Aug 24 02:00:03.257814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1552/2544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:02 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1459 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:03.270647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:03.271566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:03.295913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:03.306715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:03.307181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:03.319492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:03.320760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:03.321230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:04.174266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:04.182781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f196dcb8-172b-4bd7-92c9-63a6acb806b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1474 microversion: 2.1 time: 0.923450 Aug 24 02:00:04.183575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1553/2545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:03 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1474 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:04.200736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:04.201353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:04.216294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:04.216837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:04.217262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:04.217972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:04.218427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:04.218855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:04.835837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:04.849028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-598be2ea-956a-4020-8d3d-b8035dcf0d35 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.652003 Aug 24 02:00:04.850849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1554/2546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:04 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:04.863542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-887e01e7-164d-4592-9031-755d9710ae4b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b914bf790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:04.964205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-887e01e7-164d-4592-9031-755d9710ae4b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1461 microversion: 2.1 time: 0.111677 Aug 24 02:00:04.965001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1555/2547] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:00:04 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:04.978923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:04.979782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:04.986422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:04.987214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:04.988440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:04.989344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:04.989949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:04.990524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.517481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:05.535328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85ee22e9-16fc-4148-914b-5150a8f77e9a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.561479 Aug 24 02:00:05.554733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1556/2548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:04 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:05.564134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:05.564134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:05.571856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.572356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.572837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.573567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.574218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.574660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.612445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:05.679740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:05.709103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a41fcedf-c6e9-4d9d-989d-c894c7d43949 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 204 len: 0 microversion: 2.1 time: 0.151082 Aug 24 02:00:05.709706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1557/2549] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:05 2022] DELETE /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:05.717682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc9e330-9e0a-4bb9-996a-6d1ba23898ee", "name": "network-vif-deleted", "tag": "f403a146-f0c3-456f-b9a6-1853bfd8798e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:05.727458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.727658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.727979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.740489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] Creating event network-vif-deleted:f403a146-f0c3-456f-b9a6-1853bfd8798e for instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee on n-h2-854121-3 Aug 24 02:00:05.745267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0087ebf9-0752-45f5-ac70-77580ac5d65a req-c44048a8-321e-4171-9b13-c46d46a51e8c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031353 Aug 24 02:00:05.745918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1558/2550] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:05.751113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e301d7d-79f6-493c-b4af-831f3dd31c7d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b917e7e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:05.833888 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e301d7d-79f6-493c-b4af-831f3dd31c7d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 200 len: 1461 microversion: 2.1 time: 0.086660 Aug 24 02:00:05.834932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1559/2551] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:00:05 2022] GET /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:05.840128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:05.841713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:05.850457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.851397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.852001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.854671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.855939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.856374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.906668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:05.907449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:05.907959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:05.908495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lazy-loading 'fault' on Instance uuid 70b1433e-00c4-434a-8612-ea0e9d67a263 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:06.140630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:06.157595 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ba80e06-a512-4e8c-9663-9d2fdf4c383c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 200 len: 1309 microversion: 2.1 time: 0.321321 Aug 24 02:00:06.173140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1560/2552] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:05 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:06.179854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:06.180507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:06.188061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:06.188839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:06.189441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:06.190477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:06.191661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:06.192231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:06.913883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:06.925292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d7381b8-9e82-4620-8a59-e9117d352059 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1666 microversion: 2.1 time: 0.750511 Aug 24 02:00:06.926596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1561/2553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:06 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1666 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:06.933077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b1433e-00c4-434a-8612-ea0e9d67a263", "name": "network-vif-deleted", "tag": "70e55243-52b6-4db8-8607-d4a0a5b5b6f8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:06.947908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:06.948757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:06.949505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:06.965561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] Creating event network-vif-deleted:70e55243-52b6-4db8-8607-d4a0a5b5b6f8 for instance 70b1433e-00c4-434a-8612-ea0e9d67a263 on n-h1-854121-3 Aug 24 02:00:06.970812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dae2c00b-0f28-4c74-9595-2fea4842ce9c req-2583b26e-9c9b-4ad3-92b4-99afab1fb4ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 Aug 24 02:00:06.971741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1562/2554] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:06.978795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:06.979676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:06.987778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:06.989056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:06.989784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:06.991260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:06.991831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:06.992367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:07.451985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:07.460417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c453e0b3-5054-4862-9a23-1f1b1ca3b8ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1466 microversion: 2.1 time: 0.486637 Aug 24 02:00:07.461033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1563/2555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:06 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1466 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:07.477077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:07.477268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:07.483183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:07.483676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:07.484118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:07.485135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:07.485295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:07.485721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:07.858550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:07.866506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c511a6a5-b5e9-45fd-bb71-7c41660866db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.404496 Aug 24 02:00:07.867079 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1564/2556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:07 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:07.880868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:07.880868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:07.885959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:07.886488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:07.886873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:07.887968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:07.888048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:07.888421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:08.138036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:08.149690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18e2716f-0934-4a01-8485-6eece101bbb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.281538 Aug 24 02:00:08.165670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1565/2557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:07 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:08.173224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-unplugged", "status": "completed", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:08.188108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:08.188916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:08.189533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:08.204218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] Creating event network-vif-unplugged:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 02:00:08.211214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d762e8ee-a8d1-4e63-a5f6-2b74476f3232 req-a3f17997-27b7-4702-9f30-4aa0fb2f8c45 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043844 Aug 24 02:00:08.212504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1566/2558] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:08.220416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:08.221442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 70b1433e-00c4-434a-8612-ea0e9d67a263] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:08.269289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:08.270182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:08.270782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:08.273549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:08.274237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:08.275572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:08.321016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 HTTP/1.1 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '70b1433e-00c4-434a-8612-ea0e9d67a263'} Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:08.328465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 70b1433e-00c4-434a-8612-ea0e9d67a263 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:08.332235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8919af61-d558-4cbd-aabb-94f3addf3d79 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263" status: 404 len: 111 microversion: 2.1 time: 0.114477 Aug 24 02:00:08.333007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1567/2559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:08 2022] GET /compute/v2.1/servers/70b1433e-00c4-434a-8612-ea0e9d67a263 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:08.342520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3aeb3f66-c50d-4749-8bcd-3ea8145d213f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91756310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:08.603074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3aeb3f66-c50d-4749-8bcd-3ea8145d213f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?changes-since=2022-08-24T01%3A57%3A51Z" status: 200 len: 1902 microversion: 2.1 time: 0.262146 Aug 24 02:00:08.604202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1568/2560] 10.222.0.49 () {58 vars in 1199 bytes} [Wed Aug 24 02:00:08 2022] GET /compute/v2.1/images?changes-since=2022-08-24T01%3A57%3A51Z => generated 1902 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:08.613420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:08.615283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:08.632808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:08.633470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:08.634048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:08.634874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:08.637347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:08.637947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.314101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:09.322806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a69d3e0-9ee2-4c8a-9ba8-d76be8348800 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1666 microversion: 2.1 time: 0.717432 Aug 24 02:00:09.323373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1569/2561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:08 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1666 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:09.328024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:09.328970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:09.335782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.337123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.337725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.338755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.339366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.340511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.355803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee HTTP/1.1 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3fc9e330-9e0a-4bb9-996a-6d1ba23898ee'} Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:09.357887 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 3fc9e330-9e0a-4bb9-996a-6d1ba23898ee could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:09.361984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84921af5-421e-4571-8a1d-d9da44760516 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee" status: 404 len: 111 microversion: 2.1 time: 0.034943 Aug 24 02:00:09.363095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1570/2562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:09 2022] GET /compute/v2.1/servers/3fc9e330-9e0a-4bb9-996a-6d1ba23898ee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:09.369082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-761c2604-69a1-4c02-b9fb-1f9d7c416fc0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b92451a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:09.425202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-761c2604-69a1-4c02-b9fb-1f9d7c416fc0 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-734904069" status: 200 len: 484 microversion: 2.1 time: 0.060688 Aug 24 02:00:09.426564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1571/2563] 10.222.0.49 () {58 vars in 1229 bytes} [Wed Aug 24 02:00:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-734904069 => generated 484 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:09.432736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:09.433618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:09.449016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.450434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.451137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.452745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.453589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.454214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.762801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:09.773449 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcc70704-32e7-46d2-942a-7af6028fe935 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.344969 Aug 24 02:00:09.774247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1572/2564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:09 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:09.780399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:09.781275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:09.788016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.788505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.789064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:09.789661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:09.790276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:09.790706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:10.274431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:10.283593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dec1f75f-d865-4fa0-9f87-41bc8d35d4c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.508133 Aug 24 02:00:10.284183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1573/2565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:09 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:10.298746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:10.321415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:10.324345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:10.325044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:10.346520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] Creating event network-changed:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h2-854121-3 Aug 24 02:00:10.366086 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4503eb89-039d-415b-a508-b30148570e61 req-d594858f-e35a-4f0b-aee3-0e113174a75a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076787 Aug 24 02:00:10.373355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1574/2566] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:10.386749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8df9a658-9525-449c-84c1-2d4bb2375906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:10.444364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8df9a658-9525-449c-84c1-2d4bb2375906 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/b3aa66de-d603-4446-a6c6-0514b269345d" status: 204 len: 0 microversion: 2.1 time: 0.061699 Aug 24 02:00:10.446604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1575/2567] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:00:10 2022] DELETE /compute/v2.1/os-server-groups/b3aa66de-d603-4446-a6c6-0514b269345d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:10.458212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89ce9fb5-a9a4-4d96-a79b-1286597ffbab tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91564160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:10.729521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89ce9fb5-a9a4-4d96-a79b-1286597ffbab tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?server=08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 957 microversion: 2.1 time: 0.280403 Aug 24 02:00:10.730326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1576/2568] 10.222.0.49 () {58 vars in 1209 bytes} [Wed Aug 24 02:00:10 2022] GET /compute/v2.1/images?server=08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 957 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:10.745495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:10.747097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:10.770827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:10.772295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:10.775095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:10.776234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:10.779434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:10.780432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.030136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:11.050401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9950bcf0-3a17-408c-b04d-184a6e11fb55 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.316771 Aug 24 02:00:11.064803 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1577/2569] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:10 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:11.072561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:11.073950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:11.085945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.086714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.087915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.089115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.090886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.091750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.147201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:11.294732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9730dcb6-f2da-47ca-85ea-b32db4d5c6b4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 204 len: 0 microversion: 2.1 time: 0.227213 Aug 24 02:00:11.303530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1578/2570] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:11 2022] DELETE /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:11.309589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e931f853-99c7-4ed2-b2a2-df0d81914b30 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b924990d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:11.450938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e931f853-99c7-4ed2-b2a2-df0d81914b30 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 485 microversion: 2.1 time: 0.145774 Aug 24 02:00:11.452129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1579/2571] 10.222.0.49 () {58 vars in 1317 bytes} [Wed Aug 24 02:00:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 485 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:11.488278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:11.489201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:11.513844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.514404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.514896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.520323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.521245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.521829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.883621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:11.898109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-754935c0-d5f1-4241-9233-ffad866ef017 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.443414 Aug 24 02:00:11.900516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1580/2572] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:11 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:11.907161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:11.907967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:11.915512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.916166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.916601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:11.917333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:11.917783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:11.918208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.140419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:12.151276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5b98617-ac46-4c3e-8814-d77c1ae0f56f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.249495 Aug 24 02:00:12.166476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1581/2573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:11 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:12.171344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:12.171851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:12.179437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.180795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.182664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.183579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.184199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.184815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.206944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:12.216152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:12.302892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=5,nova_api:DELETE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:12.326703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6474957-8a5c-45ec-93f4-c4ab35f1a02d tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 204 len: 0 microversion: 2.1 time: 0.158957 Aug 24 02:00:12.328301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1582/2574] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:12 2022] DELETE /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:12.336530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22ae1207-fb2d-4045-a63c-283cd0184b11 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b926ce9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:12.405619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22ae1207-fb2d-4045-a63c-283cd0184b11 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 485 microversion: 2.1 time: 0.072930 Aug 24 02:00:12.406256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1583/2575] 10.222.0.49 () {58 vars in 1303 bytes} [Wed Aug 24 02:00:12 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 485 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:12.415678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:12.417261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:12.426809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.427472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.428078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.429632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.430334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.430755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.512095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:12.522118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc30bada-e69a-44dc-b482-23566bdee5dc tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.112186 Aug 24 02:00:12.523118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1584/2576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:12 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:12.528125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:12.528765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:12.535276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.535768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.536206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.536948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.537468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.537893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.707463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:12.716066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2edfd929-3f5d-417d-b8c6-133b0fcec4b1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.191876 Aug 24 02:00:12.727718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1585/2577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:12 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:12.727718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b89caa5-60e1-46ea-aacc-f826656d6a30 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b92a173a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:12.874129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b89caa5-60e1-46ea-aacc-f826656d6a30 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.155798 Aug 24 02:00:12.875513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1586/2578] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:00:12 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:12.881118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d27143-4863-40f2-a88f-e66e38f6b552", "name": "network-vif-deleted", "tag": "1da2727f-a184-4359-aae5-b90beb340cf7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:12.917117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:12.918141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:12.919760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:12.935514 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] Creating event network-vif-deleted:1da2727f-a184-4359-aae5-b90beb340cf7 for instance 38d27143-4863-40f2-a88f-e66e38f6b552 on n-h2-854121-3 Aug 24 02:00:12.951765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98e3c98f-530a-4631-aacd-715169f08752 req-b69cff1f-0c36-480d-971b-72b8466b375f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072819 Aug 24 02:00:12.954329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1587/2579] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:12.963025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49394f66-f632-4644-b676-529193a83456 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9249eca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:13.092833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49394f66-f632-4644-b676-529193a83456 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.134721 Aug 24 02:00:13.102776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1588/2580] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:00:12 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:13.113453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:13.114219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:13.138760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.140944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.141412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:13.142211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.145686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.147244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:13.403809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:13.426124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-495ecd82-26e6-45d7-99ab-511083735f3b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.322589 Aug 24 02:00:13.428310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1589/2581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:13 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:13.442066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79aa8015-258e-4297-a0f4-c950e81ba1b6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9251e0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:13.540590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79aa8015-258e-4297-a0f4-c950e81ba1b6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.108615 Aug 24 02:00:13.541340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1590/2582] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:13 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:13.558024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:13.559505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:13.571569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.572076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.572574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:13.573540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.573971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.574594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:13.884571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:13.895003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87832ee1-a4db-44f1-b44b-7525a58f108a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.352764 Aug 24 02:00:13.905154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1591/2583] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:13 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:13.915459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:13.916067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:13.922702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.922927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.923289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:13.924012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:13.924464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:13.925123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:14.041231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:14.051084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61f1113a-4240-4343-8d17-fed028b9dbff tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.144175 Aug 24 02:00:14.067042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1592/2584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:13 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:14.067042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-371264b2-5263-493e-83da-072456987489 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b917229d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:14.200780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-371264b2-5263-493e-83da-072456987489 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?changes-since=2022-08-24T01%3A57%3A45Z" status: 200 len: 6327 microversion: 2.1 time: 0.145212 Aug 24 02:00:14.202706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1593/2585] 10.222.0.49 () {58 vars in 1220 bytes} [Wed Aug 24 02:00:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-24T01%3A57%3A45Z => generated 6327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:14.208705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:14.209545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:14.223160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:14.224123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:14.224752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:14.226881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:14.227516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:14.228409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:14.519731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:14.533424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ead6e4f1-4667-4191-9f48-a0e9aa6af4f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.328107 Aug 24 02:00:14.535293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1594/2586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:14 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:14.540969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b937360-741b-4eb6-9396-b6e13b9fd459 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b912711f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:14.613287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b937360-741b-4eb6-9396-b6e13b9fd459 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-734904069" status: 200 len: 664 microversion: 2.1 time: 0.076689 Aug 24 02:00:14.614195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1595/2587] 10.222.0.49 () {58 vars in 1250 bytes} [Wed Aug 24 02:00:14 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-734904069 => generated 664 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:14.619172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:14.619790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:14.634620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:14.635035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:14.635477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:14.636204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:14.637356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:14.637799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:15.282981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:15.303973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb03c267-5ced-47e1-b987-7b206f9fdd73 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.680421 Aug 24 02:00:15.308118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1596/2588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:14 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:15.318133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95826578-39b1-4811-8109-ae4b61c68846 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91fb5700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:15.417838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95826578-39b1-4811-8109-ae4b61c68846 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1465 microversion: 2.1 time: 0.107096 Aug 24 02:00:15.419171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1597/2589] 10.222.0.49 () {58 vars in 1338 bytes} [Wed Aug 24 02:00:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fv2.1%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1465 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:15.424528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:15.425930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:15.456524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:15.457745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:15.458211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:15.458971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:15.459437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:15.460195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:15.744063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:15.753658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-211acf60-2b4b-4d7c-bc6e-5a19ff271f8f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.332876 Aug 24 02:00:15.766502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1598/2590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:15 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:15.775662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:15.776509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:15.787020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:15.787394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:15.787889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:15.788590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:15.789213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:15.789803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:15.916798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:15.933565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e46645ad-8bcb-4600-9c6f-8af68b79fbe9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.161377 Aug 24 02:00:15.951915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1599/2591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:15 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:15.960830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93aa9124-e4cf-4f69-b132-761a41436b6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b924badc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.037981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93aa9124-e4cf-4f69-b132-761a41436b6f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1465 microversion: 2.1 time: 0.084787 Aug 24 02:00:16.047929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1600/2592] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 24 02:00:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.49%2Fcompute%2Fservers%2F54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1465 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:16.051268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.054543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:16.066465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.068121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.069967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:16.071492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.074594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.075171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:16.315116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:16.328624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd55ccf8-ab15-4252-8214-828a8abe1e33 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.286743 Aug 24 02:00:16.340739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1601/2593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:16 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:16.340739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0023654-ac22-4def-bf0c-b26c5daadaf7 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b98adb160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.464799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0023654-ac22-4def-bf0c-b26c5daadaf7 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.133910 Aug 24 02:00:16.474746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1602/2594] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 02:00:16 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:16.474746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.474746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:16.480643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.480643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.480643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:16.481311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.481820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.482286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:16.709853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:16.722649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d9acdfd-9d75-45fe-8a42-c842f5dc28bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.255685 Aug 24 02:00:16.738877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1603/2595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:16 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:16.744434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b47a16bf-72bd-46c0-ad4e-1eda9a69449d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b98adb160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.840429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b47a16bf-72bd-46c0-ad4e-1eda9a69449d tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.100069 Aug 24 02:00:16.841090 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1604/2596] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 02:00:16 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:16.845609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:16.846218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:16.853278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.853753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.854192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:16.854899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:16.855371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:16.855808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:17.049056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:17.058385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15b360e8-7545-42d5-b449-6ab768e8420c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.216254 Aug 24 02:00:17.059198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1605/2597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:16 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:17.063798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eeda606-732d-46d9-815c-4fbd517a9ed1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b917e7670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:17.142613 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eeda606-732d-46d9-815c-4fbd517a9ed1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5" status: 200 len: 784 microversion: 2.1 time: 0.081585 Aug 24 02:00:17.143210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1606/2598] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:00:17 2022] GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5 => generated 784 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:17.150799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:17.152759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:17.162819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:17.163814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:17.164490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:17.165730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:17.166614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:17.168888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:17.259846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:17.277478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-416106bb-ad3b-4ad6-9b1e-758846ad9390 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.132270 Aug 24 02:00:17.278129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1607/2599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:17 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:17.285245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4fba7933-bc02-4b08-ae78-493ffd8fcc0a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b917e73a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:17.345822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4fba7933-bc02-4b08-ae78-493ffd8fcc0a tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.066628 Aug 24 02:00:17.357453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1608/2600] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:00:17 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:17.363048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:17.363675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:17.378487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:17.379952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:17.382350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:17.384828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:17.386374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:17.388228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:17.561043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:17.571437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f85495f4-453a-485c-a59b-34b46b7e6f77 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.212435 Aug 24 02:00:17.576758 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1609/2601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:17 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:17.577746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b8d8da1-5703-4a66-a902-96b6a64e29e3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b924badc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:18.410722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b8d8da1-5703-4a66-a902-96b6a64e29e3 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5" status: 204 len: 0 microversion: 2.1 time: 0.836880 Aug 24 02:00:18.414769 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1610/2602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:17 2022] DELETE /compute/v2.1/images/400061ea-c7d8-458e-87e7-ec7486c701e5 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:18.421059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:18.422620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:18.432018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.433189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.434348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.435646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.436435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.437104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.442872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:18.635691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:18.646167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5f90f98-b3ce-4d9a-9abb-4902d3a0433e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.229694 Aug 24 02:00:18.647265 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1611/2603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:18 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:18.656847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:18.658770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:18.667023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.667625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.668120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.668942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.669480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.669984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.833635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:18.843900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-446ee64a-7b6d-415b-b96a-74d3ef1b6e84 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.195343 Aug 24 02:00:18.844791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1612/2604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:18 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:18.851478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:18.852289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:18.870578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.871511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.872041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.872952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:18.873515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:18.874002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:18.945950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:18.954317 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-396defbb-7751-494c-9aa8-d0720e88e763 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.107070 Aug 24 02:00:18.968810 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1613/2605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:18 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:18.968810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c26b3ff4-d835-4216-a03d-4fa2518ad452 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b919000d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:19.890502 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c26b3ff4-d835-4216-a03d-4fa2518ad452 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d" status: 204 len: 0 microversion: 2.1 time: 0.929557 Aug 24 02:00:19.891304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1614/2606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:18 2022] DELETE /compute/v2.1/images/e55f0a9a-13a4-4175-a761-1429fa75900d => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:19.898900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:19.899518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:19.906072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:19.906560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:19.906993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:19.907691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:19.908140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:19.908562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.045912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:20.053833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ebd9eb7-09cf-4384-9dd3-d33e17693161 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.161336 Aug 24 02:00:20.054398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1615/2607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:19 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:20.058996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:20.059604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:20.065131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.066134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.066567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.067289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.067804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.068179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.194300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:20.202372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e14ab94-b2f4-4293-9e8c-163f11872a93 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.146812 Aug 24 02:00:20.202975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1616/2608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:20 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:20.207362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:20.207987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:20.213876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.214356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.214869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.215560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.216038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.216480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.345141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:20.352893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-466da0e5-fd40-4f9c-8a00-b3dadd9649b8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.148952 Aug 24 02:00:20.353466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1617/2609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:20 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:20.357787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bb31ea4-aaf4-497c-b665-19707e78090f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b924823a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:20.865472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bb31ea4-aaf4-497c-b665-19707e78090f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150" status: 204 len: 0 microversion: 2.1 time: 0.510882 Aug 24 02:00:20.866041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1618/2610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:20 2022] DELETE /compute/v2.1/images/38d296f4-4371-441c-8ad9-7007ebaa5150 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:20.870553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:20.871156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:20.877148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.877622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.878085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.878767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:20.879219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:20.879641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:20.946858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:20.954682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4128465e-653a-46fa-a710-f705a8e0074e tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.087708 Aug 24 02:00:20.955252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1619/2611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:20 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:21.071132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbce41a1-bd8f-4586-b056-f35842014141 tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] Calling method '.version_select at 0x7f6b918be940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.265198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbce41a1-bd8f-4586-b056-f35842014141 tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 8054 microversion: 2.1 time: 0.308806 Aug 24 02:00:21.265795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1620/2612] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:20 2022] GET /compute/v2.1/os-networks => generated 8054 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:21.271150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.271646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:21.278166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.278640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.279071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.279762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.280220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.280650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.305629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:21.379538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f203e79b-6e50-48b0-85f8-a1681577709b tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 204 len: 0 microversion: 2.1 time: 0.112552 Aug 24 02:00:21.380109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1621/2613] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:21 2022] DELETE /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:21.385088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.385761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:21.391403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.391878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.392306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.393016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.393464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.394546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.526898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:21.534690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a8df6ee-7f57-4b67-9769-fb51942a3581 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.153430 Aug 24 02:00:21.535267 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1622/2614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:21 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:21.539625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.540231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:21.545953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.546444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.546879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.547567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.548047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.548469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.673925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:21.682000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae99a9bf-a9ca-41ae-8907-0595c1eaa64d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.145795 Aug 24 02:00:21.682564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1623/2615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:21 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:21.686785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-408a7192-24a3-4c5f-ba21-86c479ce1d18 tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] Calling method '.version_select at 0x7f6b9167f550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.782374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-408a7192-24a3-4c5f-ba21-86c479ce1d18 tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks/e4e21d0c-49ed-41b8-af2c-c599dfad641a" status: 200 len: 652 microversion: 2.1 time: 0.098739 Aug 24 02:00:21.782957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1624/2616] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:00:21 2022] GET /compute/v2.1/os-networks/e4e21d0c-49ed-41b8-af2c-c599dfad641a => generated 652 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:21.787487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.788102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:21.794205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.794698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.795164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.795856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.796318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.796773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.925428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:21.933056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85092bff-0b0f-4833-a896-3996d7cac302 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.149123 Aug 24 02:00:21.933628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1625/2617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:21 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:21.938035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:21.938642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:21.946437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.946921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.947446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:21.948048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:21.948505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:21.948961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.079292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:22.087245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33f79c1b-d73b-4001-b294-9aeb58b88348 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1473 microversion: 2.1 time: 0.152684 Aug 24 02:00:22.087821 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1626/2618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:21 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1473 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:22.092002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22d033b1-acc6-49a9-ad85-81ee4ceeefde tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] Calling method '.version_select at 0x7f6b9192fca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:22.213324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22d033b1-acc6-49a9-ad85-81ee4ceeefde tempest-NetworksTest-1131506181 tempest-NetworksTest-1131506181-project-admin] 10.222.0.49 "GET /compute/v2.1/os-networks" status: 200 len: 8054 microversion: 2.1 time: 0.124449 Aug 24 02:00:22.213925 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1627/2619] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:22 2022] GET /compute/v2.1/os-networks => generated 8054 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:22.218804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:22.219443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:22.226010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.226504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.226951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.227683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.228268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.228913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.298510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:22.307302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-559fb7d7-eab8-4727-9601-a8b8d3e8a2d4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1599 microversion: 2.1 time: 0.092390 Aug 24 02:00:22.308127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1628/2620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:22 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1599 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:22.555250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:22.555895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:22.562443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.562924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.563357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.564044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.564494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.564944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.733691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:22.741497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f93713d-3bf1-476d-aa59-4287af54cf7c tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.190008 Aug 24 02:00:22.742077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1629/2621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:22 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:22.746558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:22.747191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:22.753139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.753675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.754226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.754821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.755353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.755805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.906273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:22.914562 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ab9ad0e-616e-413f-bde3-91bfb75018d2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1509 microversion: 2.1 time: 0.171366 Aug 24 02:00:22.915260 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1630/2622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:22 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:22.958032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:22.958998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:22.966954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.968009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.968521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.969441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:22.969905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:22.970469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:22.975438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:23.118127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:23.125975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df180b6f-19fc-43f8-b61e-e51ac6192e8c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.174230 Aug 24 02:00:23.126555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1631/2623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:22 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:23.131651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:23.132273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:23.137855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.138344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.138971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.139668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.140134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.140594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.279855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:23.287948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9eef66ee-9013-4d53-9187-8d93586aa5ea tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1473 microversion: 2.1 time: 0.160402 Aug 24 02:00:23.288526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1632/2624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:23 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1473 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:23.327589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:23.328265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:23.334515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.335004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.335441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.336140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.336658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.337144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.403205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:23.412078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed54430a-4e77-430a-af46-b7d0bb49009b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1319 microversion: 2.1 time: 0.088323 Aug 24 02:00:23.412670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1633/2625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:23 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:23.761937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:23.762550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:23.769105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.769609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.770041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.770727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.771175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.771596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.914309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:23.924198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65a5be16-4eef-478c-9259-dd6f85a844e4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.166005 Aug 24 02:00:23.925009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1634/2626] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:23 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:23.936813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:23.937419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:23.943369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.943848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.944283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:23.945047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:23.945505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:23.946195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.092785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:24.104478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6538c9e-2b5b-4e3b-a0fd-ed7c5e4952bc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1530 microversion: 2.1 time: 0.171617 Aug 24 02:00:24.105289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1635/2627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:23 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1530 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:24.147912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:24.148775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:24.154870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.155433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.155945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.156710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.157460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.157962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.294092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:24.302286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ecf7509-1a22-42d6-8318-3a84987e8b9d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.158670 Aug 24 02:00:24.302837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1636/2628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:24 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:24.317084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:24.317733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:24.323844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.324369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.324862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.325570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.326036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.326488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.461659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:24.470326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4dcad138-3d34-4b38-89bd-237c3cba8bc2 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1473 microversion: 2.1 time: 0.163522 Aug 24 02:00:24.470986 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1637/2629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:24 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:24.484751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:24.485337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:24.491512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.491976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.492407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.493132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.493582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.494003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.525395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.525872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.526302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.526745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:24.568590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:24.577257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f091dd1f-d81b-417e-ba1b-250f887123ee tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1324 microversion: 2.1 time: 0.105122 Aug 24 02:00:24.577823 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1638/2630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:24 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1324 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:24.946193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:24.946813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:24.953219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.953701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.954135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:24.954819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:24.955269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:24.955687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.082429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:25.090026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7312492d-08a9-41c5-bd94-47cc75284bf1 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.148053 Aug 24 02:00:25.090584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1639/2631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:24 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:25.204824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Action: 'update', calling method: .version_select at 0x7f6b924ba1f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:25.263968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.264456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.264940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.265678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.266143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.266577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.298735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:25.317030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f31919ba-5f2d-464b-859f-66e62f9ad989 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e" status: 200 len: 240 microversion: 2.36 time: 0.225433 Aug 24 02:00:25.317702 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1640/2632] 10.222.0.49 () {62 vars in 1303 bytes} [Wed Aug 24 02:00:25 2022] PUT /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e => generated 240 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:00:25.322400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:25.323019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:25.328749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.329256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.329745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.330388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.330845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.331893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.462856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:25.470550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70a8315a-837f-42b1-ba4e-22232faacba9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1530 microversion: 2.1 time: 0.151946 Aug 24 02:00:25.471125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1641/2633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:25 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1530 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:25.475499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:25.476110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:25.481739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.482230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.482672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.483365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.483822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.484272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.610706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:25.619399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b21c2bb3-afc3-4521-ac97-20f530150375 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.147320 Aug 24 02:00:25.619970 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1642/2634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:25 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:25.624767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Calling method '.version_select at 0x7f6b924828b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:25.688299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.688830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.689284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.689991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.690447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.691464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.710386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9501a48c-9279-444a-8934-fec790833821 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e/detail" status: 200 len: 672 microversion: 2.36 time: 0.089440 Aug 24 02:00:25.710979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1643/2635] 10.222.0.49 () {60 vars in 1304 bytes} [Wed Aug 24 02:00:25 2022] GET /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e/detail => generated 672 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:00:25.715419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:25.716055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:25.722420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.723045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.723484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.724246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.724803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.725314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.880253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:25.888266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e598c3fd-c289-488e-b632-539b49975ba1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1473 microversion: 2.1 time: 0.176266 Aug 24 02:00:25.888863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1644/2636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:25 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:25.893816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:25.894461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:25.900180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.900665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.901138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.901831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.902306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.902718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.936166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:25.936640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:25.937121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:25.937564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:26.003038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:26.011750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-318a70f4-e61d-4bda-8c9a-9589d580ba53 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1324 microversion: 2.1 time: 0.121368 Aug 24 02:00:26.020888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1645/2637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:25 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1324 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:26.020888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Action: 'update', calling method: .version_select at 0x7f6b91271c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:26.090421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.091109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.091723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.092589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.093215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.093786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.132498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.133222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.133805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.134673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.135275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.135848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.192593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f477f7d-6582-4bf6-a70e-9e66ff44e5c8 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e?user_id=b598416c5f704e85bb27617fb69d2d53" status: 200 len: 240 microversion: 2.36 time: 0.179416 Aug 24 02:00:26.193596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1646/2638] 10.222.0.49 () {62 vars in 1384 bytes} [Wed Aug 24 02:00:26 2022] PUT /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e?user_id=b598416c5f704e85bb27617fb69d2d53 => generated 240 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:00:26.205992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:26.207699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:26.215355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.215877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.216383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.217762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.218771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.218771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.452510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:26.460910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b600188-28b2-4276-8ab1-873f9febfabd tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1475 microversion: 2.1 time: 0.266259 Aug 24 02:00:26.461726 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1647/2639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:26 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:26.466590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b8d1ce1-e38e-44a7-924d-4da66a592f79 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] Calling method '.version_select at 0x7f6b91900a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:26.554732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b8d1ce1-e38e-44a7-924d-4da66a592f79 tempest-QuotasAdminTestV236-31956711 tempest-QuotasAdminTestV236-31956711-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e?user_id=b598416c5f704e85bb27617fb69d2d53" status: 200 len: 282 microversion: 2.36 time: 0.091810 Aug 24 02:00:26.555649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1648/2640] 10.222.0.49 () {60 vars in 1364 bytes} [Wed Aug 24 02:00:26 2022] GET /compute/v2.1/os-quota-sets/ba2811b9b48149868d293b752350da5e?user_id=b598416c5f704e85bb27617fb69d2d53 => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:00:26.560469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:26.561368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:26.568633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.569378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.570067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.571284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.571938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.572561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.757917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:26.765513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:26.776529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3fa486e-344d-45cc-8000-8b5f2320aa2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1530 microversion: 2.1 time: 0.219573 Aug 24 02:00:26.777597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1649/2641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:26 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1530 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:26.783525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad", "name": "network-vif-deleted", "tag": "e67c4267-ad7a-455d-a020-b89842be4979"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:26.797816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.798374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.798824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.816140 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] Creating event network-vif-deleted:e67c4267-ad7a-455d-a020-b89842be4979 for instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad on n-h2-854121-3 Aug 24 02:00:26.824305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f3a80f64-daa4-4a2c-a6f2-44017be6c735 req-6ce165ea-2489-4396-8b0f-9776f2b6c467 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044754 Aug 24 02:00:26.825414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1650/2642] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:26.830774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:26.832063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:26.840296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.840864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.841314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:26.842126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:26.842621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:26.843213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.019899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.028634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbc3b4c0-45e7-4dbc-807c-4eacafff1421 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.201923 Aug 24 02:00:27.031893 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1651/2643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:26 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:27.039277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.040470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:27.049753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.050824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.051277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.052339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.052888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.053322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.139048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.148679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f77c39e-8e92-485d-b6dc-e9e98d3b3431 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1431 microversion: 2.1 time: 0.115181 Aug 24 02:00:27.150082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1652/2644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1431 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:27.164880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.165896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:27.180577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.182094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.182876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.184096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.185012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.185753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.241016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.241676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.242741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.242982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:27.287755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.297021 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb5de436-68a5-46cf-b1ed-a817139b77f4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1324 microversion: 2.1 time: 0.145617 Aug 24 02:00:27.297988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1653/2645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:27.302309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2", "name": "network-vif-deleted", "tag": "d0a66c9a-177b-4812-a22e-2e9332494459"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:27.311657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.312110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.312992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.326169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] Creating event network-vif-deleted:d0a66c9a-177b-4812-a22e-2e9332494459 for instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 on n-h2-854121-3 Aug 24 02:00:27.332350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c71a38e5-abe5-4dcd-aeed-3bab2cdadf90 req-6a2698d7-5d9c-43e5-b252-c0093da8893c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Aug 24 02:00:27.332887 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1654/2646] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:27.338191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.342821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.343562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Searching by: {'deleted': False, 'project_id': '1d70e35c621c40f2b0484855a1da7340'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:00:27.348958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.349438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.350007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.350833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.351284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.351704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.377359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:00:27.411914 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-991733db-364d-47d6-b6ce-449c3addbf9e tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.077500 Aug 24 02:00:27.412894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1655/2647] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers => generated 340 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:27.429011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.433819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.434742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Searching by: {'deleted': False, 'project_id': '1d70e35c621c40f2b0484855a1da7340'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:00:27.440373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.441443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.441868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.442597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.443057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.443487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.479176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:00:27.523252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.531520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.532412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.532934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.674744 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57b9268e-56df-46aa-ba01-d9cb1facd4f0 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.249794 Aug 24 02:00:27.675999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1656/2648] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:27.680917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.681827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:27.693394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.693896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.694375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.695087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.695550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.696237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.762956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:27.770809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bd1db54-5c7e-4fec-9267-6e54a1bed1ed tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1433 microversion: 2.1 time: 0.093801 Aug 24 02:00:27.771389 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1657/2649] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1433 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:27.775889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e493403-46de-40bc-9a2c-295c0fb69377 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.784019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e493403-46de-40bc-9a2c-295c0fb69377 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011620 Aug 24 02:00:27.784674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1658/2650] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:27.797412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:27.798024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:27.804683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.805210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.805649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:27.806344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:27.806800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:27.807224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.002816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.011359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-102c65a5-6c54-4e9a-84bb-766588e313db tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1530 microversion: 2.1 time: 0.217836 Aug 24 02:00:28.012156 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1659/2651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:27 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1530 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:28.058327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.058940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.066518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.066775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.067927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.068893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.069536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.070155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.214535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.223128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-632d8654-9ce3-4b7a-8bfd-0ce61a1e4252 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.168671 Aug 24 02:00:28.223698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1660/2652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:28 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:28.235431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.236357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.244383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.245632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.246077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.246783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.247241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.247760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.311108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.321271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17b587af-e511-4f2a-aa41-68cbfd4e9bec tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1431 microversion: 2.1 time: 0.096169 Aug 24 02:00:28.321857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1661/2653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:28 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1431 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:28.326278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.326878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.332465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.332985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.333449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.334118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.334573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.335001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.370138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.370623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.371061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.372139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:28.414249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.422305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b14b7568-79c4-4bfb-909f-3a8c5509eaef tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1324 microversion: 2.1 time: 0.099482 Aug 24 02:00:28.422883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1662/2654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:28 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:28.427514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.428013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.434193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.435015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.435523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.436430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.436935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.437395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.463563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:28.551519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72c63b4d-1660-4ef2-a8e9-527dd52c7749 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 204 len: 0 microversion: 2.1 time: 0.127381 Aug 24 02:00:28.552121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1663/2655] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:28 2022] DELETE /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:28.560365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.561095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.566960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.567429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.567859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.568597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.569067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.569527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.731807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.742704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19221d36-441f-441a-9cc9-c98514ff259d tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1713 microversion: 2.1 time: 0.185831 Aug 24 02:00:28.744770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1664/2656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:28 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1713 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:00:28.792911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:28.793523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:28.803230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.803623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.804059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.804900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.805224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.805665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.822400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:28.880106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:28.893681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e078cc72-a030-4966-902a-858c59ee2a07 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1433 microversion: 2.1 time: 0.105014 Aug 24 02:00:28.908018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1665/2657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:28 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1433 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:28.908018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b365bb-3263-4136-919b-ce4d33c67ef7", "name": "network-vif-plugged", "status": "completed", "tag": "ad93bb3b-d7c6-4add-a08a-298b7e040c2b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:28.908018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:28.910967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:28.911449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:28.911929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:28.925397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] Creating event network-vif-plugged:ad93bb3b-d7c6-4add-a08a-298b7e040c2b for instance 70b365bb-3263-4136-919b-ce4d33c67ef7 on n-h1-854121-3 Aug 24 02:00:28.931295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bb534f6d-b84a-4025-8f6f-01bbce2a8c6e req-851b78a8-6576-4b3f-b8c7-70b8b736440e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034975 Aug 24 02:00:28.937684 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1666/2658] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:29.032596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.033856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.040956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.041440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.041876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.042562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.043009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.043430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.187238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:29.198284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93d51b60-e996-4ecc-a0f4-fc29201ce257 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1530 microversion: 2.1 time: 0.170382 Aug 24 02:00:29.198869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1667/2659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1530 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:29.244594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.245637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.251900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.252397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.253590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.254303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.254760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.255209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.400940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:29.413926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8a83c95-2bef-448f-8fe5-e1103bd0f4e4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.173343 Aug 24 02:00:29.416334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1668/2660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:29.419173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.419781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.427130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.427618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.428058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.428829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.429288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.429713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.505353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:29.514050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-605a2403-5ab0-4962-8698-26090cfa6cdf tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1303 microversion: 2.1 time: 0.098496 Aug 24 02:00:29.514906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1669/2661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:29.520430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53", "name": "network-vif-deleted", "tag": "646f1064-72d6-4593-995b-825a034bbb1a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:29.533735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.534805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.535615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.548971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] Creating event network-vif-deleted:646f1064-72d6-4593-995b-825a034bbb1a for instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 on n-h2-854121-3 Aug 24 02:00:29.555364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7c7b047c-9139-4ac6-9d6c-a7f22c233c0a req-bfa0f987-e819-47c0-aa19-08b8d7d8f09b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038975 Aug 24 02:00:29.555979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1670/2662] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:29.563063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.563759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.571774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.572271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.572738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.573876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.574343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.574782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.607846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.608326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.608783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.609287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid 38d27143-4863-40f2-a88f-e66e38f6b552 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:29.651955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:29.660325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1da60d2-a8d0-4481-976c-89f77ce2e8c9 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 200 len: 1324 microversion: 2.1 time: 0.102970 Aug 24 02:00:29.661240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1671/2663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 1324 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:29.764166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.764816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.770849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.771335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.771775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.772470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.772972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.773391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.953374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:29.963534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a1135c2-03db-4dc6-aae2-404b55c91266 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1713 microversion: 2.1 time: 0.203151 Aug 24 02:00:29.966082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1672/2664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1713 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:29.986549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:29.987138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:29.995648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:29.996230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:29.996794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:29.999648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:30.004234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:30.006880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:30.096094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:30.109077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc9d577d-4db1-44c1-ba37-d63a00ebb245 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1304 microversion: 2.1 time: 0.140804 Aug 24 02:00:30.122625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1673/2665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:29 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:30.230378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:30.231416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:30.256950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:30.257549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:30.257900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:30.261263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:30.264323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:30.265810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:30.450419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:30.461526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7006fe9-b9f9-4f86-a788-faadcdb67eb0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.243202 Aug 24 02:00:30.472846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1674/2666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:30 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:30.708486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eae63a2b-488d-4c85-8d49-7ed5dbebfb79 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] Action: 'create', calling method: .version_select at 0x7f6b9177bf70>, body: {"security_group": {"name": "tempest-securitygroup-1417603120", "description": "tempest-description-1611748019"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:31.107996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eae63a2b-488d-4c85-8d49-7ed5dbebfb79 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.643890 Aug 24 02:00:31.108832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1675/2667] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:00:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:31.114389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:31.115679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:31.125768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.126496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.126933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.127849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.128509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.129139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.321201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:31.333137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c55e52db-0e02-41e7-b7ee-ee0cdf74a63c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.222599 Aug 24 02:00:31.342129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1676/2668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:31 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:31.360628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:31.363443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:31.380544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.382680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.383143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.387638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.388800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.389413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.478895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.482343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.484745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.485475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lazy-loading 'fault' on Instance uuid 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:31.584055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:31.600600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf1b541e-38a3-47b9-a3fe-e1962db671e6 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 200 len: 1308 microversion: 2.1 time: 0.257367 Aug 24 02:00:31.602888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1677/2669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:31 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 1308 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:31.614230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:31.617946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: 38d27143-4863-40f2-a88f-e66e38f6b552] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:31.632189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.634623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.637528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.639148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.640087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.642143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.663856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] HTTP exception thrown: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Request method failure captured: Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 HTTP/1.1 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYR1bLRc5Id1CpQkTITJQPPnvcLDBxk-2xssQ0cBbJxhSwWdS3QoYXwfLcdtQQikLXU2lCx6e-FO4ka4cFq1QD1rUM1iaeCIspAQt3cHyOSjQ4oDdRPRxjQMDQaKyJws-L3jxQe7a0sDPfvI10RF3JpzeVBmX4_bz3BHrw0YDVOefko Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveMigrationTest-752149381 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aa9308751b9454b8d173b034f4b040b Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '38d27143-4863-40f2-a88f-e66e38f6b552'} Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:31.666526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. Aug 24 02:00:31.670186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:31.672672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Returning 404 to user: Instance 38d27143-4863-40f2-a88f-e66e38f6b552 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:31.673907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb87a9d4-c53a-4997-86df-ad097d65a657 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552" status: 404 len: 111 microversion: 2.1 time: 0.067438 Aug 24 02:00:31.675417 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1678/2670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:31 2022] GET /compute/v2.1/servers/38d27143-4863-40f2-a88f-e66e38f6b552 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:31.681473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:31.682389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:31.689595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.690485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.691179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.692182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:31.692920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:31.693561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:31.854727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:31.865489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee1884bf-ea2d-460f-be22-4bdcee1a7172 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1713 microversion: 2.1 time: 0.188781 Aug 24 02:00:31.866087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1679/2671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:31 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1713 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:31.875830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b02ce952-efd2-44f3-8b3e-d13a34ee1525 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] Action: 'create', calling method: .version_select at 0x7f6b916b6af0>, body: {"security_group": {"name": "tempest-securitygroup-444987168", "description": "tempest-description-1621106625"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:32.066062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b02ce952-efd2-44f3-8b3e-d13a34ee1525 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.198158 Aug 24 02:00:32.078948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1680/2672] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:00:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:32.113056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:32.113880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:32.155312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:32.155943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:32.156513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:32.157673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:32.158395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:32.159236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:32.227212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:32.228085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:32.228708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:32.229914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lazy-loading 'fault' on Instance uuid 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:32.286574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:32.296284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8037c82c-788c-4669-9f68-fc33759ec1ba tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 200 len: 1309 microversion: 2.1 time: 0.213783 Aug 24 02:00:32.297510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1681/2673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:32 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:32.306137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:32.306923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:32.313576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:32.314187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:32.314938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:32.316343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:32.316984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:32.317644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:32.498429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:32.517177 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89116c99-711e-4480-9567-7dee35c6e56f tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.217883 Aug 24 02:00:32.518591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1682/2674] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:32 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:32.523653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6bac3dd9-d524-4256-8f74-af1e45822078 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '.version_select at 0x7f6b917600d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:32.569402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6bac3dd9-d524-4256-8f74-af1e45822078 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782512612" status: 202 len: 0 microversion: 2.1 time: 0.049670 Aug 24 02:00:32.570329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1683/2675] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782512612 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:32.764518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3599111-dbde-4272-81fc-acf1b3d759e6 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] Action: 'create', calling method: .version_select at 0x7f6b918698b0>, body: {"security_group": {"name": "tempest-securitygroup-702658640", "description": "tempest-description-1357061967"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:33.360984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3599111-dbde-4272-81fc-acf1b3d759e6 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.789014 Aug 24 02:00:33.361974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1684/2676] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:00:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:33.367062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:33.367996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:33.382795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.384775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.385479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.386819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.389068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.389875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.588917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:33.599487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64160504-0617-4aa8-9364-b6561fa26689 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.235822 Aug 24 02:00:33.600605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1685/2677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:33 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:33.606738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aeced63-b65a-4093-9bd2-e41114150cd3", "name": "network-vif-deleted", "tag": "57670ca8-2837-4bc3-bc78-704d5acd1b46"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:33.616929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.617657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.618097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.655838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] Creating event network-vif-deleted:57670ca8-2837-4bc3-bc78-704d5acd1b46 for instance 1aeced63-b65a-4093-9bd2-e41114150cd3 on n-h2-854121-3 Aug 24 02:00:33.663884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6089b266-1020-4ebc-a3f5-801d7946708b req-b51d9af8-d3a7-4b15-ac7b-a77ae7bff329 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060088 Aug 24 02:00:33.664748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1686/2678] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:33.673216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:33.674129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:33.683786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.684361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.684844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.685707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.686172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.686595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.703885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] HTTP exception thrown: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Request method failure captured: Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 HTTP/1.1 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWYSguTTBrCAlvgclaOgzoIMxPFq4CQcMslF_c7N8_gc4YL059JLprNoebQvtkh_5kSqui2tMjU9UJZPPk9Ds-3E1katae460HzB7brDlq2j0JdRWNWDHK6sa-B9d59luZHtkgODo_5Cq_4CmIOR_iiWkfX2U82a3UeQfrM5lF2cbE Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4cebddd1936244c987047a24fdbbd78c Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4cebddd1936244c987047a24fdbbd78c Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListImageFiltersTestJSON-439749087-project Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58e8c56d2103491ba90d5c9090782cf3 Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListImageFiltersTestJSON-439749087-project Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2'} Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:33.705860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Returning 404 to user: Instance 54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:33.709494 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e37a1e9c-6732-421f-9093-928a2f4c834c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2" status: 404 len: 111 microversion: 2.1 time: 0.042169 Aug 24 02:00:33.712145 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1687/2679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:33 2022] GET /compute/v2.1/servers/54e3a9e2-a9f8-4157-8a25-f6cdd5337cc2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:33.719719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:33.719719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:33.727423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.728407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.728943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.729840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.730592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.730918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.779873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:33.834918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.837289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.838972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.839671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lazy-loading 'fault' on Instance uuid 1aeced63-b65a-4093-9bd2-e41114150cd3 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:33.902505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab8ae36a2e674bb3b0cab433cf834eb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d70e35c621c40f2b0484855a1da7340', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:33.919072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c0c053c-66e0-46a4-9a5a-dbc95be58b8a tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 200 len: 1367 microversion: 2.1 time: 0.205212 Aug 24 02:00:33.921019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1688/2680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:33 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:33.926912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "name": "network-vif-plugged", "status": "completed", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:33.941563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.942909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.942909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.954527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] Creating event network-vif-plugged:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h2-854121-3 Aug 24 02:00:33.959439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-18e501fd-c871-4be3-b2c8-90e4d20d3c7b req-4ac3168d-6eca-4b38-a4f1-e3db0e0987f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037204 Aug 24 02:00:33.964146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1689/2681] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:33.969606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:33.970743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:33.978791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.979233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.979677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.980394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:33.980883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:33.981313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:33.998583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad HTTP/1.1 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad'} Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:33.998814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:34.003524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-436d483d-3db7-437b-ab99-c3d82cea6269 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad" status: 404 len: 111 microversion: 2.1 time: 0.034825 Aug 24 02:00:34.004826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1690/2682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:33 2022] GET /compute/v2.1/servers/3f725dfd-f922-4bb8-a1f4-9c17e6cd2fad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:34.010138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34ba59e0-7654-4b8d-a00e-65b9c4bbd63d tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] Action: 'create', calling method: .version_select at 0x7f6b917670d0>, body: {"security_group": {"name": "tempest-securitygroup-770089087", "description": "tempest-description-1158658698"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:34.197914 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34ba59e0-7654-4b8d-a00e-65b9c4bbd63d tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.191986 Aug 24 02:00:34.198692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1691/2683] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:00:34 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:34.203372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:34.203990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:34.215196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.215697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.216396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.216930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.217395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.217823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.440776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:34.449031 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18914c97-f631-47c4-bf2a-469f072f4cea tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.249509 Aug 24 02:00:34.452925 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1692/2684] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:34 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:34.458005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:34.458804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:34.466049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.466742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.467371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.468388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.468884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.469313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.498878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:34.606046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80d3c820-ec15-48c6-af9c-ff527e89aac1 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 204 len: 0 microversion: 2.1 time: 0.154767 Aug 24 02:00:34.606907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1693/2685] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:34 2022] DELETE /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:34.612417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:34.613029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:34.623751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.624234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.624669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.625400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.625866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.626286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.658083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:34.751641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9938425-eea6-4412-b8a9-bd8b11737c6d tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 204 len: 0 microversion: 2.1 time: 0.142901 Aug 24 02:00:34.755814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1694/2686] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:34 2022] DELETE /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:34.761657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:34.762506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:34.769133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.769628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.770074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.770774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:34.771226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:34.771652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:34.786350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 HTTP/1.1 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53'} Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:34.788005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:34.792198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbefe5b3-7fab-4086-ae31-d3a4cf9965f4 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53" status: 404 len: 111 microversion: 2.1 time: 0.032361 Aug 24 02:00:34.793357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1695/2687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:34 2022] GET /compute/v2.1/servers/b6dea4bd-8587-4ae3-91ca-d0ae19ad6f53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:34.799255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c83f6bf-62d1-4ec9-bd3f-9372a7f7d5e9 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] Calling method '.version_select at 0x7f6b916abc10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:36.714586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c83f6bf-62d1-4ec9-bd3f-9372a7f7d5e9 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12362 microversion: 2.1 time: 1.919845 Aug 24 02:00:36.716132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1696/2688] 10.222.0.49 () {58 vars in 1191 bytes} [Wed Aug 24 02:00:34 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12362 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:00:36.721501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:36.722233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:36.730314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:36.731091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:36.731654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:36.732370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:36.732857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:36.733687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:36.956875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:36.966172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b3428bc-1091-4497-b318-0d82eaed447f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1472 microversion: 2.1 time: 0.248963 Aug 24 02:00:36.968553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1697/2689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:36 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1472 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:36.974226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:36.974894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:36.982035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:36.982634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:36.983214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:36.983928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:36.984520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:36.984828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.449908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=13 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:37.519470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=28 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:37.549168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:37.564238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52f114bc-115c-40ec-9215-e5df403fcd5c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1517 microversion: 2.1 time: 0.594471 Aug 24 02:00:37.568368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1698/2690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:37.578000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:37.579522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:37.595305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.598479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.599101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.602973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.603732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.604328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.655833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.656578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.657454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.658116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lazy-loading 'fault' on Instance uuid b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:37.728162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:37.737270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a17a5430-370b-441d-a716-fb06e6cb7bc1 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 200 len: 1301 microversion: 2.1 time: 0.167503 Aug 24 02:00:37.751442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1699/2691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:37 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 1301 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:37.751442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2be21bd8-fd23-46ca-8a2c-ba2301ce6fe5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:37.787252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2be21bd8-fd23-46ca-8a2c-ba2301ce6fe5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/12f429fa-dce0-4352-92d6-c30e4ec1277b" status: 204 len: 0 microversion: 2.1 time: 0.048042 Aug 24 02:00:37.787980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1700/2692] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:00:37 2022] DELETE /compute/v2.1/os-server-groups/12f429fa-dce0-4352-92d6-c30e4ec1277b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:37.796971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:37.797614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] [instance: 1aeced63-b65a-4093-9bd2-e41114150cd3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:37.818527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.819633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.820053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.821439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.821913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.823022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.840029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] HTTP exception thrown: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Request method failure captured: Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 HTTP/1.1 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYXBYDYr-JtRJWV5H_UdVlio8OBZD-vSHRRu_M7G-1m0buvYLOX5th3foR9t0CC6ogxm7MxQTlCl9oPYxWlfE4Sg8Mm9xrR21NcC4J6bwNuNYbqbEsWlOTuwP8cKMFgSYo__0ZfI62IFZv7OR-Ws_caf6HE7wAlnN5-uNTLDXNoNvaU Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1d70e35c621c40f2b0484855a1da7340 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestManualDisk-1006571898 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1d70e35c621c40f2b0484855a1da7340"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d70e35c621c40f2b0484855a1da7340"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1d70e35c621c40f2b0484855a1da7340"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1d70e35c621c40f2b0484855a1da7340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestManualDisk-1006571898 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1d70e35c621c40f2b0484855a1da7340 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestManualDisk-1006571898 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestManualDisk-1006571898-project Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ab8ae36a2e674bb3b0cab433cf834eb9 Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestManualDisk-1006571898-project Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1aeced63-b65a-4093-9bd2-e41114150cd3'} Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:37.842089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Returning 404 to user: Instance 1aeced63-b65a-4093-9bd2-e41114150cd3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b636078-60eb-4d09-8c99-09583fdffd88 tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3" status: 404 len: 111 microversion: 2.1 time: 0.054154 Aug 24 02:00:37.847596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1701/2693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:37 2022] GET /compute/v2.1/servers/1aeced63-b65a-4093-9bd2-e41114150cd3 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:37.852173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:37.853079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:37.859578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.860129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.860740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:37.861478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:37.862085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:37.862548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.080585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:38.103294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6339949f-7433-4195-98be-6cef0fa69207 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.255008 Aug 24 02:00:38.105627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1702/2694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:37 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:38.120706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4cb52e0-25a2-4770-80c2-be3f0f9dcb51", "name": "network-vif-deleted", "tag": "75fbdc04-f6fa-4246-9bd0-5a9066a115cb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:38.134541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.135031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.135499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.150635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] Creating event network-vif-deleted:75fbdc04-f6fa-4246-9bd0-5a9066a115cb for instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 on n-h2-854121-3 Aug 24 02:00:38.155386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5967e258-e114-4c53-9371-e35b496d0607 req-8b35757f-4b48-4fc9-a84d-c827c2332905 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045375 Aug 24 02:00:38.156242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1703/2695] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:38.161452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03018ea4-6947-4d19-8c4e-25184b98889d tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] Calling method '.version_select at 0x7f6b9125a160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:38.396150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03018ea4-6947-4d19-8c4e-25184b98889d tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.238857 Aug 24 02:00:38.397659 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1704/2696] 10.222.0.49 () {58 vars in 1191 bytes} [Wed Aug 24 02:00:38 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:38.403490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:38.404430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:38.419709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.420630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.421110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.421842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.422306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.422740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.457349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:38.562698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:38.580455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a967ff6-6b3b-4324-9897-55d3ed6602c5 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "DELETE /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 204 len: 0 microversion: 2.1 time: 0.180928 Aug 24 02:00:38.584846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1705/2697] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:38 2022] DELETE /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:38.589493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19cef975-dd88-464a-8418-8dfa4bbb30ac tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] Calling method '.version_select at 0x7f6b9125a310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:38.616590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19cef975-dd88-464a-8418-8dfa4bbb30ac tempest-ServersTestManualDisk-1006571898 tempest-ServersTestManualDisk-1006571898-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381427475" status: 202 len: 0 microversion: 2.1 time: 0.032912 Aug 24 02:00:38.620688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1706/2698] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381427475 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:38.622195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:38.623183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:38.636405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.636947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.637394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.638116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.638575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.639003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.688568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.689096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.689540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.690185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lazy-loading 'fault' on Instance uuid 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:38.693755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:38.762485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e8c56d2103491ba90d5c9090782cf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cebddd1936244c987047a24fdbbd78c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:38.774392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dd1436d-3be6-4ea2-bb9a-ef776a8d3e8f tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 200 len: 1307 microversion: 2.1 time: 0.155944 Aug 24 02:00:38.776381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1707/2699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:38 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:38.781310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08629532-3bf2-4ef5-9c67-415b8a6b2ac4", "name": "network-vif-deleted", "tag": "43b22f6c-af30-4c2b-ad3b-642d5129800e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:38.793974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:38.794544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:38.795057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:38.817148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] Creating event network-vif-deleted:43b22f6c-af30-4c2b-ad3b-642d5129800e for instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 on n-h1-854121-3 Aug 24 02:00:38.824018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bd9c9702-f72c-4a47-890f-6caa77b48b75 req-94f9108f-8ece-4040-b6ce-33decc70945c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046289 Aug 24 02:00:38.825733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1708/2700] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:38.832255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-006b0f00-e223-4c3c-8f9a-ac008d494409 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] Calling method '.version_select at 0x7f6b916b6b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:39.154727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-006b0f00-e223-4c3c-8f9a-ac008d494409 tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/92515a59-01c2-4d5d-badf-77d396cc6370" status: 202 len: 0 microversion: 2.1 time: 0.326269 Aug 24 02:00:39.155504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1709/2701] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:00:38 2022] DELETE /compute/v2.1/os-security-groups/92515a59-01c2-4d5d-badf-77d396cc6370 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:39.162108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:39.163455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:39.199884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.200556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.202908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.203753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.204329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.206980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.432353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:39.443947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04b0c374-fc2b-495f-8c5a-bbd8739825a8 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.286107 Aug 24 02:00:39.444744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1710/2702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:39 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:39.467778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:39.468633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:39.476253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.476797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.477206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.478065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.478859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.479430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.673849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:39.682577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cf83b56-792e-4d01-b0cc-d2ed076dc6d7 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1471 microversion: 2.1 time: 0.219131 Aug 24 02:00:39.683174 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1711/2703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:39 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:39.697887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:39.698825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: b4cb52e0-25a2-4770-80c2-be3f0f9dcb51] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:39.711496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.712016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.712455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.713211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.713666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.714087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.741304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] HTTP exception thrown: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Request method failure captured: Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 HTTP/1.1 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYR1bLRc5Id1CpQkTITJQPPnvcLDBxk-2xssQ0cBbJxhSwWdS3QoYXwfLcdtQQikLXU2lCx6e-FO4ka4cFq1QD1rUM1iaeCIspAQt3cHyOSjQ4oDdRPRxjQMDQaKyJws-L3jxQe7a0sDPfvI10RF3JpzeVBmX4_bz3BHrw0YDVOefko Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveMigrationTest-752149381 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aa9308751b9454b8d173b034f4b040b Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b4cb52e0-25a2-4770-80c2-be3f0f9dcb51'} Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:39.743003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Returning 404 to user: Instance b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:39.746772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff8bb9a4-3bff-4839-95ec-04f1b8d0d529 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51" status: 404 len: 111 microversion: 2.1 time: 0.050591 Aug 24 02:00:39.747286 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1712/2704] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:39 2022] GET /compute/v2.1/servers/b4cb52e0-25a2-4770-80c2-be3f0f9dcb51 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:39.758929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:39.759542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:39.770742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.771398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.771660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.772376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:39.774533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:39.779574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:39.938386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:39.962570 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-938c85a0-5099-45f0-8fc7-63ab766b9067 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.213526 Aug 24 02:00:39.964280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1713/2705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:39 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:39.968813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-200be094-3d3b-493f-8710-2416c4ecc29e tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] Calling method '.version_select at 0x7f6b917459d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:40.231335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-200be094-3d3b-493f-8710-2416c4ecc29e tempest-SecurityGroupsTestAdminJSON-601465446 tempest-SecurityGroupsTestAdminJSON-601465446-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/70a74870-77eb-4b3e-ba54-5bb77a7c60c6" status: 202 len: 0 microversion: 2.1 time: 0.265414 Aug 24 02:00:40.236675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1714/2706] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:00:39 2022] DELETE /compute/v2.1/os-security-groups/70a74870-77eb-4b3e-ba54-5bb77a7c60c6 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:40.242735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:40.243363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:40.273531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.274030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.274741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.275467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.275915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.276585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.464637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:40.480092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e463603b-3968-48c5-8656-94e9f31fa60f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.241441 Aug 24 02:00:40.480676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1715/2707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:40 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:40.508086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:40.509050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:40.516781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.517498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.517942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.519195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.519657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.520089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.552762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:40.671821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80fb53ba-11d4-4e3c-b45e-ef9593ef32e4 tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 204 len: 0 microversion: 2.1 time: 0.180098 Aug 24 02:00:40.673332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1716/2708] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:40 2022] DELETE /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:40.687325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:40.688302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] [instance: 08629532-3bf2-4ef5-9c67-415b8a6b2ac4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:40.695639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.696522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.697024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.699613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:40.699613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:40.699613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:40.716864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] HTTP exception thrown: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Request method failure captured: Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 HTTP/1.1 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYWYSguTTBrCAlvgclaOgzoIMxPFq4CQcMslF_c7N8_gc4YL059JLprNoebQvtkh_5kSqui2tMjU9UJZPPk9Ds-3E1katae460HzB7brDlq2j0JdRWNWDHK6sa-B9d59luZHtkgODo_5Cq_4CmIOR_iiWkfX2U82a3UeQfrM5lF2cbE Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4cebddd1936244c987047a24fdbbd78c Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4cebddd1936244c987047a24fdbbd78c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4cebddd1936244c987047a24fdbbd78c Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-439749087 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListImageFiltersTestJSON-439749087-project Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58e8c56d2103491ba90d5c9090782cf3 Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListImageFiltersTestJSON-439749087-project Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '08629532-3bf2-4ef5-9c67-415b8a6b2ac4'} Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:40.718603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Returning 404 to user: Instance 08629532-3bf2-4ef5-9c67-415b8a6b2ac4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:40.723048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3e6fddc-965e-41d9-a13c-16173a167632 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4" status: 404 len: 111 microversion: 2.1 time: 0.041172 Aug 24 02:00:40.724574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1717/2709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:40 2022] GET /compute/v2.1/servers/08629532-3bf2-4ef5-9c67-415b8a6b2ac4 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:40.729565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31522243-709d-400d-8cc0-c0a7b48a35cd tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] Calling method '.version_select at 0x7f6b9249e9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:41.015444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31522243-709d-400d-8cc0-c0a7b48a35cd tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/6baf8034-b7c0-45d2-9f6d-277f8c89d891" status: 202 len: 0 microversion: 2.1 time: 0.288809 Aug 24 02:00:41.022332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1718/2710] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:00:40 2022] DELETE /compute/v2.1/os-security-groups/6baf8034-b7c0-45d2-9f6d-277f8c89d891 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:41.036127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:41.040811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:41.054664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.060736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.062216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.064654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.065768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.066512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.267584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:41.282758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc26f208-0757-45c9-97d2-a14acdb4620f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.251496 Aug 24 02:00:41.296756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1719/2711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:41 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:41.296756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:41.296756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:41.314958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.316357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.317026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.317992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.318463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.318897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.516620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aa9308751b9454b8d173b034f4b040b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1ee336634941239acddd6889d6f2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:41.526572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a419038e-7bb0-4319-903e-9d4a8b276bdd tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 200 len: 1500 microversion: 2.1 time: 0.241576 Aug 24 02:00:41.527618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1720/2712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:41 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:41.532648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:41.533355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:41.550854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.551361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.554334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.555737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:41.556467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:41.556988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:41.727026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ad722eead04f7980bff23dde84f1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd75231c930634323908998c748d5e4dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:41.737044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e22ea41-8c93-4d55-a2f4-408d1419f417 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 200 len: 1471 microversion: 2.1 time: 0.208097 Aug 24 02:00:41.738822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1721/2713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:41 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:41.744339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-450606c1-3977-45db-a42a-2e4b3a5d4a24 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b91745dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:42.345041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-450606c1-3977-45db-a42a-2e4b3a5d4a24 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09" status: 204 len: 0 microversion: 2.1 time: 0.604620 Aug 24 02:00:42.345841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1722/2714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:41 2022] DELETE /compute/v2.1/images/3423bbff-f16b-4d04-9ba3-315669213a09 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:42.351216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:42.351790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:42.361858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:42.362392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:42.362884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:42.363545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:42.364005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:42.364433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:42.630825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:42.695505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2bfeeee-39cb-49af-8d6e-119dab17dbee tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1525 microversion: 2.1 time: 0.347912 Aug 24 02:00:42.698867 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1723/2715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:42 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1525 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:42.711130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b6522ff-22be-4d46-be99-a348708774a5 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] Calling method '.version_select at 0x7f6b91519430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:43.157849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b6522ff-22be-4d46-be99-a348708774a5 tempest-SecurityGroupsTestAdminJSON-821494283 tempest-SecurityGroupsTestAdminJSON-821494283-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/26362593-c67f-4ab6-9c49-52b276e3f75a" status: 202 len: 0 microversion: 2.1 time: 0.455098 Aug 24 02:00:43.157849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1724/2716] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:00:42 2022] DELETE /compute/v2.1/os-security-groups/26362593-c67f-4ab6-9c49-52b276e3f75a => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:43.171607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b774e74-13bf-4e3c-b0e9-3cd9dd7bd53c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:43.187287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5b774e74-13bf-4e3c-b0e9-3cd9dd7bd53c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b774e74-13bf-4e3c-b0e9-3cd9dd7bd53c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/f8006ca7-d820-4efd-b411-be6c4b0959bf/action HTTP/1.1 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: {"os-stop": {}} Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f8006ca7-d820-4efd-b411-be6c4b0959bf', 'body': {'os-stop': {}}} Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:43.194084 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. Aug 24 02:00:43.198039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.199777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b774e74-13bf-4e3c-b0e9-3cd9dd7bd53c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance f8006ca7-d820-4efd-b411-be6c4b0959bf has no mapping to a cell. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:43.200857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b774e74-13bf-4e3c-b0e9-3cd9dd7bd53c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/f8006ca7-d820-4efd-b411-be6c4b0959bf/action" status: 404 len: 117 microversion: 2.1 time: 0.043030 Aug 24 02:00:43.201660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1725/2717] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:43 2022] POST /compute/v2.1/servers/f8006ca7-d820-4efd-b411-be6c4b0959bf/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:43.215158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958ebf3c-bb2f-4596-bc40-d6335ff442ba", "name": "network-vif-deleted", "tag": "dbf46218-c5fa-486c-82fc-55873c34223e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:43.251803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.252313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.252804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.278672 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] Creating event network-vif-deleted:dbf46218-c5fa-486c-82fc-55873c34223e for instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba on n-h2-854121-3 Aug 24 02:00:43.288390 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3ade6604-c1cc-4f41-a135-bcaab5b47ce5 req-5cc4b7fd-6523-451b-8538-68381e319fa5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084008 Aug 24 02:00:43.290464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1726/2718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:43.297068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-941af76c-fe2d-4e10-98e2-17c880d46f0c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b915191f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:43.641060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-941af76c-fe2d-4e10-98e2-17c880d46f0c tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a" status: 204 len: 0 microversion: 2.1 time: 0.349177 Aug 24 02:00:43.642592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1727/2719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:43 2022] DELETE /compute/v2.1/images/80553b2a-b90f-4df7-bd29-50ab84d4cd1a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:43.649935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:43.651020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] [instance: e0e168b2-7e82-437b-864a-225d7b692ddb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:43.661243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.661937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.662568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.663492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.664131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.664897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.680857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] HTTP exception thrown: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Request method failure captured: Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb HTTP/1.1 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYR1bLRc5Id1CpQkTITJQPPnvcLDBxk-2xssQ0cBbJxhSwWdS3QoYXwfLcdtQQikLXU2lCx6e-FO4ka4cFq1QD1rUM1iaeCIspAQt3cHyOSjQ4oDdRPRxjQMDQaKyJws-L3jxQe7a0sDPfvI10RF3JpzeVBmX4_bz3BHrw0YDVOefko Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9b1ee336634941239acddd6889d6f2ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-LiveMigrationTest-752149381 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9b1ee336634941239acddd6889d6f2ea Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-LiveMigrationTest-752149381 Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aa9308751b9454b8d173b034f4b040b Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-LiveMigrationTest-752149381-project Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e0e168b2-7e82-437b-864a-225d7b692ddb'} Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.683132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. Aug 24 02:00:43.686700 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.689078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] Returning 404 to user: Instance e0e168b2-7e82-437b-864a-225d7b692ddb could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:43.690526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df9b0285-dc2c-455f-83c7-43ff3dd0f21b tempest-LiveMigrationTest-752149381 tempest-LiveMigrationTest-752149381-project] 10.222.0.49 "GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb" status: 404 len: 111 microversion: 2.1 time: 0.046405 Aug 24 02:00:43.696372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1728/2720] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:43 2022] GET /compute/v2.1/servers/e0e168b2-7e82-437b-864a-225d7b692ddb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:43.701476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:43.702353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] [instance: 958ebf3c-bb2f-4596-bc40-d6335ff442ba] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:43.710112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.710725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.711248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.712025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.712554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.713070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.732759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] HTTP exception thrown: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Request method failure captured: Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba HTTP/1.1 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYVuFYCVKJbUIW7CVwxsJXmrQj3jsoLHiWW9Ytavn_LHJjrpgJxfK1ka6it-pzfkCuqLQLpD-NNUlfa38NbB8XLUYHbqqpzTSQdprNeT3Z6VXB3J9AgEwG1sO7NNp1LuOeKerAadqzKmmYWXa-tL3pQghz1t3SrRMdHdYSDxZ8MMA1Y Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d75231c930634323908998c748d5e4dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d75231c930634323908998c748d5e4dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d75231c930634323908998c748d5e4dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d75231c930634323908998c748d5e4dd Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1459355187 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 45ad722eead04f7980bff23dde84f1e2 Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersOnMultiNodesTest-1459355187-project Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '958ebf3c-bb2f-4596-bc40-d6335ff442ba'} Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:43.744353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. Aug 24 02:00:43.747964 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:43.749726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] Returning 404 to user: Instance 958ebf3c-bb2f-4596-bc40-d6335ff442ba could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:43.750785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25baaf53-0de4-4809-b80e-c85ece742856 tempest-ServersOnMultiNodesTest-1459355187 tempest-ServersOnMultiNodesTest-1459355187-project] 10.222.0.49 "GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba" status: 404 len: 111 microversion: 2.1 time: 0.053460 Aug 24 02:00:43.751537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1729/2721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:43 2022] GET /compute/v2.1/servers/958ebf3c-bb2f-4596-bc40-d6335ff442ba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:43.756545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:43.757429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:43.763840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.764580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.765298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:43.766404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:43.767047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:43.767656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:44.087311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:44.101471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-870813a5-9938-449a-b4fa-ab07e8ec9f34 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.348655 Aug 24 02:00:44.102609 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1730/2722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:43 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:44.107334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4521ee29-7c65-41d0-9f12-195f2f4af442 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] Calling method '.version_select at 0x7f6b9125aee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:45.426229 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4521ee29-7c65-41d0-9f12-195f2f4af442 tempest-ListImageFiltersTestJSON-439749087 tempest-ListImageFiltersTestJSON-439749087-project] 10.222.0.49 "DELETE /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562" status: 204 len: 0 microversion: 2.1 time: 1.322365 Aug 24 02:00:45.427153 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1731/2723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:44 2022] DELETE /compute/v2.1/images/7d0dfd92-dd0d-4997-9b5a-09a79f814562 => generated 0 bytes in 1324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:45.435235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:45.436380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:45.443585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:45.447982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:45.448516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:45.449362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:45.450038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:45.450663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:45.773764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:45.794225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7934581-036e-4205-906a-142bf59517dc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1507 microversion: 2.1 time: 0.365800 Aug 24 02:00:45.795236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1732/2724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:45 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:45.817733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:45.818604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:45.827298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:45.828095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:45.828753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:45.830180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:45.831361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:45.832419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:46.072887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:46.091918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e599b17-17f2-42c0-8d1b-557ff3bcea26 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.278845 Aug 24 02:00:46.092520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1733/2725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:45 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:46.113392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e168b2-7e82-437b-864a-225d7b692ddb", "name": "network-vif-deleted", "tag": "931114a1-6b6b-4881-b4e0-c622ffab2d99"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:46.125730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:46.126629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:46.127252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:46.146259 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] Creating event network-vif-deleted:931114a1-6b6b-4881-b4e0-c622ffab2d99 for instance e0e168b2-7e82-437b-864a-225d7b692ddb on n-h2-854121-3 Aug 24 02:00:46.167889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1f31ebc1-0e2c-4779-a734-f20cae837f10 req-780231a8-7e93-4d56-85ce-96fe258a53f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061634 Aug 24 02:00:46.170239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1734/2726] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:46.182314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:46.183704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:46.192067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/019b9f1a-97af-4f3d-9165-38d4b7fa1cc6/action HTTP/1.1 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: {"suspend": {}} Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '019b9f1a-97af-4f3d-9165-38d4b7fa1cc6', 'body': {'suspend': {}}} Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:46.198460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:46.202657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:46.202657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:46.202657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. Aug 24 02:00:46.202657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:46.210573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 019b9f1a-97af-4f3d-9165-38d4b7fa1cc6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:46.211860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c90ff8fc-d05c-419f-bb32-fec2af59f853 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/019b9f1a-97af-4f3d-9165-38d4b7fa1cc6/action" status: 404 len: 111 microversion: 2.1 time: 0.039201 Aug 24 02:00:46.212463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1735/2727] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:46 2022] POST /compute/v2.1/servers/019b9f1a-97af-4f3d-9165-38d4b7fa1cc6/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:46.245279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:46.247534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:46.265957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:46.269442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:46.271599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:46.274812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:46.275507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:46.276115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:46.288469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:46.633246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:46.647727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4a77753-fa4b-4293-9571-5915ac1b4c0f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.421434 Aug 24 02:00:46.663479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1736/2728] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:46 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:46.675564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:46.676186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:46.684428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:46.685270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:46.685455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:46.686074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:46.686523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:46.686947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.224568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:47.234971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59ec0c82-ee70-41aa-84bd-31566876493b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.563238 Aug 24 02:00:47.236044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1737/2729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:46 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:47.243286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:47.244343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:47.253703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.254656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.255308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.256428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.257534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.258184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.539118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:47.568860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cedaf1a-1314-4d35-ae67-abd8d3f05ad6 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1507 microversion: 2.1 time: 0.330825 Aug 24 02:00:47.571792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1738/2730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:47 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:47.584783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b365bb-3263-4136-919b-ce4d33c67ef7", "name": "network-vif-unplugged", "status": "completed", "tag": "ad93bb3b-d7c6-4add-a08a-298b7e040c2b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:47.604464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.604985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.605575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.619628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] Creating event network-vif-unplugged:ad93bb3b-d7c6-4add-a08a-298b7e040c2b for instance 70b365bb-3263-4136-919b-ce4d33c67ef7 on n-h1-854121-3 Aug 24 02:00:47.629363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-498abd14-b4c8-46ca-b70d-072f8998256d req-8a7e7cbd-23a7-4fc4-b914-2f713caddc19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054835 Aug 24 02:00:47.630473 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1739/2731] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:47.637036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:47.638077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:47.650677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.650677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.650677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.650964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.651777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.653290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.688950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'flavor' on Instance uuid 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:47.786225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03f436c7-85a2-4a70-92b6-9bcba6aca0c9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.151738 Aug 24 02:00:47.790500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1740/2732] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:47 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:47.797715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:47.798226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:47.817408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.819857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.820508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:47.821675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:47.823669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:47.824050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:48.004479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:48.019277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1da183d-beeb-4a52-ab50-94dda1973403 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1512 microversion: 2.1 time: 0.227071 Aug 24 02:00:48.022628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1741/2733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:47 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:48.972925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:48.974134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:48.981152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:48.981562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:48.981998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:48.982715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:48.983175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:48.983791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.130421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:49.140556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-475ca4a7-d7d0-4a61-b343-99b780a678c2 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 200 len: 1450 microversion: 2.1 time: 0.549865 Aug 24 02:00:49.146605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1742/2734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:48 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 1450 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:49.386629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Calling method '.version_select at 0x7f6b91519040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:49.402740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.403729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.404377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.405380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.406338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.407107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.433867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13777f73-bbf8-46a8-bc60-9e80e922e224 tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] 10.222.0.49 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.271956 Aug 24 02:00:49.444802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1743/2735] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 02:00:49 2022] GET /compute/v2.1/limits => generated 511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:49.444802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:49.444802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:49.451384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.464524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.465854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.468409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.469379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.473042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.734836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:49.744327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18d15753-65ae-4b2f-8c0c-fcd1d8ed266c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1495 microversion: 2.1 time: 0.308475 Aug 24 02:00:49.745439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1744/2736] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:49 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1495 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:49.757581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:49.758438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:49.765028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.765793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.766230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.767085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:49.767536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:49.768115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:49.808191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:00:49.816747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Working on deleting snapshot 80c99810-38ee-4222-bb01-0cf4546b8268 from shelved instance... Aug 24 02:00:50.902653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Doing local delete in cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128567) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 02:00:50.903685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:50.904394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:50.904962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:50.905632 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 02:00:50.909719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] deallocate_for_instance() {{(pid=128567) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 02:00:51.910000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Updating instance_info_cache with network_info: [] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 02:00:52.401942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0026fff0-9c4b-4ccc-924e-86cdd2c612e7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 204 len: 0 microversion: 2.1 time: 2.655187 Aug 24 02:00:52.402861 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1745/2737] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:00:49 2022] DELETE /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 0 bytes in 2657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:00:52.470469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:52.473182 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:52.473182 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:52.474345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:52.474840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:52.475288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:52.476015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:52.476640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:52.477099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:52.482082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:52.504819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b136a3dc-92db-4434-8252-a047253b9ebf tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.100726 Aug 24 02:00:52.505975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1746/2738] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:52 2022] GET /compute/v2.1/os-services => generated 944 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:52.511281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2034272368", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:52.581801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:00:53.015791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Getting quotas for project e4a14faf82594cec86c8688dfd9f365c. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:00:53.023374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=96,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:00:53.031065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Getting quotas for user fadf0358969c407aa8f8ddb528ebd33b and project e4a14faf82594cec86c8688dfd9f365c. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:00:53.084232 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Request method failure captured: Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 1752 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZQ5Y-LzvwgfMYX9Gbs17bEv1jGk1YrPuXP85JpDPqoUH0VEWmpWcMKFVQoiRKxMiWva-y9rHEYbQRj4BbDxmjXzJNOmHoiwqTjii-SFysr89IFyRE6EG3kSf0lGupK_YqRB_EwgXZqXrpNclE1Vj_xzOnySOiL60PHSGqHWvq-NGU Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e4a14faf82594cec86c8688dfd9f365c Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-23208992 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e4a14faf82594cec86c8688dfd9f365c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4a14faf82594cec86c8688dfd9f365c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4a14faf82594cec86c8688dfd9f365c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e4a14faf82594cec86c8688dfd9f365c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-23208992 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e4a14faf82594cec86c8688dfd9f365c Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-23208992 Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-23208992-project Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: fadf0358969c407aa8f8ddb528ebd33b Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-23208992-project Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2034272368", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:53.087248 n-d-854121-3 devstack@n-api.service[128567]: exception: Maximum number of metadata items exceeds 128 Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2034272368', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:00:53.089594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 24 02:00:53.092023 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.101194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:53.102408 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75d36806-0504-46e0-a916-bf9f7e06149e tempest-AbsoluteLimitsNegativeTestJSON-23208992 tempest-AbsoluteLimitsNegativeTestJSON-23208992-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.595330 Aug 24 02:00:53.103578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1747/2739] 10.222.0.49 () {60 vars in 1148 bytes} [Wed Aug 24 02:00:52 2022] POST /compute/v2.1/servers => generated 87 bytes in 597 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:00:53.133565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:53.137263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:53.164682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.166033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.166855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.169561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.172566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.177515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.263059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lazy-loading 'flavor' on Instance uuid 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:00:53.303001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'suspend' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state suspended Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: {"suspend": {}} Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'suspend' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state suspended Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'suspend': {}}} Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 24 02:00:53.312284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state suspended Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state suspended Aug 24 02:00:53.316922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.322015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'suspend' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state suspended {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:53.325767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eee03c64-23c1-4821-ab02-3293e393bb58 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 148 microversion: 2.1 time: 0.220894 Aug 24 02:00:53.328388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1748/2740] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:53 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 148 bytes in 224 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:00:53.338996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b365bb-3263-4136-919b-ce4d33c67ef7", "name": "network-vif-deleted", "tag": "ad93bb3b-d7c6-4add-a08a-298b7e040c2b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:53.351229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.352048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.352744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.367217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_external_events [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] Unable to find a host for instance 70b365bb-3263-4136-919b-ce4d33c67ef7. Dropping event network-vif-deleted {{(pid=128567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 02:00:53.368664 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f326bc9f-7f9e-4b52-b3f6-83b730a34029 req-6fa636af-82f2-46d6-8662-6421438077e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034383 Aug 24 02:00:53.369844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1749/2741] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 02:00:53.375495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:53.376456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:53.385584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.386681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.387346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.388298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.389473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.390228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.409498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 HTTP/1.1 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '70b365bb-3263-4136-919b-ce4d33c67ef7'} Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:53.411439 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:00:53.415233 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:53.418236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:53.419684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ac6a2fa-cdf9-435f-a8c2-a05b08e900bd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 404 len: 111 microversion: 2.1 time: 0.048612 Aug 24 02:00:53.420884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1750/2742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:53 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:53.425817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:53.429229 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:53.429229 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:53.430870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.431599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.432253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.433245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.433918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.444380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.523457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8022d07a-6891-4c8c-8efd-efc069ccd2fc tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.101104 Aug 24 02:00:53.537383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1751/2743] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 02:00:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:53.551065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:53.551619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:53.567147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.567639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.571888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.576872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.577859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.578763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.743414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-068fc572-98fc-4765-bb8b-f08e55d7feb4 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 202 len: 0 microversion: 2.1 time: 0.202308 Aug 24 02:00:53.744523 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1752/2744] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:00:53 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:00:53.758662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:53.771574 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:53.771574 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:53.776188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.777109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.778716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.781236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:53.782011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:53.782608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:53.861989 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-294589a8-0283-4c39-a9cd-760d09738ce4 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.113296 Aug 24 02:00:53.862544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1753/2745] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:53 2022] GET /compute/v2.1/os-services => generated 944 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:53.887344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1584113743", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:00:53.999976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:00:55.118497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:00:55.119645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:00:55.120213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:00:55.121160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:00:55.121650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:00:55.141276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:55.141969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:55.143829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:55.146791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:55.148914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:55.152436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:55.204250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:00:55.213750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:00:55.262681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:00:55.268286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:00:55.349403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa12bedf-1a27-48ed-989d-5560c765c909 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.475159 Aug 24 02:00:55.358567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1754/2746] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:00:55.367258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:55.369713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:55.379211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:55.380044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:55.381523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:55.383268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:55.383927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:55.384539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.382397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:56.405812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2de5496-f850-424f-b31d-17c12eb59f2d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1501 microversion: 2.1 time: 1.042022 Aug 24 02:00:56.406689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1755/2747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:55 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1501 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:56.430242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:56.434003 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:56.434003 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:56.435477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.436156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.436786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.437684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.438319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.438906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.515529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91473dc0-3d93-404e-8a37-ffe1a64bed1c tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=n-d-854121-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.092684 Aug 24 02:00:56.519043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1756/2748] 10.222.0.49 () {58 vars in 1194 bytes} [Wed Aug 24 02:00:56 2022] GET /compute/v2.1/os-services?host=n-d-854121-3&binary=xxx => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:00:56.527455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:56.528085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:56.546972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.547608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.547932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.548663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.549157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.550164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.781830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:56.800519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccd104e2-3e51-4793-bf96-d176b1f90351 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1219 microversion: 2.1 time: 0.279843 Aug 24 02:00:56.813375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1757/2749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:56 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1219 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:56.833149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:56.835761 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:56.835761 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:56.841752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.843868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.844316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.850003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.851503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.853647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.897601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d3c1fff-211b-41dc-8062-7ea7213fb7ba tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.081485 Aug 24 02:00:56.907099 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1758/2750] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:56 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:00:56.915260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:56.921051 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:56.921051 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:56.923159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.923952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.924772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:56.925872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:56.928462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:56.929874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:57.070723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e35d620-931e-487e-a780-4cc0d4bc0501 tempest-ServicesAdminNegativeTestJSON-1555504549 tempest-ServicesAdminNegativeTestJSON-1555504549-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.152947 Aug 24 02:00:57.082251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1759/2751] 10.222.0.49 () {58 vars in 1198 bytes} [Wed Aug 24 02:00:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:00:57.584607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bee5bab-7026-434c-a7c9-8aab479ffbb8 tempest-ServicesAdminNegativeTestJSON-1583913230 tempest-ServicesAdminNegativeTestJSON-1583913230-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:57.588472 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:00:57.588472 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:00:57.590786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bee5bab-7026-434c-a7c9-8aab479ffbb8 tempest-ServicesAdminNegativeTestJSON-1583913230 tempest-ServicesAdminNegativeTestJSON-1583913230-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '89b6168cfed04605b89ca40b7e6f2c74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a189ad94b94b480a9d4f335f85e9884d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bee5bab-7026-434c-a7c9-8aab479ffbb8 tempest-ServicesAdminNegativeTestJSON-1583913230 tempest-ServicesAdminNegativeTestJSON-1583913230-project] Request method failure captured: Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZQMtIRr7NdR9IvijjWjEcZGEFi1xG3e2vCSrMM89vUnJdkFSnUj_V2VQX3lCFaTCgfFMM1mz5m9eK2jG8hlPxdmGpRseayADHYYx9RdXy0QT7Ti_fH927CSlzRheAHlDE4eh_aMaHGUG7HOidhHFlzVRHQ2wL0Ry3SL-IyvquDfk0 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a189ad94b94b480a9d4f335f85e9884d Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1583913230 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a189ad94b94b480a9d4f335f85e9884d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a189ad94b94b480a9d4f335f85e9884d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a189ad94b94b480a9d4f335f85e9884d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a189ad94b94b480a9d4f335f85e9884d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1583913230 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a189ad94b94b480a9d4f335f85e9884d Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1583913230 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServicesAdminNegativeTestJSON-1583913230-project Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 89b6168cfed04605b89ca40b7e6f2c74 Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1583913230-project Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 02:00:57.598563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:00:57.602208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bee5bab-7026-434c-a7c9-8aab479ffbb8 tempest-ServicesAdminNegativeTestJSON-1583913230 tempest-ServicesAdminNegativeTestJSON-1583913230-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:00:57.603841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bee5bab-7026-434c-a7c9-8aab479ffbb8 tempest-ServicesAdminNegativeTestJSON-1583913230 tempest-ServicesAdminNegativeTestJSON-1583913230-project] 10.222.0.49 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.519243 Aug 24 02:00:57.610094 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1760/2752] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:00:57 2022] GET /compute/v2.1/os-services => generated 112 bytes in 526 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:00:57.634566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:57.638647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:57.673433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:57.673939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:57.680028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:57.681231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:57.681586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:57.682107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:58.715276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:58.725167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-513f62a4-b232-4f45-85db-8b76068c5b4e tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1501 microversion: 2.1 time: 1.112641 Aug 24 02:00:58.733522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1761/2753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:57 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1501 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:00:58.739206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:00:58.742312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:00:58.766273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:58.766775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:58.767216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:58.767998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:00:58.768412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:00:58.768884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:00:58.923036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:00:58.950956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3c0f31c-f399-452c-aad0-7c9c2e543a0c tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1273 microversion: 2.1 time: 0.214091 Aug 24 02:00:58.951834 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1762/2754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:58 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:00.165621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:00.167119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:00.180222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:00.181121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:00.181794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:00.182713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:00.183375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:00.184013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:00.576687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:00.588623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cce9b1c9-228c-4a7a-adf6-696482322362 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.837620 Aug 24 02:01:00.599909 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1763/2755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:00:59 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:00.628578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:00.629413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:00.654089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:00.655266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:00.657957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:00.659150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:00.659883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:00.662950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:01.031269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:01.046032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-436e6515-29be-476b-a863-1d6457a271de tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1315 microversion: 2.1 time: 0.444340 Aug 24 02:01:01.046689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1764/2756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:00 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:01.250041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1626863988", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "bc5e3041-7e39-4358-9cf1-242fce5f2583"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:01.367955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] validate_networks() for [('bc5e3041-7e39-4358-9cf1-242fce5f2583', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:01:03.388161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:01:03.389193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:01:03.389717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:01:03.390129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:01:03.390544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:01:03.415023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:03.415506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:03.420754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:03.423756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:03.432449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:03.433337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:03.491381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Getting quotas for project 18cfc37471d34f68b68430053fc2490a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:01:03.509980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Getting quotas for user edf66724aeed42189554c9bf5fd9706c and project 18cfc37471d34f68b68430053fc2490a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:01:03.544885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:01:03.550681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:01:03.666801 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cfec3d4-cde3-4c4b-a2ad-e12ea7b7430a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.602334 Aug 24 02:01:03.669499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1765/2757] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:01:04.204106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1154654578", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "b1581d10-276f-4f25-861c-edcd3a3366ea"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:04.360337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] validate_networks() for [('b1581d10-276f-4f25-861c-edcd3a3366ea', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:01:06.168814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:01:06.170989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:01:06.174428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:01:06.175788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:01:06.176487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:01:06.249712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:06.250333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:06.250789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:06.257349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:06.257586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:06.258041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:06.331422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:01:06.353741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for user 19d2def105dc41a78e79aedb36fbe5b0 and project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:01:06.371180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:01:06.373851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:01:06.458578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6064949-2795-464c-9fce-974be247247f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.781147 Aug 24 02:01:06.459846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1766/2758] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:01:06.476917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:06.480779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:06.510308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:06.511082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:06.511747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:06.512653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:06.513318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:06.514460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:06.957531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:06.969758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79986816-834d-4973-ab54-d48f104ee9e6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.508616 Aug 24 02:01:06.970342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1767/2759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:06 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:06.997943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:06.999211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:07.021669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:07.025042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:07.025717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:07.026609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:07.028474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:07.029129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:07.384891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:07.395471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a90e38b-0aea-4c4c-b613-b3ce515c2a88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1315 microversion: 2.1 time: 0.403843 Aug 24 02:01:07.396080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1768/2760] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:06 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:07.909686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43295b8b-050c-4eca-bada-135cbf527764", "tag": "2797e39c-eb57-44aa-8413-5b7c0c7cde73"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:07.927624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:07.928112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:07.928545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:07.962766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] Creating event network-changed:2797e39c-eb57-44aa-8413-5b7c0c7cde73 for instance 43295b8b-050c-4eca-bada-135cbf527764 on n-h1-854121-3 Aug 24 02:01:07.973580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d2eca03b-0665-41d1-b2f5-9605e81ba407 req-dca779ce-aec9-4af0-84e2-84c5f9f8797c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576114 Aug 24 02:01:07.974211 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1769/2761] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:07.982541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:07.983482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:07.989526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:08.014663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:08.017142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:08.017749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:08.020268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:08.021030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:08.022419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:08.339272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:08.366806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:08.371106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:08.374025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3551dfb-88a0-4189-bad7-40d51596f531 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.395664 Aug 24 02:01:08.391430 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1770/2762] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:07 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:08.789751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a996d91-f6e3-42b3-9b4e-203627801580 tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T02%3A01%3A05.872872&end=2022-08-25T02%3A01%3A05.872872" status: 404 len: 112 microversion: - time: 0.393912 Aug 24 02:01:08.790300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1771/2763] 10.222.0.49 () {58 vars in 1316 bytes} [Wed Aug 24 02:01:08 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-23T02%3A01%3A05.872872&end=2022-08-25T02%3A01%3A05.872872 => generated 112 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 02:01:08.797689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:08.798305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:08.815756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:08.818083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:08.818617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:08.822713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:08.824166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:08.824621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:09.016618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:09.019520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:09.058596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e02869b-ea2f-48ae-a3c4-5b503128e8f5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1260 microversion: 2.1 time: 0.267118 Aug 24 02:01:09.059444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1772/2764] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:08 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:09.076580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:09.084162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: b11552fb-be71-456f-9a81-7be395cdb803] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:09.106780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/b11552fb-be71-456f-9a81-7be395cdb803/action HTTP/1.1 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: {"unpause": {}} Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b11552fb-be71-456f-9a81-7be395cdb803', 'body': {'unpause': {}}} Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:09.108777 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance b11552fb-be71-456f-9a81-7be395cdb803 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28d1153c-13ef-4de6-83ed-46aecef26464 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/b11552fb-be71-456f-9a81-7be395cdb803/action" status: 404 len: 111 microversion: 2.1 time: 0.049646 Aug 24 02:01:09.116178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1773/2765] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:09 2022] POST /compute/v2.1/servers/b11552fb-be71-456f-9a81-7be395cdb803/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:09.413227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4a83c36-3b17-4ef6-bb45-1e7a33752cc6 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b91225ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-613779785", "description": "tempest-description-1014297499"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:09.569260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4a83c36-3b17-4ef6-bb45-1e7a33752cc6 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.454338 Aug 24 02:01:09.570066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1774/2766] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:01:09 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:09.575034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:09.575864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:09.582786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:09.583533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:09.584177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:09.585079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:09.585689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:09.586275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:09.732237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:09.741387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fcc82e64-670f-419e-8a2a-cfceb3dd8f97 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1315 microversion: 2.1 time: 0.169964 Aug 24 02:01:09.742748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1775/2767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:09 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:09.747733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e7cdfab-b1d9-4ed9-9ae4-49e53731eb0c tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] Calling method '.version_select at 0x7f6b911c78b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:09.754465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2e7cdfab-b1d9-4ed9-9ae4-49e53731eb0c tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e7cdfab-b1d9-4ed9-9ae4-49e53731eb0c tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] Request method failure captured: Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-simple-tenant-usage/6ce23537b86c4717abd88eb3decf2249?start=2022-08-25T02%3A01%3A05.872872&end=2022-08-23T02%3A01%3A05.872872 HTTP/1.1 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZhv0Q7o6z8oR7r1rHG2vpN-XjJi6v9Eqz3cW6hwB2J2bZczOmueIbDv-J5oXzHbc1ij-FraUFyjr3dWXjUU-19blZsmcdtwychfHIrD0uPys_UwhMcDZ1uLAa-3PZud1YX6GJIh6I8uuhEmrwFo4dN5dM565YYNG9K2yRhgPk4BkU Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e29ec9820ef54de683fce1ece5cba19d Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1261652593 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e29ec9820ef54de683fce1ece5cba19d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e29ec9820ef54de683fce1ece5cba19d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e29ec9820ef54de683fce1ece5cba19d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e29ec9820ef54de683fce1ece5cba19d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1261652593 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e29ec9820ef54de683fce1ece5cba19d Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1261652593 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: aa94fde781a94e9499aa268c19aae7d0 Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid start time. The start time cannot occur after the end time. Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '6ce23537b86c4717abd88eb3decf2249'} Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 24 02:01:09.762363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:09.767766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e7cdfab-b1d9-4ed9-9ae4-49e53731eb0c tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:09.769224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e7cdfab-b1d9-4ed9-9ae4-49e53731eb0c tempest-TenantUsagesNegativeTestJSON-1261652593 tempest-TenantUsagesNegativeTestJSON-1261652593-project-admin] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage/6ce23537b86c4717abd88eb3decf2249?start=2022-08-25T02%3A01%3A05.872872&end=2022-08-23T02%3A01%3A05.872872" status: 400 len: 111 microversion: 2.1 time: 0.025290 Aug 24 02:01:09.769934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1776/2768] 10.222.0.49 () {58 vars in 1412 bytes} [Wed Aug 24 02:01:09 2022] GET /compute/v2.1/os-simple-tenant-usage/6ce23537b86c4717abd88eb3decf2249?start=2022-08-25T02%3A01%3A05.872872&end=2022-08-23T02%3A01%3A05.872872 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:09.842103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bff64d-094a-4d6b-aa13-d9b58e2bab5e", "tag": "43489ce2-7cc8-47a6-9740-c6086cb2e3e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:09.856609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:09.857490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:09.858216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:09.872013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] Creating event network-changed:43489ce2-7cc8-47a6-9740-c6086cb2e3e3 for instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e on n-h2-854121-3 Aug 24 02:01:09.877853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c15dec2e-cfe0-45f8-bbf9-641e97d9dee7 req-f4abb641-2e34-40ee-b0dc-ff8e9ab7ed0b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106325 Aug 24 02:01:09.878464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1777/2769] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:09.883890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:09.884600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:09.891573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:09.892269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:09.893507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:09.894307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:09.894776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:09.895205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:10.053057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:10.062446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-460e6a28-c250-439f-9ee3-ab42d80c2676 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.182640 Aug 24 02:01:10.063198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1778/2770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:09 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:10.137272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa4713af-6af4-4db5-a425-8c14ceb26543 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] Calling method '.version_select at 0x7f6b9177bb80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:10.138154 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:01:10.138154 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:01:10.173932 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa4713af-6af4-4db5-a425-8c14ceb26543 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.109621 Aug 24 02:01:10.175410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1779/2771] 10.222.0.49 () {60 vars in 1226 bytes} [Wed Aug 24 02:01:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:01:10.181876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:10.182232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:10.189311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:10.189939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:10.191142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:10.191970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:10.192663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:10.193343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:10.408417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:10.424864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:10.427112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:10.428462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43fe6908-deae-40cd-a499-cff383e6cb88 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.252110 Aug 24 02:01:10.440746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1780/2772] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:10 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:10.453803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-427adda0-8701-479f-a911-e7f30f262be9 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b91745700>, body: {"security_group_rule": {"parent_group_id": "7e29d603-23a2-4d6c-b184-ced401081157", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:10.700964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-427adda0-8701-479f-a911-e7f30f262be9 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.260924 Aug 24 02:01:10.702214 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1781/2773] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:10 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:10.823370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34ef9508-b5da-436d-8afd-e3fae7dcaad7 tempest-TenantUsagesNegativeTestJSON-715942823 tempest-TenantUsagesNegativeTestJSON-715942823-project] Calling method '.version_select at 0x7f6b911dfd30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:10.826992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34ef9508-b5da-436d-8afd-e3fae7dcaad7 tempest-TenantUsagesNegativeTestJSON-715942823 tempest-TenantUsagesNegativeTestJSON-715942823-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b24cee0a5e344d81ab8bb3248f3e2e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce23537b86c4717abd88eb3decf2249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34ef9508-b5da-436d-8afd-e3fae7dcaad7 tempest-TenantUsagesNegativeTestJSON-715942823 tempest-TenantUsagesNegativeTestJSON-715942823-project] Request method failure captured: Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T02%3A01%3A05.872872&end=2022-08-25T02%3A01%3A05.872872&detailed=1 HTTP/1.1 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZgXJpxBkDdGmnUeYpeNHi0gtZnaJz4gxRLm9zxrYmn6xGGkysCXIqtFC8bcGUNcnSebSbz8FhHxE5tGt56t0dOz9QnZnmtY2Cbsmc0BL0WCtbCFevFDjR_RSO7wSwgxAgLdrjtKjVCB5rIiJypp9in01oWLnGyI-cw_mFP-IKbISE Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 6ce23537b86c4717abd88eb3decf2249 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-715942823 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6ce23537b86c4717abd88eb3decf2249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6ce23537b86c4717abd88eb3decf2249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6ce23537b86c4717abd88eb3decf2249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6ce23537b86c4717abd88eb3decf2249"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-715942823 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 6ce23537b86c4717abd88eb3decf2249 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-715942823 Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TenantUsagesNegativeTestJSON-715942823-project Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b24cee0a5e344d81ab8bb3248f3e2e2a Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-715942823-project Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 24 02:01:10.828794 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34ef9508-b5da-436d-8afd-e3fae7dcaad7 tempest-TenantUsagesNegativeTestJSON-715942823 tempest-TenantUsagesNegativeTestJSON-715942823-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:10.833258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34ef9508-b5da-436d-8afd-e3fae7dcaad7 tempest-TenantUsagesNegativeTestJSON-715942823 tempest-TenantUsagesNegativeTestJSON-715942823-project] 10.222.0.49 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T02%3A01%3A05.872872&end=2022-08-25T02%3A01%3A05.872872&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.128397 Aug 24 02:01:10.834623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1782/2774] 10.222.0.49 () {58 vars in 1335 bytes} [Wed Aug 24 02:01:10 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-23T02%3A01%3A05.872872&end=2022-08-25T02%3A01%3A05.872872&detailed=1 => generated 123 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:10.842665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:10.843284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:10.851177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:10.851599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:10.852180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:10.852970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:10.853588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:10.854173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.007227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:11.015644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79adb3b3-eaa1-43f7-8fa7-1c262c5913c4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.177921 Aug 24 02:01:11.016219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1783/2775] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:10 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:11.021065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:11.021677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:11.027616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.028233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.028578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.029314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.029777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.030206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.186695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:11.194662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e63bc130-a09d-42a4-a11a-3553bb6a674d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.177454 Aug 24 02:01:11.195393 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1784/2776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:11 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:11.200592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63186f26-ca2f-4978-a96e-94d29bf1bb43 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] Action: 'update', calling method: .version_select at 0x7f6b911f14c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:11.203860 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:01:11.203860 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:01:11.318223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63186f26-ca2f-4978-a96e-94d29bf1bb43 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.121661 Aug 24 02:01:11.318931 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1785/2777] 10.222.0.49 () {62 vars in 1247 bytes} [Wed Aug 24 02:01:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:01:11.328330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aafc1d05-fac2-4bc1-a857-dc1431848a24 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911f1e50>, body: {"security_group_rule": {"parent_group_id": "7e29d603-23a2-4d6c-b184-ced401081157", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:11.379651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-aafc1d05-fac2-4bc1-a857-dc1431848a24 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aafc1d05-fac2-4bc1-a857-dc1431848a24 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 138 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "7e29d603-23a2-4d6c-b184-ced401081157", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: exception: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7e29d603-23a2-4d6c-b184-ced401081157', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:11.381214 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aafc1d05-fac2-4bc1-a857-dc1431848a24 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: This rule already exists in group 7e29d603-23a2-4d6c-b184-ced401081157 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aafc1d05-fac2-4bc1-a857-dc1431848a24 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.063010 Aug 24 02:01:11.385244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1786/2778] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:11 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:11.390592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:11.391226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:11.398518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.398878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.399435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.400197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.400609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.401070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.545742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:11.555286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55a39190-f45d-40a9-874d-a2e554ad0f1a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1315 microversion: 2.1 time: 0.169510 Aug 24 02:01:11.555694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1787/2779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:11 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:11.567466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:11.568049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:11.574854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.575351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.575945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.576664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.577316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.577984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.608824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'unpause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: {"unpause": {}} Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'unpause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'unpause': {}}} Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state active. Cannot unpause while the instance is in this state. Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:11.610512 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'unpause' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:11.614938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e26c6f0-cb9c-4316-8447-78873a529d1c tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 145 microversion: 2.1 time: 0.056032 Aug 24 02:01:11.615495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1788/2780] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:11 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 145 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:01:11.620346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ff74459-28a4-4f58-aa3a-bd40680993eb tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] Calling method '.version_select at 0x7f6b911c83a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:11.621175 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:01:11.621175 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:01:11.641256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ff74459-28a4-4f58-aa3a-bd40680993eb tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.021850 Aug 24 02:01:11.642495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1789/2781] 10.222.0.49 () {60 vars in 1226 bytes} [Wed Aug 24 02:01:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:01:11.647863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dc39be2-2d31-4b0c-84e3-fe1d13a522d8 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b91232c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:11.882047 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dc39be2-2d31-4b0c-84e3-fe1d13a522d8 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/86d7b3a0-b592-4abc-9591-ee4504579e9a" status: 202 len: 0 microversion: 2.1 time: 0.237745 Aug 24 02:01:11.882833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1790/2782] 10.222.0.49 () {58 vars in 1287 bytes} [Wed Aug 24 02:01:11 2022] DELETE /compute/v2.1/os-security-group-rules/86d7b3a0-b592-4abc-9591-ee4504579e9a => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:11.887759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:11.888525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:11.896244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.896763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.897394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:11.898115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:11.898728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:11.899157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:12.055007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:12.063650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:12.065766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:12.066915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43206644-f8c4-4f24-a353-1937f473bae6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.182908 Aug 24 02:01:12.067661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1791/2783] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:11 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:12.072265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:12.072902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:12.079530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:12.080020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:12.080628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:12.081357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:12.081865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:12.082236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:12.580470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:12.591713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a9486e3-bcae-4d0d-b5a6-70d39514e0e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.522915 Aug 24 02:01:12.592570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1792/2784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:12 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:12.607754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-939ac86e-9fa6-47b2-9879-41d7dda95fc0 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] Action: 'update', calling method: .version_select at 0x7f6b911f1e50>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:12.612324 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:01:12.612324 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:01:12.689881 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-939ac86e-9fa6-47b2-9879-41d7dda95fc0 tempest-QuotaClassesAdmin257Test-1324553795 tempest-QuotaClassesAdmin257Test-1324553795-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.084712 Aug 24 02:01:12.690599 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1793/2785] 10.222.0.49 () {62 vars in 1247 bytes} [Wed Aug 24 02:01:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:01:12.700891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43295b8b-050c-4eca-bada-135cbf527764", "name": "network-vif-plugged", "status": "completed", "tag": "2797e39c-eb57-44aa-8413-5b7c0c7cde73"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:12.716164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:12.716733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:12.717174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:12.737486 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] Creating event network-vif-plugged:2797e39c-eb57-44aa-8413-5b7c0c7cde73 for instance 43295b8b-050c-4eca-bada-135cbf527764 on n-h1-854121-3 Aug 24 02:01:12.744436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-85503867-2fdb-4b1a-b9f2-af1df996834a req-e4971bad-4337-40d4-b6f6-359e7ee3644a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051975 Aug 24 02:01:12.745862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1794/2786] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:12.755622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eaa6384b-d4c1-4178-a17e-92c8c27b4c65 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911c8c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1569352821", "description": "tempest-description-1640575832"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:13.219178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eaa6384b-d4c1-4178-a17e-92c8c27b4c65 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.469815 Aug 24 02:01:13.219988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1795/2787] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:01:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:13.234491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:13.236364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:13.261869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:13.264878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:13.265533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:13.267779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:13.268524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:13.269131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:13.550590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:13.567579 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c686996c-636d-4a55-ac87-14a1cfda1854 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.343733 Aug 24 02:01:13.570194 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1796/2788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:13 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:13.578953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:13.579572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:13.598654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:13.599313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:13.599626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:13.600358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:13.605369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:13.605874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:13.998556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:14.024118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3008eccb-c55a-454e-b498-0a80f32ce4eb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1315 microversion: 2.1 time: 0.448170 Aug 24 02:01:14.027197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1797/2789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:13 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:14.044880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:14.045656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:14.053195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:14.057699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:14.063103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:14.063103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:14.063103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:14.063103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:14.339763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:14.350849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1520540-f39b-4153-ab0f-3d88702bc6e9 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.321294 Aug 24 02:01:14.351839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1798/2790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:14 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:14.365128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:14.365748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:14.375988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:14.376664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:14.378384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:14.379154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:14.380223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:14.381897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:14.722678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:14.734728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:14.738304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:14.739752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0f62091-d902-4474-82e3-f0397243e2bd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.386956 Aug 24 02:01:14.754088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1799/2791] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:14 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:14.767698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-367034a8-7ae9-4b42-b9cb-f9b2ff14e215 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911c8670>, body: {"security_group_rule": {"parent_group_id": "5ca47a0c-2c2d-473d-a500-0b1fb9ad9e77", "ip_protocol": "tcp", "from_port": 1650420615, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:14.886703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-367034a8-7ae9-4b42-b9cb-f9b2ff14e215 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Invalid port range 1650420615:22. Former value cannot be greater than the later Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-367034a8-7ae9-4b42-b9cb-f9b2ff14e215 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 146 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "5ca47a0c-2c2d-473d-a500-0b1fb9ad9e77", "ip_protocol": "tcp", "from_port": 1650420615, "to_port": 22}} Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid port range 1650420615:22. Former value cannot be greater than the later Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5ca47a0c-2c2d-473d-a500-0b1fb9ad9e77', 'ip_protocol': 'tcp', 'from_port': 1650420615, 'to_port': 22}}} Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1650420615:22. Former value cannot be greater than the later Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1650420615:22. Former value cannot be greater than the later Aug 24 02:01:14.889782 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1650420615:22. Former value cannot be greater than the later Aug 24 02:01:14.894792 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.897915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-367034a8-7ae9-4b42-b9cb-f9b2ff14e215 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: Invalid port range 1650420615:22. Former value cannot be greater than the later {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:14.900514 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-367034a8-7ae9-4b42-b9cb-f9b2ff14e215 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.144021 Aug 24 02:01:14.907846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1800/2792] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:14 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:14.922526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20df93e9-de2c-4d28-9630-e0e53bc4c7f0", "tag": "2ce37610-d809-495e-bf1f-31e1d8892c26"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:14.941331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:14.942643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:14.943342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:14.958648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] Creating event network-changed:2ce37610-d809-495e-bf1f-31e1d8892c26 for instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 on n-h2-854121-3 Aug 24 02:01:14.966070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dafd10e6-321d-4f03-a621-642e6040a0f5 req-83010548-8308-4a31-b205-d8cbddd7dfef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053497 Aug 24 02:01:14.967235 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1801/2793] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:14.975289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:14.975993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 97e25c17-520a-4aa6-ae46-97d4ff2f5238] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:14.983588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/97e25c17-520a-4aa6-ae46-97d4ff2f5238/action HTTP/1.1 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 18 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: {"unshelve": null} Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '97e25c17-520a-4aa6-ae46-97d4ff2f5238', 'body': {'unshelve': None}} Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.985824 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 97e25c17-520a-4aa6-ae46-97d4ff2f5238 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbbe1731-e553-4313-9faa-b773a89c38cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/97e25c17-520a-4aa6-ae46-97d4ff2f5238/action" status: 404 len: 111 microversion: 2.1 time: 0.019506 Aug 24 02:01:14.990832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1802/2794] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:14 2022] POST /compute/v2.1/servers/97e25c17-520a-4aa6-ae46-97d4ff2f5238/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:14.997304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:14.998016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:15.007161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.007911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.008541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.009453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.010054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.010661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.257634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:15.267680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22c50cdd-cea8-45fe-9d33-2a19554cbc0d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.276813 Aug 24 02:01:15.285278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1803/2795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:14 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:15.291044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b298bb42-6428-46fe-91ed-58e8222326a7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b91519ca0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-336669023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:15.292948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b298bb42-6428-46fe-91ed-58e8222326a7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Security group id should be uuid Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b298bb42-6428-46fe-91ed-58e8222326a7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 130 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-336669023", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group id should be uuid Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-336669023', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:15.294476 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:15.299929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 24 02:01:15.299929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:15.299929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b298bb42-6428-46fe-91ed-58e8222326a7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: Security group id should be uuid {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:15.299929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b298bb42-6428-46fe-91ed-58e8222326a7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.009590 Aug 24 02:01:15.299929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1804/2796] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:15 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 02:01:15.312288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:15.313391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:15.324808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.325392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.325895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.326571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.327009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.327594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.496181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:15.513455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11d3afda-ade3-4c89-addf-6f001d64365a tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.206441 Aug 24 02:01:15.515276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1805/2797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:15 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:15.728126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bff64d-094a-4d6b-aa13-d9b58e2bab5e", "name": "network-vif-plugged", "status": "completed", "tag": "43489ce2-7cc8-47a6-9740-c6086cb2e3e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:15.739596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.740273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.741169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.753164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] Creating event network-vif-plugged:43489ce2-7cc8-47a6-9740-c6086cb2e3e3 for instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e on n-h2-854121-3 Aug 24 02:01:15.758916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d21cd648-e372-4b53-b177-a06f91700442 req-289be8ce-ea3d-45b0-bdd6-0810d3b29d2d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242156 Aug 24 02:01:15.760102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1806/2798] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:15.765635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:15.766547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:15.773541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.774035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.774470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.775164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:15.776114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:15.776702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:15.802314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:16.028550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:16.039216 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ea32800-44af-4e3d-a1a1-b174a6296e04 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1502 microversion: 2.1 time: 0.277750 Aug 24 02:01:16.043140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1807/2799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:15 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:16.058342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9f93335-f8a0-4b01-8292-b26832d7ca00 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b91232c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1220184989", "description": "tempest-description-316213885"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:16.284896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:16.332275 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9f93335-f8a0-4b01-8292-b26832d7ca00 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.288180 Aug 24 02:01:16.332909 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1808/2800] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:01:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:16.337634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:16.338253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:16.360913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.361410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.363892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.364984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.365488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.365964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.526163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:16.535238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57d60311-7fff-4465-b3ef-289b7ce537de tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.201305 Aug 24 02:01:16.535824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1809/2801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:16 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:16.544915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:16.545919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:16.556730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.557328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.557763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.558466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.558915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.559338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.764618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:16.777275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:16.779531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:16.781574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec2eb866-d55e-4ffe-bea8-722a9fab73b8 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.244528 Aug 24 02:01:16.782975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1810/2802] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:16 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:16.789993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:16.829459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.832809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.833900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.866612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:01:16.932818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c6d29ab-9d05-4093-ad0f-7dd1c29d8d54 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764/action" status: 202 len: 0 microversion: 2.1 time: 0.146836 Aug 24 02:01:16.937857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1811/2803] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:16 2022] POST /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:16.943744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:16.944643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:16.953765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.958699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.959457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:16.960422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:16.960932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:16.961356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:17.301446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:17.314188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2651d0fc-a3de-4661-8f14-998046747bbc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.373533 Aug 24 02:01:17.331168 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1812/2804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:16 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:17.343028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d31ce966-fa95-494c-af41-c9045a9d9e6f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911c85e0>, body: {"security_group_rule": {"parent_group_id": "d55bc8c9-1951-47af-b73b-24d9a164f1e7", "ip_protocol": "tempest-999-346940252", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:17.438678 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d31ce966-fa95-494c-af41-c9045a9d9e6f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Invalid IP protocol tempest-999-346940252. Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d31ce966-fa95-494c-af41-c9045a9d9e6f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 156 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "d55bc8c9-1951-47af-b73b-24d9a164f1e7", "ip_protocol": "tempest-999-346940252", "from_port": 22, "to_port": 22}} Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid IP protocol tempest-999-346940252. Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd55bc8c9-1951-47af-b73b-24d9a164f1e7', 'ip_protocol': 'tempest-999-346940252', 'from_port': 22, 'to_port': 22}}} Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-346940252. Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-346940252. Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.440960 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-346940252. Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d31ce966-fa95-494c-af41-c9045a9d9e6f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: Invalid IP protocol tempest-999-346940252. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d31ce966-fa95-494c-af41-c9045a9d9e6f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.110979 Aug 24 02:01:17.444388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1813/2805] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:17 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 02:01:17.452040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:17.452865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:17.480257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:17.480812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:17.481333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:17.482087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:17.482540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:17.483090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:17.507322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Cannot 'unshelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action HTTP/1.1 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 18 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: {"unshelve": null} Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'unshelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'unshelve': None}} Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 in vm_state active. Cannot unshelve while the instance is in this state. Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:01:17.508945 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 409 to user: Cannot 'unshelve' instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 while it is in vm_state active {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0400c7ad-16c1-491a-9fc9-1da8001880b6 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action" status: 409 len: 146 microversion: 2.1 time: 0.065356 Aug 24 02:01:17.512513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1814/2806] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:17 2022] POST /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6/action => generated 146 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:01:17.516482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:17.517225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:17.521300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:17.525345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:17.525826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:17.526268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:17.527376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:17.527835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:17.528255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:17.752245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:17.763491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a1812a1-8780-4c93-8967-236842c0fc5b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.251189 Aug 24 02:01:17.778823 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1815/2807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:17 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:17.785936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60be0f87-fec6-4c93-adb0-1b7656905450 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911c8700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1906352910", "description": "tempest-description-179678527"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:18.235496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60be0f87-fec6-4c93-adb0-1b7656905450 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.454685 Aug 24 02:01:18.236431 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1816/2808] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:01:17 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:18.241059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:18.241865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:18.251144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:18.253685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:18.255770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:18.262425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:18.263087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:18.263637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:18.534373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:18.548201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b0a7e80-2cfa-4467-9db6-bf545bdb5035 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.310566 Aug 24 02:01:18.555493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1817/2809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:18 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:18.561511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:18.563509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:18.571338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:18.572397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:18.573775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:18.574835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:18.575494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:18.576145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:18.847859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:18.863152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:18.865422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:18.866876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08f8dff4-5af3-473c-9400-045416f053fd tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1362 microversion: 2.26 time: 0.309558 Aug 24 02:01:18.883029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1818/2810] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:18 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1362 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:18.888392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53c06bea-57d7-426e-93a1-de5be5b46b4f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b9118e040>, body: {"security_group_rule": {"parent_group_id": "94e16bf0-5ec0-4516-b83b-4ac46f10e0f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:19.023973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-53c06bea-57d7-426e-93a1-de5be5b46b4f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53c06bea-57d7-426e-93a1-de5be5b46b4f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 138 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "94e16bf0-5ec0-4516-b83b-4ac46f10e0f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '94e16bf0-5ec0-4516-b83b-4ac46f10e0f4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 02:01:19.026312 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 24 02:01:19.030366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:19.032573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53c06bea-57d7-426e-93a1-de5be5b46b4f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:19.034873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53c06bea-57d7-426e-93a1-de5be5b46b4f tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.149246 Aug 24 02:01:19.036611 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1819/2811] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:18 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:19.044856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:19.046906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:19.063065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.065042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.066437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:19.067476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.068355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.068941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:19.355147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:19.369693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f967ae0b-d339-4f19-abdb-b4c6b3c5c54d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.330834 Aug 24 02:01:19.385481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1820/2812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:19 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:19.390739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:19.391309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:19.404304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.405244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.405884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:19.407750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.408257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.409453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:19.654640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:19.667867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d28c1d7-73e5-4dc1-9d2c-a89f64c4b8fa tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.280615 Aug 24 02:01:19.668907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1821/2813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:19 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:19.676899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:19.677522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:19.684755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.689381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.690167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:19.691154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:19.691925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:19.692556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:20.005249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:20.019858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0891e82-f4f1-4c7d-b963-11acab2051ae tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.348980 Aug 24 02:01:20.024298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1822/2814] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:19 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:20.037782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02916e3c-b897-4435-909f-fa0070191265 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b9125eaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-952405182", "description": "tempest-description-705726623"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:20.429279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02916e3c-b897-4435-909f-fa0070191265 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.402039 Aug 24 02:01:20.430193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1823/2815] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:01:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:20.434677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865204008_updated"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:20.437206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 2bf41636-6d0e-41dc-b9b1-c248b5a185a3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:20.452850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/2bf41636-6d0e-41dc-b9b1-c248b5a185a3 HTTP/1.1 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 81 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1865204008_updated"}} Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2bf41636-6d0e-41dc-b9b1-c248b5a185a3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1865204008_updated'}}} Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 02:01:20.456157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:20.459779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 2bf41636-6d0e-41dc-b9b1-c248b5a185a3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:20.462984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63788f0d-e8d0-4b01-aabb-1bca0636357d tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "PUT /compute/v2.1/servers/2bf41636-6d0e-41dc-b9b1-c248b5a185a3" status: 404 len: 111 microversion: 2.1 time: 0.028874 Aug 24 02:01:20.465162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1824/2816] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:01:20 2022] PUT /compute/v2.1/servers/2bf41636-6d0e-41dc-b9b1-c248b5a185a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:20.472967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20df93e9-de2c-4d28-9630-e0e53bc4c7f0", "name": "network-vif-plugged", "status": "completed", "tag": "2ce37610-d809-495e-bf1f-31e1d8892c26"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:20.490832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:20.492093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:20.492609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:20.517572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] Creating event network-vif-plugged:2ce37610-d809-495e-bf1f-31e1d8892c26 for instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 on n-h2-854121-3 Aug 24 02:01:20.526790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dfdd50b0-c1ca-4741-9742-fba0ca3c4ff0 req-82d47ecf-ad41-4c7d-b858-5af4bb33c72d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058814 Aug 24 02:01:20.528549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1825/2817] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:20.537404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:20.538287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:20.551320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:20.551647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:20.552193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:20.553296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:20.556126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:20.557399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:21.535802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:21.547407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:21.550386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:21.552492 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf4b3393-9a2f-4cdd-8957-354948b281a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1545 microversion: 2.26 time: 1.021431 Aug 24 02:01:21.555246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1826/2818] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:20 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1545 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:21.561403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:21.562194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:21.574832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:21.575328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:21.575934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:21.577269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:21.578066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:21.578771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:21.917175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:21.938805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-825b7e78-fc6f-4040-8dcc-c15bd4311296 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1308 microversion: 2.1 time: 0.381576 Aug 24 02:01:21.941426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1827/2819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:21 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:21.953912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f27f3a2f-e9bf-46dc-b1b0-8afcfeea38fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911a4940>, body: {"security_group_rule": {"parent_group_id": "9a38ef52-7ddd-4b7b-9805-afa0218bc908", "ip_protocol": "tcp", "from_port": 22, "to_port": 1810167335}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:22.123514 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f27f3a2f-e9bf-46dc-b1b0-8afcfeea38fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f27f3a2f-e9bf-46dc-b1b0-8afcfeea38fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 146 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "9a38ef52-7ddd-4b7b-9805-afa0218bc908", "ip_protocol": "tcp", "from_port": 22, "to_port": 1810167335}} Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9a38ef52-7ddd-4b7b-9805-afa0218bc908', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1810167335}}} Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 Aug 24 02:01:22.125209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f27f3a2f-e9bf-46dc-b1b0-8afcfeea38fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 400 to user: Invalid port range 22:1810167335. Valid TCP ports should be between 1-65535 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f27f3a2f-e9bf-46dc-b1b0-8afcfeea38fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.183612 Aug 24 02:01:22.129605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1828/2820] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:21 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:22.133079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:22.134890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:22.150397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.150897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.151330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.152037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.152491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.160320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.522823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:22.539404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ecbc7c4b-d63a-4cdb-b754-889b56df4e6b tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.410975 Aug 24 02:01:22.540124 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1829/2821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:22 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:22.559000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:22.559978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:22.569620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.570379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.571013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.572362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.573367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.574116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.686090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:22.845307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:22.856821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74bb9f3e-11fc-4f04-9c2f-b3f435a34397 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.311603 Aug 24 02:01:22.865114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1830/2822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:22 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:22.870343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911aaca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:22.881204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.881938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.882377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.883362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:22.896448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.897184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.897796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.898756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.900180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.901066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:22.950429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:22.961863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:22.962647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:22.974065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:23.001347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:23.003975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:23.004635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:23.042059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:23.081582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ad611af-af75-4797-812a-a5eae404cfc0 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-201532832" status: 201 len: 0 microversion: 2.26 time: 0.210527 Aug 24 02:01:23.086321 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1831/2823] 10.222.0.49 () {62 vars in 1377 bytes} [Wed Aug 24 02:01:22 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-201532832 => generated 0 bytes in 217 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 02:01:23.483558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:23.484146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:23.492029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:23.492857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:23.493496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:23.494672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:23.495351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:23.495975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:23.538288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:01:23.650610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddfd67f4-7927-4b57-87fb-1ca76aebe84a tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 204 len: 0 microversion: 2.32 time: 0.566073 Aug 24 02:01:23.652257 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1832/2824] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:01:23 2022] DELETE /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:01:23.659756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Action: 'create', calling method: .version_select at 0x7f6b911a4160>, body: {"security_group_rule": {"parent_group_id": "108852d8-a53d-4e9e-bdd3-8f2a326fbeb2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:23.731091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:01:23.731709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Neutron security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:01:23.732245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.732245 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 138 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: {"security_group_rule": {"parent_group_id": "108852d8-a53d-4e9e-bdd3-8f2a326fbeb2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'security_group_rule': {'parent_group_id': '108852d8-a53d-4e9e-bdd3-8f2a326fbeb2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:01:23.735301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 404 to user: Security group 108852d8-a53d-4e9e-bdd3-8f2a326fbeb2 does not exist Aug 24 02:01:23.739911 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-dca6f8e8-3bee-4301-a5c2-d85f142444ff'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:23.743366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efe7a496-aade-4f61-9496-20764048301c tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.086834 Aug 24 02:01:23.743366 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1833/2825] 10.222.0.49 () {60 vars in 1195 bytes} [Wed Aug 24 02:01:23 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:23.757020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:23.758310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:23.771884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:23.772647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:23.775385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:23.777154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:23.777797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:23.778395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.101640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:24.130289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ab7f350-f015-4036-8028-ba6d522e85f3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.387163 Aug 24 02:01:24.132505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1834/2826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:23 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:24.148005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:24.149451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:24.156268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.156560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.157052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.157874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.158966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.159811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.485345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:24.494722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c4f53bf-1d6a-44d2-aa92-9e29f56120bf tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1487 microversion: 2.1 time: 0.361079 Aug 24 02:01:24.495313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1835/2827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:24 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1487 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:24.507665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6fb9aea-f4b3-4a28-a249-ce39b4f6869c tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911a4af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:24.521256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fb9aea-f4b3-4a28-a249-ce39b4f6869c tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.522355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fb9aea-f4b3-4a28-a249-ce39b4f6869c tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.522952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fb9aea-f4b3-4a28-a249-ce39b4f6869c tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.536398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6fb9aea-f4b3-4a28-a249-ce39b4f6869c tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-201532832" status: 204 len: 0 microversion: 2.26 time: 0.035391 Aug 24 02:01:24.537802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1836/2828] 10.222.0.49 () {60 vars in 1358 bytes} [Wed Aug 24 02:01:24 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-201532832 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:01:24.544444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:24.545392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:24.554630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.555298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.555896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.556806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.557586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.558350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.852943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:24.863487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:24.865017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:24.866241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58868fcd-a6b8-458c-bdeb-fcffa65451ac tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 2950 microversion: 2.32 time: 0.326277 Aug 24 02:01:24.866986 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1837/2829] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:24 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 2950 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:24.871579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b9118a3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:24.892272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:01:24.893468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Neutron security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 not found {{(pid=128567) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 24 02:01:24.893994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] HTTP exception thrown: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.893994 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Request method failure captured: Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-group-rules/6efbac24-3644-43dd-b4c6-1bc8834477d5 HTTP/1.1 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZjc6St1znt69cdAJkXEux8gl6wRNlOcJX6rqPQYO_L_YOPwOVmcqYJKGEJPeQD-dC-Inus8A-dxl2gKclN6d97MPcYQiMpCj3218rYav4HBTQv_jyzLGdiG3oblMOz7vo85qA5eL781--mq2lKymzheqPuKdfxVCo70UI80-_-fG0 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e9d88813c8f14a78bab10c77d95d12e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e9d88813c8f14a78bab10c77d95d12e1 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2617ca35eabf4abcb9dd72c50d29ff61 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '6efbac24-3644-43dd-b4c6-1bc8834477d5'} Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:01:24.895854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Returning 404 to user: Security group rule 6efbac24-3644-43dd-b4c6-1bc8834477d5 does not exist Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7bfbda9c-44cb-4984-868d-5e7d81a7088d'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acbcaf8b-9a44-4840-9c7e-2dcb911ae5fe tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-group-rules/6efbac24-3644-43dd-b4c6-1bc8834477d5" status: 404 len: 199 microversion: 2.1 time: 0.029485 Aug 24 02:01:24.899979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1838/2830] 10.222.0.49 () {58 vars in 1287 bytes} [Wed Aug 24 02:01:24 2022] DELETE /compute/v2.1/os-security-group-rules/6efbac24-3644-43dd-b4c6-1bc8834477d5 => generated 199 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:24.905550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:24.905550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:24.912605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.913392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.913563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:24.914234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:24.914855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:24.915420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.104758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:25.114098 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0436d98b-924b-4856-aa7e-5238e1b359e8 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.214465 Aug 24 02:01:25.115037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1839/2831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:24 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:25.120243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b69146ec-f9fc-4c65-820c-f027c598a85f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b69146ec-f9fc-4c65-820c-f027c598a85f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 HTTP/1.1 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 280 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.125460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b69146ec-f9fc-4c65-820c-f027c598a85f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b69146ec-f9fc-4c65-820c-f027c598a85f tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 400 len: 619 microversion: 2.1 time: 0.010463 Aug 24 02:01:25.129282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1840/2832] 10.222.0.49 () {60 vars in 1257 bytes} [Wed Aug 24 02:01:25 2022] PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:25.133404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:25.133914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:25.143253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.143753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.144181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.144911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.145358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.145779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.262422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edbc48c4-efad-485d-8cdd-4379de77be19 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.132494 Aug 24 02:01:25.266028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1841/2833] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:25 2022] POST /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:25.273533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911fb310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:25.283091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.283607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.284049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.285919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:25.305971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.306668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.307120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.307839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.308399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.308733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.369220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:25.371186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:25.371186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:25.394013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:25.411453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fde1b661-f581-4006-a66a-38ca03076576 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 204 len: 0 microversion: 2.26 time: 0.146971 Aug 24 02:01:25.412070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1842/2834] 10.222.0.49 () {60 vars in 1295 bytes} [Wed Aug 24 02:01:25 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:01:25.521797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afc37d71-04c8-46c6-8a61-e94cd61c2b8e tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Action: 'create', calling method: .version_select at 0x7f6b9177b0d0>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:27.556389 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afc37d71-04c8-46c6-8a61-e94cd61c2b8e tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.142801 Aug 24 02:01:27.557013 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1843/2835] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 02:01:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:27.565248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1c74cac-1e9b-4c3c-a927-7fdf87923bb7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b9118e040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:28.140412 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1c74cac-1e9b-4c3c-a927-7fdf87923bb7 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/9a38ef52-7ddd-4b7b-9805-afa0218bc908" status: 202 len: 0 microversion: 2.1 time: 0.581931 Aug 24 02:01:28.141776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1844/2836] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:01:27 2022] DELETE /compute/v2.1/os-security-groups/9a38ef52-7ddd-4b7b-9805-afa0218bc908 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:28.148098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:28.149740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:28.171314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:28.171819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:28.172254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:28.172995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:28.173453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:28.173910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:28.588417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:28.603565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5409d296-5fb2-4b3c-81ea-e13b352f8fc7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.460493 Aug 24 02:01:28.604997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1845/2837] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:28 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:28.627886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:28.631174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:28.645381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:28.645885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:28.646330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:28.647056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:28.647517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:28.647946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:28.938354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:28.948925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a3da481-4e9e-43be-b88a-5aff825583d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 200 len: 1472 microversion: 2.1 time: 0.327555 Aug 24 02:01:28.949087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1846/2838] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:28 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 1472 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:28.956198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-103b6d24-e907-43ee-baf7-255086f1c84e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91225670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:28.964982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103b6d24-e907-43ee-baf7-255086f1c84e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:28.965870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103b6d24-e907-43ee-baf7-255086f1c84e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:28.966816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103b6d24-e907-43ee-baf7-255086f1c84e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:28.981034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-103b6d24-e907-43ee-baf7-255086f1c84e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 12 microversion: 2.26 time: 0.029050 Aug 24 02:01:28.988988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1847/2839] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 02:01:28 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:28.994824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:28.995706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:29.002293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:29.003092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:29.003743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:29.004643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:29.005332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:29.006001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:29.381974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:29.396889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:29.413960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:29.420275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:29.424870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71bf7f7d-255c-485c-974e-e3aafc49086e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 2929 microversion: 2.32 time: 0.434349 Aug 24 02:01:29.438166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1848/2840] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:28 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 2929 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:29.458372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:29.460417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:29.470362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:29.472087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:29.472795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:29.473732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:29.474392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:29.475054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:29.687274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:29.710363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e61bda90-cda4-4ca2-8010-52316964b644 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.264984 Aug 24 02:01:29.716455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1849/2841] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:29 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:29.726754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d65dc546-3d86-4f9f-b647-dc0fa4c97c79 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b91156d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:30.079313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d65dc546-3d86-4f9f-b647-dc0fa4c97c79 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/d3f277e7-380f-45be-9dde-a65f2fee76d1" status: 200 len: 142 microversion: 2.1 time: 0.360940 Aug 24 02:01:30.079903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1850/2842] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 02:01:29 2022] GET /compute/v2.1/os-floating-ips/d3f277e7-380f-45be-9dde-a65f2fee76d1 => generated 142 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:30.087847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e004dae1-52a0-4f11-9a2b-0f898d02b9db tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b911a79d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:30.522503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e004dae1-52a0-4f11-9a2b-0f898d02b9db tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/94e16bf0-5ec0-4516-b83b-4ac46f10e0f4" status: 202 len: 0 microversion: 2.1 time: 0.421762 Aug 24 02:01:30.523606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1851/2843] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:01:30 2022] DELETE /compute/v2.1/os-security-groups/94e16bf0-5ec0-4516-b83b-4ac46f10e0f4 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:30.543670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:30.557017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:30.603253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:30.608252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:30.608992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:30.609814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:30.616886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:30.617608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.099280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:31.121275 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2b69c8d-f7d3-451c-9889-05566762f5e3 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.593377 Aug 24 02:01:31.123382 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1852/2844] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:30 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:31.154315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-262199982"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:31.161865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:31.182938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.183719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.184450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.185393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.189432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.190135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.617496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a7881ee-954a-4f95-8c45-002449714e69 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.460602 Aug 24 02:01:31.620493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1853/2845] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:01:31 2022] POST /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:01:31.631652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91156550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:31.672039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.676028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.676952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.677870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:31.703436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.704971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.706811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.709243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.712791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.717112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.774244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.775070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.775884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.791377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:31.792861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:31.793519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:31.905828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:31.960246 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ef42d60-a144-4ed6-8a90-c503abe6e2c6 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-448251180" status: 201 len: 0 microversion: 2.26 time: 0.338164 Aug 24 02:01:31.963354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1854/2846] 10.222.0.49 () {62 vars in 1377 bytes} [Wed Aug 24 02:01:31 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-448251180 => generated 0 bytes in 342 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 02:01:31.983576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8875f6b5-4b44-4bc4-80bd-c8bdfaec2308 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b91156af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:32.701270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8875f6b5-4b44-4bc4-80bd-c8bdfaec2308 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.736609 Aug 24 02:01:32.711288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1855/2847] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:01:31 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:32.716428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-unplugged", "status": "completed", "tag": "cf13d730-863e-41c4-a6c7-d3070eaee9b1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:32.727633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:32.728503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:32.729212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:32.743407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] Creating event network-vif-unplugged:cf13d730-863e-41c4-a6c7-d3070eaee9b1 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:32.754148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-830f03a3-c0ee-4c02-9357-759eecf165ed req-027a8435-5408-4f8d-a872-3a10cbd37446 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040550 Aug 24 02:01:32.754370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1856/2848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:32.765279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:32.774842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:32.787339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:32.788182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:32.788971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:32.794351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:32.795161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:32.795877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:33.044962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:33.058670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:33.061282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:33.063011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adc76f35-dbb0-42ab-9467-542a27dc294e tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 2816 microversion: 2.32 time: 0.307688 Aug 24 02:01:33.072807 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1857/2849] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:32 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 2816 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:33.072807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3da01fc-cea2-43fa-8e0b-2fad54083e88 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b911f1b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:33.516154 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3da01fc-cea2-43fa-8e0b-2fad54083e88 tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/d55bc8c9-1951-47af-b73b-24d9a164f1e7" status: 202 len: 0 microversion: 2.1 time: 0.451330 Aug 24 02:01:33.516778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1858/2850] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:01:33 2022] DELETE /compute/v2.1/os-security-groups/d55bc8c9-1951-47af-b73b-24d9a164f1e7 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:33.521635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-deleted", "tag": "efdfe94a-558a-4964-b054-0ee5008b309f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:33.540149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:33.540639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:33.541115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:33.600211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] Creating event network-vif-deleted:efdfe94a-558a-4964-b054-0ee5008b309f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:33.606697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ac2002f8-9569-47a6-a886-70d22e4227fc req-c659b595-a561-43bb-98b9-cf66d99a583a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088478 Aug 24 02:01:33.608205 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1859/2851] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:33.615116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:33.616311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:33.623466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:33.624206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:33.624928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:33.625881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:33.626702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:33.627377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:33.873877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:33.883693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c6ed802-1576-421c-a4c3-f3dff0bb4214 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.273832 Aug 24 02:01:33.885090 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1860/2852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:33 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:33.889935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51dff4c5-3f27-4dc6-b495-88bcd9ad0bef tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51dff4c5-3f27-4dc6-b495-88bcd9ad0bef tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 HTTP/1.1 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 24 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": ""}} Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6', 'body': {'server': {'name': ''}}} Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '' Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:01:33.894861 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 24 02:01:33.898806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:33.901374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51dff4c5-3f27-4dc6-b495-88bcd9ad0bef tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:33.902708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51dff4c5-3f27-4dc6-b495-88bcd9ad0bef tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 400 len: 108 microversion: 2.1 time: 0.016419 Aug 24 02:01:33.904511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1861/2853] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:01:33 2022] PUT /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:01:33.911838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d015b96-a9e5-4d79-a1ec-f7e1f1a6e159 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91160160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:33.967364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d015b96-a9e5-4d79-a1ec-f7e1f1a6e159 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 200 len: 1413 microversion: 2.1 time: 0.061219 Aug 24 02:01:33.968241 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1862/2854] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:01:33 2022] GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:33.973740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df4d47cf-a050-418a-b851-790290440f67 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91314ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:33.981474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df4d47cf-a050-418a-b851-790290440f67 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:33.982076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df4d47cf-a050-418a-b851-790290440f67 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:33.982616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df4d47cf-a050-418a-b851-790290440f67 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:33.991696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df4d47cf-a050-418a-b851-790290440f67 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 35 microversion: 2.26 time: 0.022172 Aug 24 02:01:33.992957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1863/2855] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 02:01:33 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 35 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:33.997998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4fc7be2b-71b7-4beb-90d9-ede53ed3e106 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b911793a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:35.793667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4fc7be2b-71b7-4beb-90d9-ede53ed3e106 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/d3f277e7-380f-45be-9dde-a65f2fee76d1" status: 202 len: 0 microversion: 2.1 time: 1.799351 Aug 24 02:01:35.794560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1864/2856] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:01:33 2022] DELETE /compute/v2.1/os-floating-ips/d3f277e7-380f-45be-9dde-a65f2fee76d1 => generated 0 bytes in 1801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:35.800085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a59c51b-1cb9-4188-b6b3-c13c652ba0ba tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b91156dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:36.223446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a59c51b-1cb9-4188-b6b3-c13c652ba0ba tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/5ca47a0c-2c2d-473d-a500-0b1fb9ad9e77" status: 202 len: 0 microversion: 2.1 time: 0.427088 Aug 24 02:01:36.224617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1865/2857] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:01:35 2022] DELETE /compute/v2.1/os-security-groups/5ca47a0c-2c2d-473d-a500-0b1fb9ad9e77 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:36.241042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:36.243991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:36.261365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.262240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.262884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.264418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.265347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.265997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.544924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:36.555594 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eae9608c-4fd5-46fa-8eee-fffffe3397c7 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1504 microversion: 2.1 time: 0.318243 Aug 24 02:01:36.567135 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1866/2858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:36 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:36.573001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91160670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:36.593747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.598489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.599082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.600649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:36.607942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.608430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.608921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.609748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.610194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.610788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.637484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.638229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.638825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.671092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:36.707844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca876ebf-cb90-4314-ab0a-10d27225490b tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-448251180" status: 204 len: 0 microversion: 2.26 time: 0.138935 Aug 24 02:01:36.709106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1867/2859] 10.222.0.49 () {60 vars in 1361 bytes} [Wed Aug 24 02:01:36 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-448251180 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:01:36.714252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:36.715052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:36.722580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.723314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.723905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.724860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.725465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.726897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.849056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:36.859227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:36.870288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:36.870288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc5dc0bc-d7e0-4c67-afd9-16a4b4630e57 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1604 microversion: 2.32 time: 0.152282 Aug 24 02:01:36.870288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1868/2860] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:36 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:36.885370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-unplugged", "status": "completed", "tag": "388674f5-75f1-4dad-984e-1a85c9e5ed1c"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-unplugged", "status": "completed", "tag": "54393e22-36ea-466c-a75d-f21b7d4792a8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:36.897367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.898417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.899052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.911750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Creating event network-vif-unplugged:388674f5-75f1-4dad-984e-1a85c9e5ed1c for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:36.912636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] Creating event network-vif-unplugged:54393e22-36ea-466c-a75d-f21b7d4792a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:36.921345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-575d8538-90f1-43ac-95d1-47bd903f47bf req-a4464201-1911-4088-be65-4b608833e873 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.050816 Aug 24 02:01:36.925203 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1869/2861] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:36.938136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:36.941141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:36.956772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.959244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.959802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:36.962204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:36.964895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:36.965831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:37.355077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:37.369134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55cd18a3-3d0e-4d85-8a1b-f68540e1bb88 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.438232 Aug 24 02:01:37.379804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1870/2862] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:36 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:37.383756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48d0a9e7-2904-4367-a086-40bc0e4293c8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91225f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:37.457880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48d0a9e7-2904-4367-a086-40bc0e4293c8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 200 len: 1413 microversion: 2.1 time: 0.081077 Aug 24 02:01:37.467644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1871/2863] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:01:37 2022] GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:37.482950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-deleted", "tag": "957de5bb-22b4-440c-a3f5-be84eac0472f"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-deleted", "tag": "cf13d730-863e-41c4-a6c7-d3070eaee9b1"}, {"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-deleted", "tag": "54393e22-36ea-466c-a75d-f21b7d4792a8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:37.504337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:37.505169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:37.505831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:37.544864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Creating event network-vif-deleted:957de5bb-22b4-440c-a3f5-be84eac0472f for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:37.546484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Creating event network-vif-deleted:cf13d730-863e-41c4-a6c7-d3070eaee9b1 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:37.549408 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] Creating event network-vif-deleted:54393e22-36ea-466c-a75d-f21b7d4792a8 for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:37.564972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f68f6210-fad8-4bda-9fd6-eb5d4d241164 req-7f95ec67-0bb3-43ec-a6c9-1f8498a0269c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.091324 Aug 24 02:01:37.573039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1872/2864] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:37.590254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14635a0-efac-4609-9368-b08426874e4f tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Action: 'create', calling method: .version_select at 0x7f6b911aa1f0>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:40.226135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b14635a0-efac-4609-9368-b08426874e4f tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.651514 Aug 24 02:01:40.233236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1873/2865] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 02:01:37 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:40.239713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b23a74b7-ac99-46bf-bd1a-a757dc66bdbc tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] Calling method '.version_select at 0x7f6b9110a0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:40.818830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b23a74b7-ac99-46bf-bd1a-a757dc66bdbc tempest-SecurityGroupRulesNegativeTestJSON-1138886911 tempest-SecurityGroupRulesNegativeTestJSON-1138886911-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/7e29d603-23a2-4d6c-b184-ced401081157" status: 202 len: 0 microversion: 2.1 time: 0.583997 Aug 24 02:01:40.823412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1874/2866] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:01:40 2022] DELETE /compute/v2.1/os-security-groups/7e29d603-23a2-4d6c-b184-ced401081157 => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:40.831036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e34aea7-8c7f-4271-bdf9-5c26390d980e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91156430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:40.861810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e34aea7-8c7f-4271-bdf9-5c26390d980e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:40.862330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e34aea7-8c7f-4271-bdf9-5c26390d980e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:40.862963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e34aea7-8c7f-4271-bdf9-5c26390d980e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:40.877454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:40.893261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e34aea7-8c7f-4271-bdf9-5c26390d980e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 12 microversion: 2.26 time: 0.070862 Aug 24 02:01:40.894645 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1875/2867] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 02:01:40 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 12 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:40.899576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:40.900700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:40.919201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:40.920441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:40.921098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:40.922433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:40.923047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:40.923687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:41.103782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:41.115910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:41.117470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:41.126069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58e72cd2-6b2d-4df1-befa-30a74c750019 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1604 microversion: 2.32 time: 0.230054 Aug 24 02:01:41.141211 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1876/2868] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:40 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:41.155643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:41.161319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:41.180253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:41.182184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:41.184983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:41.186929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:41.190353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:41.191086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:41.619039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:41.629220 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-971ece86-3a49-40c0-85c6-e016b1a377a0 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1512 microversion: 2.1 time: 0.486495 Aug 24 02:01:41.645107 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1877/2869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:41 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:41.662996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1e779b1-3a2b-4da2-8d24-8f4261161971 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9110d790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:41.779929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1e779b1-3a2b-4da2-8d24-8f4261161971 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 200 len: 1413 microversion: 2.1 time: 0.133109 Aug 24 02:01:41.793061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1878/2870] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:01:41 2022] GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 1413 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:41.823383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20df93e9-de2c-4d28-9630-e0e53bc4c7f0", "name": "network-vif-plugged", "status": "completed", "tag": "2ce37610-d809-495e-bf1f-31e1d8892c26"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:41.878586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:41.880578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:41.881087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:41.881520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:41.946943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] Creating event network-vif-plugged:2ce37610-d809-495e-bf1f-31e1d8892c26 for instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 on n-h2-854121-3 Aug 24 02:01:41.959336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0ca48df6-b217-469d-9f41-2758e16b07d6 req-3724730c-c57a-4f2d-8945-64ac33f99455 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165079 Aug 24 02:01:41.971625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1879/2871] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:41.977722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74120617-cff6-452e-9a5e-002f53d6f300", "name": "network-vif-deleted", "tag": "388674f5-75f1-4dad-984e-1a85c9e5ed1c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:01:41.998310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:41.998823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:42.000140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:42.076933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] Creating event network-vif-deleted:388674f5-75f1-4dad-984e-1a85c9e5ed1c for instance 74120617-cff6-452e-9a5e-002f53d6f300 on n-h1-854121-3 Aug 24 02:01:42.098052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a52ddb5b-35bd-44ab-946f-14296318153f req-c9ee19f0-5b21-4f86-87ce-057ceabf295f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121783 Aug 24 02:01:42.105458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1880/2872] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:01:42.124194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42bfb2ce-a664-44fa-8850-2b2bea6741c2 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b911fbe50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:44.324584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-42bfb2ce-a664-44fa-8850-2b2bea6741c2 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041" status: 202 len: 0 microversion: 2.1 time: 2.213488 Aug 24 02:01:44.325575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1881/2873] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:01:42 2022] DELETE /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041 => generated 0 bytes in 2219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:01:44.333643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b9118e0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:44.375848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.377817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.385525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.386163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:44.406399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.408981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.412978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.418962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.419622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.420214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.497884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.505700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.507371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.546500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:44.591693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a4696cc-b10c-4534-a74c-773555e54a11 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 204 len: 0 microversion: 2.26 time: 0.264533 Aug 24 02:01:44.593922 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1882/2874] 10.222.0.49 () {60 vars in 1295 bytes} [Wed Aug 24 02:01:44 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:01:44.607869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:44.612591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:44.645711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.652291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.654692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.655647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.658669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.664437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.835924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:44.849117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:44.857989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:44.862893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73a2c73b-7a23-4652-a5e4-68db37856081 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1604 microversion: 2.32 time: 0.267779 Aug 24 02:01:44.864426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1883/2875] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:01:44 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:01:44.889036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:44.889696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:44.906481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.912594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.913407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:44.914652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:44.915391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:44.916054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:45.298445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:01:45.309927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8a315a3-aa19-4655-8dd9-bfbd4f0d3e2a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1489 microversion: 2.1 time: 0.441222 Aug 24 02:01:45.319075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1884/2876] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:01:44 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1489 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:45.329923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6926ab8f-a782-4d42-bb54-1efb02e2ea4d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91160670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:54.905387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:55.306752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=36,nova_cell1:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:01:59.504121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6926ab8f-a782-4d42-bb54-1efb02e2ea4d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 200 len: 1422 microversion: 2.1 time: 14.183653 Aug 24 02:01:59.504753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1885/2877] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:01:45 2022] GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 1422 bytes in 14185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:01:59.512242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b911a78b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:59.622219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1243cad6-8e53-4af1-97eb-81dccbc9c041 could not be found", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:01:59.622949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] HTTP exception thrown: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Request method failure captured: Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041 HTTP/1.1 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZ07xi0xFAmqGc8CiaReeVqv5quHt5cjhaCB2lzBJXNiaavsH2XoK_ZuM6CKVC4BBcogGj4VwL_4LB16BrBhcfPW17kA1GR_NzMSTYpsH_UEOYYLtSvEAhCN3H_BmckEmwWIYo5mwtIe8qXK7GnZb9J2s2aWymaVz2JOggqkL67oIM Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: dc329dd2b8ec4236bb5b0d2608bde522 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: dc329dd2b8ec4236bb5b0d2608bde522 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsTestJSON-661092967-project Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 43060d2622bb43dca6898bb98a66c5b6 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsTestJSON-661092967-project Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: exception: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1243cad6-8e53-4af1-97eb-81dccbc9c041'} Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1243cad6-8e53-4af1-97eb-81dccbc9c041 could not be found Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a01f4b24-1e0c-480b-9f33-7d43af49fcdc'] Aug 24 02:01:59.625405 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041. Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Returning 404 to user: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09b7b0e8-017b-42a1-85ae-2dbed8ab47e4 tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041" status: 404 len: 111 microversion: 2.1 time: 0.118812 Aug 24 02:01:59.629715 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1886/2878] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 02:01:59 2022] GET /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:01:59.637366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911aa3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:59.664433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.665728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.666475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.669386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:59.680131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.680747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.681278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.682081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.682612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.683709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.718046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.718656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.720063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.735101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.735909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.736541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.809484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:01:59.834849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7986a3ee-1fe8-4756-9cc4-f01f0f806f38 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-1267128200" status: 201 len: 0 microversion: 2.26 time: 0.205435 Aug 24 02:01:59.841525 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1887/2879] 10.222.0.49 () {62 vars in 1380 bytes} [Wed Aug 24 02:01:59 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-1267128200 => generated 0 bytes in 213 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 24 02:01:59.855952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:01:59.856753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:01:59.865277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.866024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.866649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.867540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:01:59.868164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:01:59.868833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:01:59.904879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:02:00.070647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbff4e57-71c3-4798-86f5-7faaedca2d85 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 204 len: 0 microversion: 2.1 time: 0.225987 Aug 24 02:02:00.075665 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1888/2880] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:01:59 2022] DELETE /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:02:00.117850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.118826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.146563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.395899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:00.411160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:00.415383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:00.416638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eed8c086-8a07-4e98-91f6-0c2e6cefdfb3 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1604 microversion: 2.32 time: 0.339598 Aug 24 02:02:00.419180 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1889/2881] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:00 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1604 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:02:00.433699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.434238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:00.445124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.445624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.446085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.446769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.447223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.447903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.466969 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 HTTP/1.1 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7d660cab-5e97-47a1-bfc9-1fcf2254e486'} Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:00.472212 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:00.476998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24bdfcb1-a020-49aa-bcbe-83a4ea2850a2 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 404 len: 111 microversion: 2.1 time: 0.053487 Aug 24 02:02:00.481768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1890/2882] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:00 2022] DELETE /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:00.490384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92e06c38-2c2e-481c-9a13-a6014c4e5058 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b911a7790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.554681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92e06c38-2c2e-481c-9a13-a6014c4e5058 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 200 len: 1422 microversion: 2.1 time: 0.071571 Aug 24 02:02:00.559485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1891/2883] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:02:00 2022] GET /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:00.570158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Calling method '.version_select at 0x7f6b9118ab80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.651288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1243cad6-8e53-4af1-97eb-81dccbc9c041 could not be found", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:00.652953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] HTTP exception thrown: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Request method failure captured: Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041 HTTP/1.1 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZ07xi0xFAmqGc8CiaReeVqv5quHt5cjhaCB2lzBJXNiaavsH2XoK_ZuM6CKVC4BBcogGj4VwL_4LB16BrBhcfPW17kA1GR_NzMSTYpsH_UEOYYLtSvEAhCN3H_BmckEmwWIYo5mwtIe8qXK7GnZb9J2s2aWymaVz2JOggqkL67oIM Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: dc329dd2b8ec4236bb5b0d2608bde522 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc329dd2b8ec4236bb5b0d2608bde522"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: dc329dd2b8ec4236bb5b0d2608bde522 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsTestJSON-661092967 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsTestJSON-661092967-project Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 43060d2622bb43dca6898bb98a66c5b6 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsTestJSON-661092967-project Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: exception: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1243cad6-8e53-4af1-97eb-81dccbc9c041'} Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1243cad6-8e53-4af1-97eb-81dccbc9c041 could not be found Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5054776-d007-47ee-ae93-946d4bd7c774'] Aug 24 02:02:00.654925 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041. Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] Returning 404 to user: Floating IP not found for ID 1243cad6-8e53-4af1-97eb-81dccbc9c041 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-658bf12a-0409-457e-b60a-cacb77dd0b6d tempest-FloatingIPsTestJSON-661092967 tempest-FloatingIPsTestJSON-661092967-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041" status: 404 len: 111 microversion: 2.1 time: 0.095609 Aug 24 02:02:00.659509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1892/2884] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:02:00 2022] DELETE /compute/v2.1/os-floating-ips/1243cad6-8e53-4af1-97eb-81dccbc9c041 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:00.667661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911f1b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.687874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.688708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.689371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.690193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:00.699538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.700272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.700903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.702070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.702537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.703284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.738736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.739594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.740054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.751049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.751576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.752011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.789018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:00.809903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-531bdb67-b91f-4355-bb85-8238c054e94f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-765055229" status: 201 len: 0 microversion: 2.26 time: 0.150723 Aug 24 02:02:00.815472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1893/2885] 10.222.0.49 () {62 vars in 1377 bytes} [Wed Aug 24 02:02:00 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-765055229 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 02:02:00.835923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:00.836863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:00.843698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.844200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.844646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:00.846110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:00.847192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:00.847313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:01.045638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:01.056576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c04fdb7-b00c-4cef-8634-e95fc4ac4331 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 200 len: 1495 microversion: 2.1 time: 0.239140 Aug 24 02:02:01.058272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1894/2886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:00 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 1495 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:01.265633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb17f835-c81a-48af-abef-d504c6b9983e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Action: 'create', calling method: .version_select at 0x7f6b911aa9d0>, body: {"keypair": {"name": "tempest-keypair-1048089594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpzf4y4P5+UMYltYq9ltL3pGAyEsqDWmUr+889JwyBp6gY8daCqZ51ENrAEfRBgTjvYjtQjpqxM9Orao6yvRAcc7eeQXieGnQkmmeVUh1JxfbUvnIxaPXW9wnZ9YSPQXQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:01.281440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eb17f835-c81a-48af-abef-d504c6b9983e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Getting quotas for project 448f19d0920242d2a897f4c7b992f703. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:01.287373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eb17f835-c81a-48af-abef-d504c6b9983e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Getting quotas for user dcd501b317174afcbfdfe4cedadc6b0b and project 448f19d0920242d2a897f4c7b992f703. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:01.324202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb17f835-c81a-48af-abef-d504c6b9983e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.264558 Aug 24 02:02:01.324943 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1895/2887] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:02:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:01.330102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:01.330827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 7d660cab-5e97-47a1-bfc9-1fcf2254e486] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:01.337442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:01.338077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:01.338818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:01.339530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:01.339982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:01.340400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:01.355709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 HTTP/1.1 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7d660cab-5e97-47a1-bfc9-1fcf2254e486'} Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:01.357608 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 7d660cab-5e97-47a1-bfc9-1fcf2254e486 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-382975f6-4ddc-4022-a185-f84d8a787479 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486" status: 404 len: 111 microversion: 2.1 time: 0.033217 Aug 24 02:02:01.362423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1896/2888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:01 2022] GET /compute/v2.1/servers/7d660cab-5e97-47a1-bfc9-1fcf2254e486 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:01.367432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-715dbe3c-0a2f-4d21-a6e3-8fda9731d725 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9118e430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:02.273787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-715dbe3c-0a2f-4d21-a6e3-8fda9731d725 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 204 len: 0 microversion: 2.1 time: 0.911694 Aug 24 02:02:02.282545 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1897/2889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:01 2022] DELETE /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:02:02.383603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc311e50-c4dc-4dff-979c-45a914e222b4 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b9118a550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-244225813", "description": "tempest-description-1282800268"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:03.098811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc311e50-c4dc-4dff-979c-45a914e222b4 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.812663 Aug 24 02:02:03.099615 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1898/2890] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:03.112386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b9110a670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:03.135456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.136315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.137001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.137684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:03.146548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.158946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.160398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.164193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.165061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.166118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.247685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.255406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.256212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.288661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:03.357317 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba6808cd-1e8e-47f4-b46d-b225a17f3524 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 204 len: 0 microversion: 2.26 time: 0.254512 Aug 24 02:02:03.358169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1899/2891] 10.222.0.49 () {60 vars in 1295 bytes} [Wed Aug 24 02:02:03 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:02:03.377756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:03.378030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:03.391284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.395055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.395949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.397079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.397199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.397628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.464171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:02:03.568813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ca6ef77-8f8c-4b15-b39a-8342a67af576 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 204 len: 0 microversion: 2.1 time: 0.201713 Aug 24 02:02:03.570438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1900/2892] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:03 2022] DELETE /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:02:03.592577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:03.593338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:03.602766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.603619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.604989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:03.605999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:03.606616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:03.607197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.089025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:04.107125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:04.110469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '12bf7164fa554f238b90c30e30484c80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11b9c09fe62f48a493380c77be9a6de9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:04.116396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d85659c-4a08-4846-b08d-09b359aa3e48 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 200 len: 1604 microversion: 2.32 time: 0.540560 Aug 24 02:02:04.118463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1901/2893] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:03 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 1604 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:02:04.126275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:04.129186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:04.169031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.171678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.193002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.193989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.195281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.196549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.263210 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 HTTP/1.1 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '43295b8b-050c-4eca-bada-135cbf527764'} Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:04.275816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:04.279593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:04.280971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ad20aae-bf8e-499a-9bcd-da33e97af4e1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 404 len: 111 microversion: 2.1 time: 0.160150 Aug 24 02:02:04.281707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1902/2894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:04 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:04.296250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:04.296701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:04.304767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.307746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.308611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.309029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.309584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.310252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.315720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:04.364863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:02:04.504419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbde7d4b-58d3-4b26-b55a-d70a83038457 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 204 len: 0 microversion: 2.1 time: 0.220477 Aug 24 02:02:04.505649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1903/2895] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:04 2022] DELETE /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:02:04.513251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43295b8b-050c-4eca-bada-135cbf527764", "name": "network-vif-deleted", "tag": "2797e39c-eb57-44aa-8413-5b7c0c7cde73"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:04.536366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.537476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.537594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.551022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] Creating event network-vif-deleted:2797e39c-eb57-44aa-8413-5b7c0c7cde73 for instance 43295b8b-050c-4eca-bada-135cbf527764 on n-h1-854121-3 Aug 24 02:02:04.557598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b2460874-4b95-4028-8048-2911e69bb2fd req-0f1435d9-10d9-47f1-bb13-8bc6b8c0f3fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049668 Aug 24 02:02:04.558856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1904/2896] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:04.565835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24cdc522-3a6d-4cd6-b35f-f1ffda86f8cf tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b9118ef70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-939184526", "description": "tempest-description-1428100386"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:04.728019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24cdc522-3a6d-4cd6-b35f-f1ffda86f8cf tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.167665 Aug 24 02:02:04.740778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1905/2897] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:04.740778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20df93e9-de2c-4d28-9630-e0e53bc4c7f0", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce37610-d809-495e-bf1f-31e1d8892c26"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:04.759786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.760381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.762184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.774148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] Creating event network-vif-unplugged:2ce37610-d809-495e-bf1f-31e1d8892c26 for instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 on n-h2-854121-3 Aug 24 02:02:04.779478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-583d8afc-0b79-4a26-964e-7630615c18e7 req-d54bc17d-ede6-4883-8776-54fc7e5015ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048643 Aug 24 02:02:04.780678 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1906/2898] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:04.789588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e28f64b7-2515-4be0-b534-5a3739de2e0f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b913145e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:04.797916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28f64b7-2515-4be0-b534-5a3739de2e0f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:04.798986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28f64b7-2515-4be0-b534-5a3739de2e0f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:04.799427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28f64b7-2515-4be0-b534-5a3739de2e0f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:04.808547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e28f64b7-2515-4be0-b534-5a3739de2e0f tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 12 microversion: 2.26 time: 0.026310 Aug 24 02:02:04.809399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1907/2899] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 02:02:04 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:04.819321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-706776892", "imageRef": "601fdb3f-ffb0-4fc3-9a90-53072d8ea50a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "200b9ab4-cced-4a21-b6aa-8e1fc55e74d1"}], "security_groups": [{"name": "tempest-securitygroup--463695840"}], "key_name": "tempest-keypair-1048089594", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:04.997081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] validate_networks() for [('200b9ab4-cced-4a21-b6aa-8e1fc55e74d1', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:02:05.696427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:02:05.698154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:02:05.698639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:02:05.699044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:02:05.699619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:02:05.709902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:05.710393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:05.710833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:05.711562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:05.712018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:05.712503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:05.739916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Getting quotas for project 448f19d0920242d2a897f4c7b992f703. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:05.745914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Getting quotas for user dcd501b317174afcbfdfe4cedadc6b0b and project 448f19d0920242d2a897f4c7b992f703. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:05.763983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:02:05.766445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='601fdb3f-ffb0-4fc3-9a90-53072d8ea50a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:02:05.832647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ed3bdd1-fb3a-4424-9b7e-5cf0a04be6d8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.019214 Aug 24 02:02:05.833362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1908/2900] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:02:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:02:05.842939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:05.843568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:05.851741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:05.852145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:05.852893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:05.854344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:05.854887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:05.855254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:06.059427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a45857c939914f98bc0ea5d2350817b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca375751092f40f79f187cab5c6c9b76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:06.071749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec07809-4ebe-4f08-84c0-a5d5f208bd77 tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 200 len: 1510 microversion: 2.1 time: 0.237132 Aug 24 02:02:06.072516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1909/2901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:05 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:06.091618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-384222361", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f063e915-3d81-4041-baf0-073f76efb223"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:06.159466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] validate_networks() for [('f063e915-3d81-4041-baf0-073f76efb223', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:02:06.702481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:02:06.703061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:02:06.703401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:02:06.703844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:02:06.704932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:02:06.715783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:06.716353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:06.716839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:06.717573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:06.718211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:06.718642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:06.736881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:06.742902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Getting quotas for user 14c3e6fc474345239f16575d5b5439ef and project 005c578132f34fde8611eb817e0f0c7a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:06.756381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:02:06.758889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:02:06.771723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:06.812711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa05e373-42fc-4a7f-b744-0c0849add006 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726770 Aug 24 02:02:06.816975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1910/2902] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:02:06.825335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-75789518", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "b1581d10-276f-4f25-861c-edcd3a3366ea"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:06.919700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] validate_networks() for [('b1581d10-276f-4f25-861c-edcd3a3366ea', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:02:07.651229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:02:07.651895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:02:07.652552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:02:07.653140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:02:07.653767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:02:07.668466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:07.673008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:07.674233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:07.676394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:07.677193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:07.677869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:07.733304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:07.740841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for user 19d2def105dc41a78e79aedb36fbe5b0 and project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:07.754313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:02:07.756628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:02:07.809899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6d40397-4d4a-4f98-aa37-f44829740920 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991001 Aug 24 02:02:07.828139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1911/2903] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:02:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:02:07.841238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-236742101", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "3d600fec-519b-4c08-a3ed-6b3145c95c73"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:07.945735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] validate_networks() for [('3d600fec-519b-4c08-a3ed-6b3145c95c73', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:02:09.483850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:02:09.484986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:02:09.485771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:02:09.486378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:02:09.486957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:02:09.500602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.511655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.512775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.513809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.514769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.515624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.552088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Getting quotas for project 01be30d45d214564b7cc7bfdd1dc62ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:09.572158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Getting quotas for user 2e317f2628594867bcb0d228ade52975 and project 01be30d45d214564b7cc7bfdd1dc62ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:09.628233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:02:09.632993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:02:09.743719 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bfcf98db-2476-46a6-9d9a-b66e3f446f88 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913263 Aug 24 02:02:09.745122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1912/2904] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:02:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:02:09.754043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b91116820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:09.765357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.766088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.767822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.768835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:09.779659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.780565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.781311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.782221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.783928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.784654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.818816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.819615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.820276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.846297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:09.872526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9411294e-a293-4a8f-9f76-4db70a21f1a7 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 204 len: 0 microversion: 2.26 time: 0.126076 Aug 24 02:02:09.874145 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1913/2905] 10.222.0.49 () {60 vars in 1295 bytes} [Wed Aug 24 02:02:09 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:02:09.883731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:09.884620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:09.893580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.894761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.895756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.897366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.898273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.899072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.925767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] HTTP exception thrown: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Request method failure captured: Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 HTTP/1.1 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUpcBrY5V1eznzAiaXBRm4595U3kNtfRONpMq7oGw3khLzHixy9Bz-i172LpWLRr3dGQOtrHG1jrlTlUqZNu7thrmCdLHFr0qVCgtyHnDJ-Jju4cdKR-xMw30YbMvuEhM4olrTPu6Q9mQtcILNkzRiYFMDcZE5pzlovLcUrZyNI3S4 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 12bf7164fa554f238b90c30e30484c80 Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '74120617-cff6-452e-9a5e-002f53d6f300'} Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:09.927859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:09.932661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:09.946893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Returning 404 to user: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:09.948224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-506a9d53-d209-4a5b-89f4-2749147a33dc tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 404 len: 111 microversion: 2.32 time: 0.072152 Aug 24 02:02:09.952744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1914/2906] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:09 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:02:09.963985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:09.964604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:09.982801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.983308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.983750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:09.984460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:09.984976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:09.985411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:10.672675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:10.691707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5090e6c3-298a-4b97-ba12-e6f8e12a823e tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1303 microversion: 2.1 time: 0.740104 Aug 24 02:02:10.705041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1915/2907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:09 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1303 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:10.729758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:10.733393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:10.748228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:10.749105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:10.749920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:10.754254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:10.755323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:10.756212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:10.967447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:10.982249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3ee2fca-3c61-4b3b-8ce9-a1c9f55bfc0e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1272 microversion: 2.1 time: 0.276025 Aug 24 02:02:10.994204 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1916/2908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:10 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:11.001289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:11.008688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] [instance: 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:11.029313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.029817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.030546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.031350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.031952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.032583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.123025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] HTTP exception thrown: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Request method failure captured: Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 HTTP/1.1 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUuTvwv-w5t9O3dpvJ5IFT4zW94J-dyF2RshYsxNhmf0G75Hkuh_zM4PY6vEKm0Z1FBTt6dpp_ekhVPQmQMV4SXRNhgt4mXZZGUQ_T2rdaxU0RdCiZ8mxZ9i4Ot6oR2WUTQH7ih6VDINC-sp7x9uvNGqSG6rYJ-yvMIOfCn-2F0fQ0 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ca375751092f40f79f187cab5c6c9b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ca375751092f40f79f187cab5c6c9b76 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-809175249 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a45857c939914f98bc0ea5d2350817b9 Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-809175249-project Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '07f1855f-e4d3-4bb4-bb2a-12ec6888dca6'} Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:11.129245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] Returning 404 to user: Instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:11.133626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-321352af-01b6-426d-a0d4-b7169bb149cb tempest-ServersNegativeTestJSON-809175249 tempest-ServersNegativeTestJSON-809175249-project] 10.222.0.49 "GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6" status: 404 len: 111 microversion: 2.1 time: 0.134622 Aug 24 02:02:11.136151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1917/2909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:10 2022] GET /compute/v2.1/servers/07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:11.158279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:11.160126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:11.171051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.171771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.172231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.173819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.174688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.175472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.840611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:11.856303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40879768-4bef-49fa-bdfc-6b9c3a1ae2ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1264 microversion: 2.1 time: 0.716188 Aug 24 02:02:11.857230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1918/2910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:11 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1264 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:11.865870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f1855f-e4d3-4bb4-bb2a-12ec6888dca6", "name": "network-vif-deleted", "tag": "d65f7677-775f-40df-a5c2-df3a361a9d3c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:11.902449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.903350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.903995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.940527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] Creating event network-vif-deleted:d65f7677-775f-40df-a5c2-df3a361a9d3c for instance 07f1855f-e4d3-4bb4-bb2a-12ec6888dca6 on n-h2-854121-3 Aug 24 02:02:11.951945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-533fa16c-0fcd-4bad-887b-9d7e7f585204 req-9639d648-945f-42b9-ba2d-a822aa1fb959 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092379 Aug 24 02:02:11.952552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1919/2911] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:11.958542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:11.959256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:11.967671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.967975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.968538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:11.969322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:11.972003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:11.972003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.425275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:12.440397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6162391-2ca5-4ba2-b22f-b63841d31bd9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1267 microversion: 2.1 time: 0.486413 Aug 24 02:02:12.442787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1920/2912] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:11 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1267 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:12.453550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911328b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:12.477689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.482496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.483391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.487589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:12.506619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.510153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.510868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.513549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.514741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.516365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.585929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.586446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.586896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.606150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.606676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.607117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.651977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:12.690014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ffc7935-504a-4f7b-a8bd-d2ab83239c9e tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-758674769" status: 201 len: 0 microversion: 2.26 time: 0.243814 Aug 24 02:02:12.690820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1921/2913] 10.222.0.49 () {62 vars in 1377 bytes} [Wed Aug 24 02:02:12 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-758674769 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 02:02:12.702260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e1c7666-92ce-4e1c-9634-86841aebcc98 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '.version_select at 0x7f6b911161f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:12.744862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e1c7666-92ce-4e1c-9634-86841aebcc98 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020293187" status: 204 len: 0 microversion: 2.32 time: 0.048976 Aug 24 02:02:12.747256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1922/2914] 10.222.0.49 () {60 vars in 1262 bytes} [Wed Aug 24 02:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020293187 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:02:12.764683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:12.767690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:12.784217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.788610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.792310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:12.794657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:12.797643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:12.798914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:13.480958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:13.495886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71660d23-9fef-4349-b482-6b25621238f0 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.746019 Aug 24 02:02:13.497202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1923/2915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:12 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:13.502559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:13.507796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:13.528086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:13.529016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:13.529687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:13.530629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:13.531297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:13.531936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:13.602505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:14.652701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:14.664617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08b7fa66-3a41-4dc6-b0e9-be96f3a855cc tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 1.163217 Aug 24 02:02:14.679636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1924/2916] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:13 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:14.691854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b9177b670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:14.714205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.715863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.716313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.718386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:14.740089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.740937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.743755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.744671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.745332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.745948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.797142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.798098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.799025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.816464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.818499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.821030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.898793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:14.934691 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fba72a88-5d73-4c88-8566-3266259ddb5a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-313541793" status: 201 len: 0 microversion: 2.26 time: 0.253847 Aug 24 02:02:14.935359 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1925/2917] 10.222.0.49 () {62 vars in 1377 bytes} [Wed Aug 24 02:02:14 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags/tempest-tag-313541793 => generated 0 bytes in 255 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 24 02:02:14.949637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:14.952899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:14.971547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.974419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.977074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:14.978911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:14.980335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:14.981890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:15.590695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:15.603656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e04e7d48-bac3-4f66-b6fe-7412e83e0b8c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1306 microversion: 2.1 time: 0.665466 Aug 24 02:02:15.621643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1926/2918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:14 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1306 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:15.634220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:15.634848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:15.652515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:15.653084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:15.656399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:15.657406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:15.658595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:15.659088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:15.857876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:15.881213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16aaf0ff-178c-4706-aac7-127a9e772c8d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1273 microversion: 2.1 time: 0.258144 Aug 24 02:02:15.898962 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1927/2919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:15 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:15.905341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20df93e9-de2c-4d28-9630-e0e53bc4c7f0", "name": "network-vif-deleted", "tag": "2ce37610-d809-495e-bf1f-31e1d8892c26"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:15.929521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:15.930403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:15.931109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:15.958372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] Creating event network-vif-deleted:2ce37610-d809-495e-bf1f-31e1d8892c26 for instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 on n-h2-854121-3 Aug 24 02:02:15.971066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1031912c-c560-4da0-be1b-1820a5d00eb9 req-a7ecd020-71d7-4622-b7ef-5c445b4de35e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070351 Aug 24 02:02:15.985143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1928/2920] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:15.992798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:15.993778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:16.001850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:16.009650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:16.010891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:16.012060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:16.012861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:16.013557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.579572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:17.588338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-baf14948-974d-4212-8c03-f364a64acad4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 1.600513 Aug 24 02:02:17.592293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1929/2921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:15 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:17.607742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Action: 'update_all', calling method: .version_select at 0x7f6b9118a9d0>, body: {"tags": ["tempest-tag-363153658", "tempest-tag-2113463478"]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:17.625379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.629622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.630374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.631114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:17.645503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.646258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.646981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.649909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.650673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.651374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.705123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.705799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.709299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.753937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:17.791907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3df2e05b-1c7d-48f4-9b4f-fd52d7f4a26a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 61 microversion: 2.26 time: 0.198264 Aug 24 02:02:17.806368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1930/2922] 10.222.0.49 () {62 vars in 1312 bytes} [Wed Aug 24 02:02:17 2022] PUT /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 61 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:17.816195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:17.816956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:17.828843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.838552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.839121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:17.839890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:17.840371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:17.840828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:18.578313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:18.587523 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-968b95e5-ca31-48c6-89c6-5111f4754651 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.779918 Aug 24 02:02:18.604651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1931/2923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:17 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:18.621126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:18.622106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:18.632773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:18.633280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:18.633755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:18.634443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:18.634902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:18.635325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.185861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:19.194169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a42cc87-8e95-4fbb-8abb-1e209222a82c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1306 microversion: 2.1 time: 0.588337 Aug 24 02:02:19.194948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1932/2924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:18 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1306 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:19.200252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:19.201135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:19.207916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.208776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.209459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.210476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.211089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.211829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.535334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:19.539229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:19.553841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd505a8d-934e-43ee-91bb-5fef8bbc35f6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.357540 Aug 24 02:02:19.554997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1933/2925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:19 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:19.561740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369425a8-ad82-4f7d-96be-266689912a83", "tag": "a4715124-541c-4d5c-8596-108ce5262f71"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:19.589760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.593272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.593929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.612814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=28 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:19.621055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] Creating event network-changed:a4715124-541c-4d5c-8596-108ce5262f71 for instance 369425a8-ad82-4f7d-96be-266689912a83 on n-h1-854121-3 Aug 24 02:02:19.639369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2f2f5a8d-f5fc-4895-a109-2dfd187a6e1d req-f203b01a-2800-4c88-a245-e54d9f88bb32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082916 Aug 24 02:02:19.640049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1934/2926] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:19.650025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d7b0c59-2369-40a1-beb6-153fdb6b8348 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b911aa310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:19.667649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7b0c59-2369-40a1-beb6-153fdb6b8348 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.669643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7b0c59-2369-40a1-beb6-153fdb6b8348 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.670100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7b0c59-2369-40a1-beb6-153fdb6b8348 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.693850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d7b0c59-2369-40a1-beb6-153fdb6b8348 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 200 len: 61 microversion: 2.26 time: 0.052301 Aug 24 02:02:19.694578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1935/2927] 10.222.0.49 () {60 vars in 1292 bytes} [Wed Aug 24 02:02:19 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 61 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:19.703969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fa83f6-b757-4b07-8b05-ea129fa44e33", "tag": "68b7eb3f-bc70-4f23-bb03-70e106066712"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:19.727222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.730209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.733390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.761953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] Creating event network-changed:68b7eb3f-bc70-4f23-bb03-70e106066712 for instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 on n-h2-854121-3 Aug 24 02:02:19.777185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e7228437-2399-4dfa-99fd-37c9164d7958 req-dcd996da-7890-438a-a0e9-99a704f789e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081285 Aug 24 02:02:19.778089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1936/2928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:19.787755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:19.793046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:19.808314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.811846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.812378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:19.815137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:19.815787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:19.820090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.122898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:20.155459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ff2146a-c602-49c2-8108-464a6f5ef74f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.375921 Aug 24 02:02:20.159713 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1937/2929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:19 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:20.166052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:20.166935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:20.183427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.183930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.184376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.185222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.185680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.186108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.809642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:20.819175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf427bd7-e89a-4da0-9264-49d0185da0a9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.657664 Aug 24 02:02:20.820324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1938/2930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:20 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:20.827467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '.version_select at 0x7f6b9118a670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:20.837155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.838151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.838742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.839371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:20.843550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:20.848193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.848676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.849129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.850012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.850760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.851570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.881709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.882185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.882622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.902010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lazy-loading 'flavor' on Instance uuid 48bff64d-094a-4d6b-aa13-d9b58e2bab5e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:20.921978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc7e4c7f-cc1c-4109-a9f0-045d4d476553 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags" status: 204 len: 0 microversion: 2.26 time: 0.098149 Aug 24 02:02:20.924067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1939/2931] 10.222.0.49 () {60 vars in 1295 bytes} [Wed Aug 24 02:02:20 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e/tags => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:02:20.934411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:20.935031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:20.945425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.946144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.946938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.947793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:20.948790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:20.949402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:20.954064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:21.263579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:21.274211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b1cab2f-a8df-46a9-a35c-c397586ae4af tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1306 microversion: 2.1 time: 0.348799 Aug 24 02:02:21.275166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1940/2932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:20 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1306 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:21.287871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:21.287871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:21.296999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.297972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.298930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:21.299671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.303925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.304387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:21.578073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:21.587133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e803635-9a93-4824-ad2a-d77d62a52617 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.310879 Aug 24 02:02:21.591132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1941/2933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:21 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:21.605099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:21.605498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:21.612412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.613227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.613887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:21.614746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.615323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.615927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:21.648230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:02:21.735255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06a384be-bba8-48c4-b73b-9a29a45f0733 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 204 len: 0 microversion: 2.26 time: 0.142644 Aug 24 02:02:21.738262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1942/2934] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:02:21 2022] DELETE /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:02:21.746774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:21.747621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:21.754889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.755505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.756146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:21.756979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:21.757575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:21.758215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.136907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:22.153997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e09b414-b6a6-465a-b7b5-d5977b203375 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.414246 Aug 24 02:02:22.154591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1943/2935] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:21 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:22.170616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bafdd99-5270-46df-a71e-4111d9f847ae", "tag": "1a6683d5-bd36-49ca-8687-a71c33882b63"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:22.199164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.199641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.200073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.211619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] Creating event network-changed:1a6683d5-bd36-49ca-8687-a71c33882b63 for instance 5bafdd99-5270-46df-a71e-4111d9f847ae on n-h1-854121-3 Aug 24 02:02:22.227491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-40ab0b6d-76a4-422c-b341-74cc69bf84ee req-52f16b59-02b9-403b-8766-cb10ce63d7b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071429 Aug 24 02:02:22.228334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1944/2936] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:22.235909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:22.236858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:22.245410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.246133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.246731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.247610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.248220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.253787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.556967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:22.567785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:22.569846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:22.571138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08a7c947-c508-4546-96df-c0324bb96a82 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1551 microversion: 2.26 time: 0.341643 Aug 24 02:02:22.571775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1945/2937] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:22 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1551 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:02:22.577138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce129711-415a-481a-b5e1-7bb5c6643766", "tag": "33b4ee25-9857-4059-97c3-9b2e9843c89f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:22.587711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.588433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.589081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.604763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] Creating event network-changed:33b4ee25-9857-4059-97c3-9b2e9843c89f for instance ce129711-415a-481a-b5e1-7bb5c6643766 on n-h2-854121-3 Aug 24 02:02:22.612042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-82eae797-f9b9-4003-b645-e6cbee214712 req-06e54391-4440-4aa3-ae5f-f989b45134f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038885 Aug 24 02:02:22.615077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1946/2938] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:22.621086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:22.622211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:22.630575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.631059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.631562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:22.632272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:22.632855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:22.633448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:23.035487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:23.049943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55c0a8e7-75e5-4cb0-b5b4-85986621159b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.432914 Aug 24 02:02:23.059135 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1947/2939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:22 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:23.075048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:23.075911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:23.088986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:23.089750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:23.090356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:23.091237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:23.091856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:23.092455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:23.366884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:23.386666 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3051f5b0-d885-4bdb-9598-d2ae99fcf2d6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1306 microversion: 2.1 time: 0.323674 Aug 24 02:02:23.388231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1948/2940] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:23 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1306 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:23.395160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:23.396215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:23.409550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:23.410441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:23.411157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:23.413588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:23.414666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:23.415514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:23.682494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:23.690623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80e024a6-c90d-4949-b9ef-dc24b5a221c9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.300983 Aug 24 02:02:23.704888 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1949/2941] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:23 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:23.944262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3a2dfe2-1f72-4f35-a4e5-798460a9eaa3 tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Calling method '.version_select at 0x7f6b9118a670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:24.051740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3a2dfe2-1f72-4f35-a4e5-798460a9eaa3 tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] 10.222.0.49 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.345454 Aug 24 02:02:24.052326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1950/2942] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:02:23 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:02:24.066285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:24.067094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:24.075033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:24.075694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:24.076294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:24.077527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:24.078214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:24.078784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:24.397821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:24.406867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f00333f4-f253-4871-b375-efa1dd6d1658 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.344537 Aug 24 02:02:24.408014 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1951/2943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:24 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:24.412629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:24.413444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:24.423944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:24.424684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:24.425367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:24.426235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:24.426933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:24.432010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:24.930567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:24.939643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:24.949184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:24.950585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09f1ad23-5280-4809-9d3a-95ef7b844e9a tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1551 microversion: 2.26 time: 0.541483 Aug 24 02:02:24.951178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1952/2944] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:24 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1551 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:02:24.956371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c01bfb3-1c6a-401f-8ce8-6def5cc25e0a tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Action: 'create', calling method: .version_select at 0x7f6b910d2670>, body: {"pool": "non_exist_pool"} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:25.056937 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4c01bfb3-1c6a-401f-8ce8-6def5cc25e0a tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] HTTP exception thrown: Floating IP pool not found. Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c01bfb3-1c6a-401f-8ce8-6def5cc25e0a tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Request method failure captured: Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 26 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaufAAQz4_8mU_79nJAaDYDiLC1jYgbsajwzm4qJqdz0mu2fUVJAvSWyxDL2mC8esi5eJRi-IEkDiGwXlPMIHJ8UQgZwHOnwU05psHC2N5LHBr4MBm-vXZh8JtVbL-a1IhyaMjyUDNiXNmd65WovqjhW4kXjSbmC3Kc2Z_ny2tC1KU Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f4876880e064b25a0d7daaaa45c5d73 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f4876880e064b25a0d7daaaa45c5d73 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsNegativeTestJSON-1105116128-project Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a17e0d45098741a7b1d360bbc787a5c9 Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1105116128-project Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: {"pool": "non_exist_pool"} Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: exception: Floating IP pool not found. Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:25.061538 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:25.070461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 24 02:02:25.070461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:25.072607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c01bfb3-1c6a-401f-8ce8-6def5cc25e0a tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Returning 404 to user: Floating IP pool not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:25.073755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c01bfb3-1c6a-401f-8ce8-6def5cc25e0a tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.121388 Aug 24 02:02:25.074346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1953/2945] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 02:02:24 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:25.083602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:25.084534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:25.091951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.092751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.093420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.094328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.095008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.095625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.503247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:25.519822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e01db05-294e-4f83-9fed-4b6c6d319306 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.437800 Aug 24 02:02:25.521605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1954/2946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:25 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:25.526822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fa83f6-b757-4b07-8b05-ea129fa44e33", "name": "network-vif-plugged", "status": "completed", "tag": "68b7eb3f-bc70-4f23-bb03-70e106066712"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:25.540864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.541796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.542459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.560010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] Creating event network-vif-plugged:68b7eb3f-bc70-4f23-bb03-70e106066712 for instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 on n-h2-854121-3 Aug 24 02:02:25.567848 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fbaf88f4-e874-4431-bfdd-931b796a8ae0 req-931cbc9e-c946-4180-9cd6-9eef167cf42f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044627 Aug 24 02:02:25.569613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1955/2947] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:25.576639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:25.577715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:25.585772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.586633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.587345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.588287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.588990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.589630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.879365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:25.899065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46195ea8-89f6-47e8-b5b6-f7843d2fd402 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1306 microversion: 2.1 time: 0.326667 Aug 24 02:02:25.903643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1956/2948] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:25 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1306 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:25.924814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:25.927816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:25.948039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.951857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.952354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:25.953199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:25.953666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:25.956193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.149285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:26.161904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e2dffd0-de04-44ec-849d-4638df6d2420 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.255826 Aug 24 02:02:26.163555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1957/2949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:25 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:26.171856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Calling method '.version_select at 0x7f6b9110d9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:26.246789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ee04bd22-89b2-446d-8211-1b1673474a94 could not be found", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:26.247480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] HTTP exception thrown: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Request method failure captured: Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-floating-ips/ee04bd22-89b2-446d-8211-1b1673474a94 HTTP/1.1 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaufAAQz4_8mU_79nJAaDYDiLC1jYgbsajwzm4qJqdz0mu2fUVJAvSWyxDL2mC8esi5eJRi-IEkDiGwXlPMIHJ8UQgZwHOnwU05psHC2N5LHBr4MBm-vXZh8JtVbL-a1IhyaMjyUDNiXNmd65WovqjhW4kXjSbmC3Kc2Z_ny2tC1KU Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 4f4876880e064b25a0d7daaaa45c5d73 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4f4876880e064b25a0d7daaaa45c5d73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 4f4876880e064b25a0d7daaaa45c5d73 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1105116128 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-FloatingIPsNegativeTestJSON-1105116128-project Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: a17e0d45098741a7b1d360bbc787a5c9 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1105116128-project Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: exception: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ee04bd22-89b2-446d-8211-1b1673474a94'} Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ee04bd22-89b2-446d-8211-1b1673474a94 could not be found Aug 24 02:02:26.249775 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0f54f89-a829-48ff-a30c-0252a2fa2790'] Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94. Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94 Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94 Aug 24 02:02:26.255333 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.262143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] Returning 404 to user: Floating IP not found for ID ee04bd22-89b2-446d-8211-1b1673474a94 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:26.262143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1405a40-aa0b-4540-84d4-934097afe8fa tempest-FloatingIPsNegativeTestJSON-1105116128 tempest-FloatingIPsNegativeTestJSON-1105116128-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/ee04bd22-89b2-446d-8211-1b1673474a94" status: 404 len: 111 microversion: 2.1 time: 0.096129 Aug 24 02:02:26.263344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1958/2950] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:02:26 2022] DELETE /compute/v2.1/os-floating-ips/ee04bd22-89b2-446d-8211-1b1673474a94 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:26.270566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:26.271276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:26.288683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.289997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.291183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.293270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.294110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.294731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.319612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] HTTP exception thrown: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Request method failure captured: Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 HTTP/1.1 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUpcBrY5V1eznzAiaXBRm4595U3kNtfRONpMq7oGw3khLzHixy9Bz-i172LpWLRr3dGQOtrHG1jrlTlUqZNu7thrmCdLHFr0qVCgtyHnDJ-Jju4cdKR-xMw30YbMvuEhM4olrTPu6Q9mQtcILNkzRiYFMDcZE5pzlovLcUrZyNI3S4 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 12bf7164fa554f238b90c30e30484c80 Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '74120617-cff6-452e-9a5e-002f53d6f300'} Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:26.323128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.330030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.331795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Returning 404 to user: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:26.332871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed690e86-a2a5-4f8a-bbd8-b85211faf286 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "DELETE /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 404 len: 111 microversion: 2.32 time: 0.068314 Aug 24 02:02:26.337875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1959/2951] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:02:26 2022] DELETE /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:02:26.346728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:26.347591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:26.354171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.354896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.355491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.356371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.357094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.357703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.586317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:26.589451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:26.609422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4e5f56e-23e1-4640-ac3c-e65a0a025459 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.266188 Aug 24 02:02:26.610829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1960/2952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:26 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:26.627390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:26.644957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:26.653535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.655019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.655979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.659090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.659919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.663073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.800688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:26.850582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:26.860821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edf66724aeed42189554c9bf5fd9706c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18cfc37471d34f68b68430053fc2490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:26.863002 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aacd2ce1-c489-47b7-aba6-4462c2b7e409 tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 200 len: 1509 microversion: 2.26 time: 0.250800 Aug 24 02:02:26.864229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1961/2953] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:26 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:02:26.883213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:26.884341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] [instance: 74120617-cff6-452e-9a5e-002f53d6f300] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:26.894374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.895571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.896380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.899071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:26.899761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:26.900399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:26.928856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] HTTP exception thrown: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Request method failure captured: Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 HTTP/1.1 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUpcBrY5V1eznzAiaXBRm4595U3kNtfRONpMq7oGw3khLzHixy9Bz-i172LpWLRr3dGQOtrHG1jrlTlUqZNu7thrmCdLHFr0qVCgtyHnDJ-Jju4cdKR-xMw30YbMvuEhM4olrTPu6Q9mQtcILNkzRiYFMDcZE5pzlovLcUrZyNI3S4 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.32 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_11b9c09fe62f48a493380c77be9a6de9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 11b9c09fe62f48a493380c77be9a6de9 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1979802056 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 12bf7164fa554f238b90c30e30484c80 Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest-1979802056-project Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '74120617-cff6-452e-9a5e-002f53d6f300'} Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.930816 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. Aug 24 02:02:26.936972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:26.939364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] Returning 404 to user: Instance 74120617-cff6-452e-9a5e-002f53d6f300 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:26.941498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40f8ae8b-5f8b-427b-bf46-366e69cbeb96 tempest-TaggedBootDevicesTest-1979802056 tempest-TaggedBootDevicesTest-1979802056-project] 10.222.0.49 "GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300" status: 404 len: 111 microversion: 2.32 time: 0.074999 Aug 24 02:02:26.943324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1962/2954] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:26 2022] GET /compute/v2.1/servers/74120617-cff6-452e-9a5e-002f53d6f300 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:02:26.976908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bff64d-094a-4d6b-aa13-d9b58e2bab5e", "name": "network-vif-deleted", "tag": "43489ce2-7cc8-47a6-9740-c6086cb2e3e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:27.001144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:27.001693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:27.002130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:27.032664 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] Creating event network-vif-deleted:43489ce2-7cc8-47a6-9740-c6086cb2e3e3 for instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e on n-h2-854121-3 Aug 24 02:02:27.067292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-aa4d509a-f239-4b4b-86df-110c14005270 req-fe22c0db-34ee-4cfe-8a3d-b4cfe8aeea9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122335 Aug 24 02:02:27.067907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1963/2955] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:27.123365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:27.124102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:27.144247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:27.151249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:27.152138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:27.153638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:27.154287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:27.157727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:28.047274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:28.057130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45b7a9a7-f682-4778-9af7-715fca99e89d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.987115 Aug 24 02:02:28.073479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1964/2956] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:27 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:28.085912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:28.086535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:28.103143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:28.103667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:28.105599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:28.108269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:28.109188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:28.112019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:28.632064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:28.640296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2af87703-0f44-4cb8-b07c-55e04ac6cdac tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1486 microversion: 2.1 time: 0.563432 Aug 24 02:02:28.655457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1965/2957] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:28 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1486 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:28.655457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:28.655457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:28.668264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:28.668827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:28.669272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:28.669990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:28.670446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:28.671116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:28.963945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:28.973456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffc2a27e-84a9-4915-bb27-062367c68f2f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.324895 Aug 24 02:02:28.974053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1966/2958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:28 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:28.978774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:28.987601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:29.004913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.005408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.005846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.006558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.007013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.007459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.306330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:29.315722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f8da1fe-c682-486f-9b5c-4ebdc642b460 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.340527 Aug 24 02:02:29.335684 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1967/2959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:28 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:29.343352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:29.344506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] [instance: 48bff64d-094a-4d6b-aa13-d9b58e2bab5e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:29.361267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.363186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.365035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.366049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.367819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.368503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.396135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] HTTP exception thrown: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Request method failure captured: Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e HTTP/1.1 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZbsHyozyvY64izBB6G6UDXh7DfUocCajiI08HAJoZxbt-VO2F1kmwf5l_r_DSIfXBCkz_NmUehKlZ7OqztmriWarxK7bqY_8XzqLyZv-CdthJDgzgmkZmgHzszyMYKeuBOvcAm05vMvDJlm_tcy0tvrumj1n4kxVuq7bsyDhS7WWM Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.26 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 18cfc37471d34f68b68430053fc2490a Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerTagsTestJSON-2126117404 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/18cfc37471d34f68b68430053fc2490a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/18cfc37471d34f68b68430053fc2490a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/18cfc37471d34f68b68430053fc2490a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_18cfc37471d34f68b68430053fc2490a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerTagsTestJSON-2126117404 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 18cfc37471d34f68b68430053fc2490a Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerTagsTestJSON-2126117404 Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerTagsTestJSON-2126117404-project Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edf66724aeed42189554c9bf5fd9706c Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerTagsTestJSON-2126117404-project Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '48bff64d-094a-4d6b-aa13-d9b58e2bab5e'} Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:29.398139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. Aug 24 02:02:29.402707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:29.404629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] Returning 404 to user: Instance 48bff64d-094a-4d6b-aa13-d9b58e2bab5e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:29.405891 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e46b0207-3780-4417-97a5-b1279bbdf9be tempest-ServerTagsTestJSON-2126117404 tempest-ServerTagsTestJSON-2126117404-project] 10.222.0.49 "GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e" status: 404 len: 111 microversion: 2.26 time: 0.069210 Aug 24 02:02:29.408373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1968/2960] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:02:29 2022] GET /compute/v2.1/servers/48bff64d-094a-4d6b-aa13-d9b58e2bab5e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:02:29.415946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce129711-415a-481a-b5e1-7bb5c6643766", "name": "network-vif-plugged", "status": "completed", "tag": "33b4ee25-9857-4059-97c3-9b2e9843c89f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:29.435723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.437601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.438876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.459143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] Creating event network-vif-plugged:33b4ee25-9857-4059-97c3-9b2e9843c89f for instance ce129711-415a-481a-b5e1-7bb5c6643766 on n-h2-854121-3 Aug 24 02:02:29.466538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8cdcaafa-b47f-4e7d-b1d0-7ced7834313b req-c04ff753-392c-4a82-907e-8f1bb8a2b105 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055289 Aug 24 02:02:29.467287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1969/2961] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:29.475186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:29.483579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.486399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.487128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.518971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:02:29.683482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b38ae41-07c5-4ddc-ae42-7cb13b70034b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33/action" status: 202 len: 0 microversion: 2.1 time: 0.214300 Aug 24 02:02:29.693301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1970/2962] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:02:29 2022] POST /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:29.711405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:29.712188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:29.721125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.721630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.722071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:29.722903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:29.723365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:29.724175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:30.067206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:30.101620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1180f998-de25-4b1e-a0be-92c58f4d2a8d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.406923 Aug 24 02:02:30.117247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1971/2963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:29 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:30.128556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:30.129555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:30.137400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:30.138210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:30.138559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:30.139352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:30.140164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:30.141262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:30.565773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:30.582120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab4e0896-5e09-46a4-bd81-f1a6735441b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.463564 Aug 24 02:02:30.583068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1972/2964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:30 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:30.592175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:30.593194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:30.613466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:30.614116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:30.614660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:30.615607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:30.616463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:30.617255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:31.010550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:31.021486 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c78f3176-49ea-48aa-b0f3-acf16ceadf03 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1315 microversion: 2.1 time: 0.437116 Aug 24 02:02:31.025033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1973/2965] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:30 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:31.030525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:31.033486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:31.047436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:31.053552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:31.054110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:31.054955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:31.055517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:31.056056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:32.090039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:32.098606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a03aba5e-5bd6-4f5d-a70f-a3d04cf8ff1a tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 1.071661 Aug 24 02:02:32.101360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1974/2966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:31 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:32.115282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:32.121307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:32.144481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:32.149208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:32.149840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:32.150680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:32.151227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:32.151732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:32.937316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:32.954208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a109736-1de8-4881-9891-35717fe3ba98 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.846840 Aug 24 02:02:32.954887 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1975/2967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:32 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:32.975638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:32.977374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:32.996496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:32.997367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:32.998050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:33.001044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:33.001805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:33.002450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:33.564735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:33.576527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c373364-1ebd-4c02-b338-e8f28399b1b6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.605750 Aug 24 02:02:33.577158 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1976/2968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:32 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:33.616234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369425a8-ad82-4f7d-96be-266689912a83", "name": "network-vif-plugged", "status": "completed", "tag": "a4715124-541c-4d5c-8596-108ce5262f71"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:33.643621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:33.644037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:33.644476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:33.669251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] Creating event network-vif-plugged:a4715124-541c-4d5c-8596-108ce5262f71 for instance 369425a8-ad82-4f7d-96be-266689912a83 on n-h1-854121-3 Aug 24 02:02:33.681943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9f4ccf86-9697-429b-b5a3-131c5041f929 req-951e02c6-e459-4723-8a5f-3e4bdb49a34b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079399 Aug 24 02:02:33.682561 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1977/2969] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:33.694321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:33.698202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:33.710130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:33.721187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:33.721918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:33.722826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:33.723455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:33.724049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:34.374673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:34.386018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4cdec86-eb5b-4a20-91c2-94eb6836266e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1502 microversion: 2.1 time: 0.695110 Aug 24 02:02:34.387007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1978/2970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:33 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1502 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:34.398976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:34.402970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:34.414438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:34.416791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:34.419372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:34.421507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:34.422123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:34.428405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:35.019940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:35.024661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:35.037500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-436cd680-ca34-41ed-a449-5416f96beda1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1370 microversion: 2.1 time: 0.649228 Aug 24 02:02:35.046313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1979/2971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:34 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1370 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:35.103139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:35.109745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:35.153431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:35.154121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:35.155941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:35.157718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:35.159331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:35.162220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:35.499895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:35.509321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-355588f6-7d42-473a-b29a-d9f927b608d7 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.461810 Aug 24 02:02:35.526445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1980/2972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:35 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:35.534638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-244225813"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:35.538767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:35.554641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:35.555403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:35.557710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:35.559276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:35.560681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:35.561974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:36.263952 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Adding security group 28a6252e-927d-4dec-babc-3f850466a2e5 to port 33b4ee25-9857-4059-97c3-9b2e9843c89f Aug 24 02:02:37.167476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6ff67bc-7872-47cd-8cb7-9b0b6adb85d5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/action" status: 202 len: 0 microversion: 2.1 time: 1.639609 Aug 24 02:02:37.168163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1981/2973] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:02:35 2022] POST /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/action => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:37.175411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:37.176352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:37.194294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:37.195250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:37.196074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:37.197942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:37.199782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:37.200516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:38.396595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:38.414058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-772b56a5-a2d9-4e2a-9bb7-69ddef905c12 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 1.240531 Aug 24 02:02:38.416073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1982/2974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:37 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:38.449086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bafdd99-5270-46df-a71e-4111d9f847ae", "name": "network-vif-plugged", "status": "completed", "tag": "1a6683d5-bd36-49ca-8687-a71c33882b63"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:38.467963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:38.468799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:38.472108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:38.508056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] Creating event network-vif-plugged:1a6683d5-bd36-49ca-8687-a71c33882b63 for instance 5bafdd99-5270-46df-a71e-4111d9f847ae on n-h1-854121-3 Aug 24 02:02:38.518288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a8b88654-ae7e-47c1-859a-0caa3bb76d7e req-5cf04629-27aa-4874-bef4-df47765f8d18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084582 Aug 24 02:02:38.523610 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1983/2975] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:38.537299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:38.538737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:38.553021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:38.556145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:38.558507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:38.561257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:38.563536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:38.565249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:39.089035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:39.100572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30a243ee-f89c-4bda-927d-7cdf53534801 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1556 microversion: 2.1 time: 0.570349 Aug 24 02:02:39.116866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1984/2976] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:38 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1556 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:39.127908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:39.131082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:39.146060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:39.147972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:39.149391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:39.153065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:39.154425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:39.155599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:39.533769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:39.544953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ed48305-5c4a-49f7-85e5-ccaef41db264 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1314 microversion: 2.1 time: 0.426831 Aug 24 02:02:39.545550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1985/2977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:39 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:39.564742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-939184526"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:39.565573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:39.572588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:39.573338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:39.575735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:39.577786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:39.578454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:39.580116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:39.767278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Adding security group 8239d7dd-d435-4670-91ec-da3bee223e2d to port 33b4ee25-9857-4059-97c3-9b2e9843c89f Aug 24 02:02:40.290555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54beb053-ba11-4292-a7bd-75af0e609e18 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/action" status: 202 len: 0 microversion: 2.1 time: 0.730237 Aug 24 02:02:40.291182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1986/2978] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:02:39 2022] POST /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:40.295880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce129711-415a-481a-b5e1-7bb5c6643766", "tag": "33b4ee25-9857-4059-97c3-9b2e9843c89f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:40.310409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:40.310893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:40.311330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:40.324011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Creating event network-changed:33b4ee25-9857-4059-97c3-9b2e9843c89f for instance ce129711-415a-481a-b5e1-7bb5c6643766 on n-h2-854121-3 Aug 24 02:02:40.329756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036857 Aug 24 02:02:40.334567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1987/2979] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:40.336552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:40.338244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77e645a0-47cd-4265-a9ef-d9691e232da1 req-1a011a14-7f80-4a09-b9d8-40dc95ca00bd service nova] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002198 Aug 24 02:02:40.339202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1988/2980] 10.222.0.49 () {56 vars in 886 bytes} [Wed Aug 24 02:02:40 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 02:02:40.384166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:40.388362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:40.402956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:40.405853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:40.406345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:40.410578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:40.411311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:40.411939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:40.709144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8fa5c7ce-5c0d-41ca-943c-8558d55dd7df tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.368621 Aug 24 02:02:40.710709 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1989/2981] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:02:40 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-interface => generated 285 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:40.715985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:40.716933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:40.731627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:40.733485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:40.734298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:40.734984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:40.736741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:40.737560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:40.738219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:41.684591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:41.701472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f559dab-1597-4900-a886-3a77eb19fefb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.989312 Aug 24 02:02:41.717840 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1990/2982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:40 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:41.926425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63f756ea-17ff-4673-a380-281fcd9e7432 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Calling method '.version_select at 0x7f6b9109cdc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:41.970928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-63f756ea-17ff-4673-a380-281fcd9e7432 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63f756ea-17ff-4673-a380-281fcd9e7432 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/01e48d8d-9555-4df3-87c7-0a66fa88b338/metadata/os_distro HTTP/1.1 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': '01e48d8d-9555-4df3-87c7-0a66fa88b338', 'id': 'os_distro'} Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 01e48d8d-9555-4df3-87c7-0a66fa88b338 Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:41.977250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 01e48d8d-9555-4df3-87c7-0a66fa88b338 could not be found. Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63f756ea-17ff-4673-a380-281fcd9e7432 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63f756ea-17ff-4673-a380-281fcd9e7432 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "DELETE /compute/v2.1/images/01e48d8d-9555-4df3-87c7-0a66fa88b338/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.259699 Aug 24 02:02:41.983380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1991/2983] 10.222.0.49 () {58 vars in 1293 bytes} [Wed Aug 24 02:02:41 2022] DELETE /compute/v2.1/images/01e48d8d-9555-4df3-87c7-0a66fa88b338/metadata/os_distro => generated 62 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:41.992139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:41.992139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:41.998383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:41.998936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:41.999390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:42.000113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:42.001129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:42.001757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:42.640586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43f85cfe-233e-4af6-8f06-5a0db352c5c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.658648 Aug 24 02:02:42.641558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1992/2984] 10.222.0.49 () {58 vars in 1293 bytes} [Wed Aug 24 02:02:41 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766/os-security-groups => generated 1157 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:42.646049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:42.646670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:42.658845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:42.659352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:42.659784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:42.660500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:42.660981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:42.661407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:44.158581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:44.177383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c824ffc-1479-4606-af73-bb8970f09210 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1501 microversion: 2.1 time: 1.526957 Aug 24 02:02:44.180378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1993/2985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:42 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1501 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:44.185385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ae5cb26-df6c-4fbb-9923-304fbe982212 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Calling method '.version_select at 0x7f6b910d9550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:44.228994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9ae5cb26-df6c-4fbb-9923-304fbe982212 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ae5cb26-df6c-4fbb-9923-304fbe982212 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/images/da54b24e-2696-4aa1-abe2-c3609d5584db/metadata/os_version HTTP/1.1 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': 'da54b24e-2696-4aa1-abe2-c3609d5584db', 'id': 'os_version'} Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da54b24e-2696-4aa1-abe2-c3609d5584db Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:44.231436 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da54b24e-2696-4aa1-abe2-c3609d5584db could not be found. Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ae5cb26-df6c-4fbb-9923-304fbe982212 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:44.237151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ae5cb26-df6c-4fbb-9923-304fbe982212 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "GET /compute/v2.1/images/da54b24e-2696-4aa1-abe2-c3609d5584db/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051320 Aug 24 02:02:44.240763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1994/2986] 10.222.0.49 () {58 vars in 1293 bytes} [Wed Aug 24 02:02:44 2022] GET /compute/v2.1/images/da54b24e-2696-4aa1-abe2-c3609d5584db/metadata/os_version => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:44.246581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce129711-415a-481a-b5e1-7bb5c6643766", "tag": "33b4ee25-9857-4059-97c3-9b2e9843c89f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:44.288278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:44.288860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:44.289479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:44.304922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] Creating event network-changed:33b4ee25-9857-4059-97c3-9b2e9843c89f for instance ce129711-415a-481a-b5e1-7bb5c6643766 on n-h2-854121-3 Aug 24 02:02:44.312669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b939e95f-03af-47b9-a109-051e135b1b36 req-c214df16-18c8-41d0-9a55-a78e44319088 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073591 Aug 24 02:02:44.314554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1995/2987] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:44.337749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91527463-5ad0-4746-bb26-67321c418ab2 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b910d9040>, body: {"security_group": {"name": " tempest-securitygroup -1999368208 ", "description": "tempest-description-941246242"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:44.913879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91527463-5ad0-4746-bb26-67321c418ab2 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.593306 Aug 24 02:02:44.921529 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1996/2988] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:44 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:44.921529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:44.921529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:44.946064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:44.947706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:44.948329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:44.950928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:44.954645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:44.956912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:45.208337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:45.218920 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e539c2b4-c85d-4e0e-8744-a222f7cd3f03 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.302825 Aug 24 02:02:45.226882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1997/2989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:44 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:45.232015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:45.232550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:45.247425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:45.247920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:45.248421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:45.249285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:45.252218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:45.252692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:45.296622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lazy-loading 'flavor' on Instance uuid 5bafdd99-5270-46df-a71e-4111d9f847ae {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:02:45.402838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70897001-6a37-407a-9e99-fc097a50940e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "POST /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae/action" status: 202 len: 0 microversion: 2.1 time: 0.173367 Aug 24 02:02:45.406743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1998/2990] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:02:45 2022] POST /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:45.416752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42d8d111-8906-4354-9347-efb83c940c76 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Calling method '.version_select at 0x7f6b9118a0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:45.465995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-42d8d111-8906-4354-9347-efb83c940c76 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42d8d111-8906-4354-9347-efb83c940c76 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/images/4a81b21d-d94b-48fe-ac3a-21bd6af63db2/metadata HTTP/1.1 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': '4a81b21d-d94b-48fe-ac3a-21bd6af63db2'} Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4a81b21d-d94b-48fe-ac3a-21bd6af63db2 Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:45.468192 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a81b21d-d94b-48fe-ac3a-21bd6af63db2 could not be found. Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42d8d111-8906-4354-9347-efb83c940c76 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-42d8d111-8906-4354-9347-efb83c940c76 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "GET /compute/v2.1/images/4a81b21d-d94b-48fe-ac3a-21bd6af63db2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062212 Aug 24 02:02:45.472474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 1999/2991] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 02:02:45 2022] GET /compute/v2.1/images/4a81b21d-d94b-48fe-ac3a-21bd6af63db2/metadata => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:45.475308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b83b8bf6-4d9e-4a17-a30b-fdb700373133 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911aa550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:45.567880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b83b8bf6-4d9e-4a17-a30b-fdb700373133 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d" status: 200 len: 223 microversion: 2.1 time: 0.096583 Aug 24 02:02:45.569231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2000/2992] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:02:45 2022] GET /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d => generated 223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:45.580345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:45.581132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:45.614877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:45.615597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:45.616215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:45.617597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:45.619333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:45.620823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:45.984762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:46.002223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcbf646c-00e2-4a7c-92e0-4f0a6381c84a tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1509 microversion: 2.1 time: 0.432556 Aug 24 02:02:46.003489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2001/2993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:45 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1509 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:46.014940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f303074-034c-42b1-b707-781f331fa161 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Action: 'update_all', calling method: .version_select at 0x7f6b9109dc10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:46.054568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4f303074-034c-42b1-b707-781f331fa161 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f303074-034c-42b1-b707-781f331fa161 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/images/3f0d9402-5c94-46d7-84f7-440e57ceb423/metadata HTTP/1.1 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 57 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': '3f0d9402-5c94-46d7-84f7-440e57ceb423', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3f0d9402-5c94-46d7-84f7-440e57ceb423 Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:46.057851 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3f0d9402-5c94-46d7-84f7-440e57ceb423 could not be found. Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f303074-034c-42b1-b707-781f331fa161 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f303074-034c-42b1-b707-781f331fa161 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "PUT /compute/v2.1/images/3f0d9402-5c94-46d7-84f7-440e57ceb423/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055510 Aug 24 02:02:46.062520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2002/2994] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:02:46 2022] PUT /compute/v2.1/images/3f0d9402-5c94-46d7-84f7-440e57ceb423/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:46.067771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45c64a4f-18df-471c-b888-7fe8cb0104cf tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9118ac10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:46.683768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45c64a4f-18df-471c-b888-7fe8cb0104cf tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d" status: 202 len: 0 microversion: 2.1 time: 0.621521 Aug 24 02:02:46.684811 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2003/2995] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:02:46 2022] DELETE /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:46.690461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6843943b-8c6e-4a6b-847f-c9731711d513 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Action: 'update', calling method: .version_select at 0x7f6b9118a790>, body: {"meta": {"os_distro": "alt"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:46.728956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6843943b-8c6e-4a6b-847f-c9731711d513 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6843943b-8c6e-4a6b-847f-c9731711d513 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/images/d8f39b8d-2975-46c4-b9c4-086ad295e77a/metadata/os_distro HTTP/1.1 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 30 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: {"meta": {"os_distro": "alt"}} Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': 'd8f39b8d-2975-46c4-b9c4-086ad295e77a', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8f39b8d-2975-46c4-b9c4-086ad295e77a Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:46.742220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8f39b8d-2975-46c4-b9c4-086ad295e77a could not be found. Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:46.746187 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:46.752569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6843943b-8c6e-4a6b-847f-c9731711d513 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:46.753155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6843943b-8c6e-4a6b-847f-c9731711d513 tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "PUT /compute/v2.1/images/d8f39b8d-2975-46c4-b9c4-086ad295e77a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.066895 Aug 24 02:02:46.761235 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2004/2996] 10.222.0.49 () {60 vars in 1310 bytes} [Wed Aug 24 02:02:46 2022] PUT /compute/v2.1/images/d8f39b8d-2975-46c4-b9c4-086ad295e77a/metadata/os_distro => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:46.775896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:46.776896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:46.822263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:46.830349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:46.830887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:46.831922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:46.832404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:46.832864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:47.207065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:47.223449 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32ca182d-cfe7-4dc1-bf59-eaa23ac81280 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.461072 Aug 24 02:02:47.224480 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2005/2997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:46 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:47.230367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369425a8-ad82-4f7d-96be-266689912a83", "tag": "a4715124-541c-4d5c-8596-108ce5262f71"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:47.243950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:47.244865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:47.245552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:47.262805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] Creating event network-changed:a4715124-541c-4d5c-8596-108ce5262f71 for instance 369425a8-ad82-4f7d-96be-266689912a83 on n-h1-854121-3 Aug 24 02:02:47.268757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-14d39de4-31b4-40d8-9e28-6d543a2f3ecf req-adae1c52-2274-4260-8c2e-5fd2ec5cb8bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042623 Aug 24 02:02:47.269604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2006/2998] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:47.275043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91086e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:47.306868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:47.307541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:02:47.308791 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.308791 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d HTTP/1.1 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a8456811-3c66-4eb4-a6b8-6b0b0455c35d'} Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:47.312772 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] Aug 24 02:02:47.317479 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.324162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:02:47.324162 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-54ccd633-0076-44ba-9f86-3eca6622f469'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:47.324162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80d9cf20-2ed0-474c-901a-8ccd9eb9a15a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d" status: 404 len: 194 microversion: 2.1 time: 0.051938 Aug 24 02:02:47.324162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2007/2999] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:02:47 2022] GET /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:47.330105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b535fd4-4a47-40e1-9400-39f82f3e127d tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Action: 'create', calling method: .version_select at 0x7f6b926bf790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:47.363737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9b535fd4-4a47-40e1-9400-39f82f3e127d tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] HTTP exception thrown: Image not found. Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b535fd4-4a47-40e1-9400-39f82f3e127d tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Request method failure captured: Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/images/a3042354-6e97-4285-b4b6-e35f0dff73a8/metadata HTTP/1.1 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 57 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYa_JVHRhc0Ec62nZndjnSxOqWO2MJV-gYxsPFSPSkO5SYN99HoqMTW59IzGGtALLpQibLXAq7zpB1ijmwjpqSJ_GG3hPut00bUNzN9fElyBjQpzWF9COxBb5ND3-iyvrwk16nmZgJ5-XEobW4z9tSlMjuNuN-8Z3kA62DDF-jiwkmA Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b1a8068ad60b4d348fc2552e8e8482a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b1a8068ad60b4d348fc2552e8e8482a7 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 88195d9bec0147b4a56755b3b5bbd34d Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1080320605-project Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'image_id': 'a3042354-6e97-4285-b4b6-e35f0dff73a8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a3042354-6e97-4285-b4b6-e35f0dff73a8 Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:02:47.366579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a3042354-6e97-4285-b4b6-e35f0dff73a8 could not be found. Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b535fd4-4a47-40e1-9400-39f82f3e127d tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b535fd4-4a47-40e1-9400-39f82f3e127d tempest-ImagesMetadataNegativeTestJSON-1080320605 tempest-ImagesMetadataNegativeTestJSON-1080320605-project] 10.222.0.49 "POST /compute/v2.1/images/a3042354-6e97-4285-b4b6-e35f0dff73a8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043121 Aug 24 02:02:47.370350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2008/3000] 10.222.0.49 () {60 vars in 1281 bytes} [Wed Aug 24 02:02:47 2022] POST /compute/v2.1/images/a3042354-6e97-4285-b4b6-e35f0dff73a8/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:02:47.375177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:47.375889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:47.391474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:47.392812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:47.393567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:47.394786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:47.395385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:47.395987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:47.737565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:47.740913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:02:47.749390 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15eb66b7-650e-423c-9813-0d96c5850f50 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1492 microversion: 2.1 time: 0.379743 Aug 24 02:02:47.749993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2009/3001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:47 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1492 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:47.771198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e26f7593-d598-424c-9f67-a6e5fd151b47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b9118a790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1455982041", "description": "tempest-description-558926018"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:48.195072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e26f7593-d598-424c-9f67-a6e5fd151b47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.428892 Aug 24 02:02:48.206767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2010/3002] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:47 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:48.212605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:48.213233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:48.225968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:48.226996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:48.227462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:48.228214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:48.228680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:48.229146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:48.289920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:02:48.392674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-524bc8ee-3eb6-421b-b27e-2c110abedbdd tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 204 len: 0 microversion: 2.1 time: 0.184211 Aug 24 02:02:48.393313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2011/3003] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:48 2022] DELETE /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:02:48.401867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cb27566-e1a3-4e8f-bbaf-8bb3574f7d68 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b91133af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2107296338", "description": "tempest-description-1366945823"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:48.604745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8cb27566-e1a3-4e8f-bbaf-8bb3574f7d68 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.209843 Aug 24 02:02:48.607593 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2012/3004] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:48.620258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:48.622082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:48.634134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:48.635122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:48.635911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:48.637319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:48.637778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:48.638631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:48.973873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:48.986715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59c6cc0f-a3f9-4764-ac12-b0c6200e8c0f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.371540 Aug 24 02:02:48.991232 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2013/3005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:48 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:49.007058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:49.007804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:49.021939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:49.022721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:49.024974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:49.028212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:49.032603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:49.033086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:50.029139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14c3e6fc474345239f16575d5b5439ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '005c578132f34fde8611eb817e0f0c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:50.046600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a27fa57c-6bf0-4cc4-8725-7983688f29b1 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 200 len: 1498 microversion: 2.1 time: 1.053658 Aug 24 02:02:50.047943 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2014/3006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:48 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 1498 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:50.082548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f902081-ffcc-4151-8b04-f62af93d51b0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b9109c310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-824831844", "description": "tempest-description-535378146"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:50.852528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f902081-ffcc-4151-8b04-f62af93d51b0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.797525 Aug 24 02:02:50.853826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2015/3007] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:02:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:51.240678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89bad9d3-2262-4aaa-82a2-e57fa3ec2f51 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: .version_select at 0x7f6b91086e50>, body: {"keypair": {"name": "tempest-keypair-632130994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1V/Sx7JLrAF2DZD5kxUIY4Px5GkqXAqAx9MDvIJ2HyezjuComB2Y3bLGWYMP4CBIZnp0Pj7ckC1vdB6DUR/hnzxdHfh9xCHVt/M0JiXPl0Y1msfyGFK8vvhmhir9X2Ig=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:51.277353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-89bad9d3-2262-4aaa-82a2-e57fa3ec2f51 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:51.288400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-89bad9d3-2262-4aaa-82a2-e57fa3ec2f51 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:51.355036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89bad9d3-2262-4aaa-82a2-e57fa3ec2f51 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.499206 Aug 24 02:02:51.356630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2016/3008] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:02:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:51.369878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:51.373431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:51.388772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:51.390123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:51.390569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:51.391332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:51.391777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:51.392204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:52.087074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:52.106563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ccf7884-a3d9-4c2f-b35a-7e7543c3a2bc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.747868 Aug 24 02:02:52.107472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2017/3009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:51 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:52.122039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bbbca15-94fa-4988-894c-250d53f8b6a7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9109c310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:52.930907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bbbca15-94fa-4988-894c-250d53f8b6a7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.821831 Aug 24 02:02:52.934356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2018/3010] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:02:52 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:52.942870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:52.946219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:52.965543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:52.966260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:52.966707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:52.968688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:52.971272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:52.972625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:53.019403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae HTTP/1.1 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5bafdd99-5270-46df-a71e-4111d9f847ae'} Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:53.021442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:53.026578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc27a05c-5259-4005-93fd-ef206b6d9752 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 404 len: 111 microversion: 2.1 time: 0.086909 Aug 24 02:02:53.037210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2019/3011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:52 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:53.042624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bafdd99-5270-46df-a71e-4111d9f847ae", "name": "network-vif-deleted", "tag": "1a6683d5-bd36-49ca-8687-a71c33882b63"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:53.068927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:53.069418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:53.069855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:53.100055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Creating event network-vif-deleted:1a6683d5-bd36-49ca-8687-a71c33882b63 for instance 5bafdd99-5270-46df-a71e-4111d9f847ae on n-h1-854121-3 Aug 24 02:02:53.106582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067791 Aug 24 02:02:53.107721 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2020/3012] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:02:53.109124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:53.112034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b717e2d4-464b-4f3c-99a4-5b4e86f496e0 req-00415887-cfbf-43af-ab44-3d01db4f4958 service nova] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003398 Aug 24 02:02:53.112661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2021/3013] 10.222.0.49 () {56 vars in 886 bytes} [Wed Aug 24 02:02:53 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 02:02:53.118374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-040b1e18-e7ba-45a2-ae29-1c256fda5e00 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9109cb80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:53.690145 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-040b1e18-e7ba-45a2-ae29-1c256fda5e00 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f" status: 202 len: 0 microversion: 2.1 time: 0.576149 Aug 24 02:02:53.694966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2022/3014] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:02:53 2022] DELETE /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:53.701431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:53.704951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:53.711425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:53.716235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:53.718149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:53.720441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:53.721408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:53.723495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:53.743585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae HTTP/1.1 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5bafdd99-5270-46df-a71e-4111d9f847ae'} Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:53.755384 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:53.759189 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:53.762291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:53.765489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9014a969-79cf-4bcb-931e-997e8fd493e9 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 404 len: 111 microversion: 2.1 time: 0.069150 Aug 24 02:02:53.768767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2023/3015] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:53 2022] DELETE /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:53.775991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:53.789740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:53.800789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:53.801702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:53.802379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:53.803316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:53.804005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:53.804744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.117278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:54.127677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80e81b04-32b7-47e5-9bc0-75edd17dd8ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1496 microversion: 2.1 time: 0.355405 Aug 24 02:02:54.128272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2024/3016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:53 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1496 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:54.145188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9109c3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.197064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:54.197683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group 4ffd9ac3-628d-490b-a572-5a144c68c45f not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:02:54.198218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.198218 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f HTTP/1.1 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4ffd9ac3-628d-490b-a572-5a144c68c45f'} Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:54.200330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8657f220-4528-466a-965b-25c52ab750ee'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d726c03-54e8-4422-a0f1-5e92f1d7b047 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f" status: 404 len: 194 microversion: 2.1 time: 0.072501 Aug 24 02:02:54.205211 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2025/3017] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:02:54 2022] GET /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:54.212305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.212449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 5bafdd99-5270-46df-a71e-4111d9f847ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:54.244421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.244421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.261047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.262088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.262490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.262943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.289770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae HTTP/1.1 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5bafdd99-5270-46df-a71e-4111d9f847ae'} Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.291348 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.295522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 5bafdd99-5270-46df-a71e-4111d9f847ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:54.315176 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62ea523d-93fa-4deb-a8af-03438ed1946d tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae" status: 404 len: 111 microversion: 2.1 time: 0.084711 Aug 24 02:02:54.317844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2026/3018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:54 2022] GET /compute/v2.1/servers/5bafdd99-5270-46df-a71e-4111d9f847ae => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:54.325597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a10bbe08-90f7-443e-a6c1-6ca99d4fe3cb tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b910860d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.751598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a10bbe08-90f7-443e-a6c1-6ca99d4fe3cb tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61" status: 202 len: 0 microversion: 2.1 time: 0.432542 Aug 24 02:02:54.752566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2027/3019] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:02:54 2022] DELETE /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:54.758118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.758841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:54.774235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.779312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.779842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.780595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.781092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.781519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.799469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 HTTP/1.1 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '43295b8b-050c-4eca-bada-135cbf527764'} Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:54.802029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.806486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.808213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:54.809809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f52a55f4-4057-4a50-ab18-702be967a67e tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 404 len: 111 microversion: 2.1 time: 0.055791 Aug 24 02:02:54.811166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2028/3020] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:54 2022] DELETE /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:54.817663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b910d9af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.889034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:54.890001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:02:54.891262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.891262 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61 HTTP/1.1 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f5040f7a-7429-46da-985a-a7a5ef3d7e61'} Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:54.894449 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] Aug 24 02:02:54.899158 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.905315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:02:54.905315 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8bc440b3-6c09-495f-a759-bab2d25ef800'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:54.907233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4cb0bcfe-392f-4a0f-ac5d-40f55314f04d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61" status: 404 len: 194 microversion: 2.1 time: 0.093928 Aug 24 02:02:54.908534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2029/3021] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:02:54 2022] GET /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61 => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:54.917479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:54.918638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 43295b8b-050c-4eca-bada-135cbf527764] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:54.927105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.927836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.928487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.929386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:54.930184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:54.930776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:54.962971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 HTTP/1.1 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '43295b8b-050c-4eca-bada-135cbf527764'} Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:54.965519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. Aug 24 02:02:54.970000 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:54.973003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 43295b8b-050c-4eca-bada-135cbf527764 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:54.974794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a29e3239-f280-48ae-adfb-b840c4b1bd55 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764" status: 404 len: 111 microversion: 2.1 time: 0.060934 Aug 24 02:02:54.979600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2030/3022] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:54 2022] GET /compute/v2.1/servers/43295b8b-050c-4eca-bada-135cbf527764 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:54.988513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd0b663e-c488-4259-8e9d-f9e2ee951965 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9109cc10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:55.631615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd0b663e-c488-4259-8e9d-f9e2ee951965 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46" status: 202 len: 0 microversion: 2.1 time: 0.649049 Aug 24 02:02:55.633795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2031/3023] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:02:54 2022] DELETE /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:02:55.641224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:55.642001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:55.666506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:55.667513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:55.669258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:55.670353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:55.671093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:55.673282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:55.691029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 HTTP/1.1 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '70b365bb-3263-4136-919b-ce4d33c67ef7'} Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:55.693547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:55.697626 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:55.700368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:55.701392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c2005ba-a16c-4e12-8fdb-acc75dace81b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 404 len: 111 microversion: 2.1 time: 0.066317 Aug 24 02:02:55.702171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2032/3024] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:02:55 2022] DELETE /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:55.707382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:55.708257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:55.715679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:55.716361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:55.718478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:55.719949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:55.720605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:55.721864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:55.918199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:55.928458 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81f54b9b-f43f-410a-bbb5-91afe67760b5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 200 len: 1473 microversion: 2.1 time: 0.224794 Aug 24 02:02:55.929454 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2033/3025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:55 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:55.937586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1947854409", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "802f15e4-b690-4ef7-b7bc-f44a2f083514"}], "security_groups": [{"name": "tempest-securitygroup--470323947"}], "key_name": "tempest-keypair-632130994", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:56.718067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] validate_networks() for [('802f15e4-b690-4ef7-b7bc-f44a2f083514', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:02:58.137140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:02:58.138422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:02:58.139044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:02:58.139597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:02:58.140162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:02:58.160429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.160949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.161401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:58.162122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.163697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.164289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:58.207917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:02:58.217551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:02:58.252474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:02:58.260890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:02:58.393764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a57f976-061a-4dc5-b420-9a0a6e62df12 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.463139 Aug 24 02:02:58.394432 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2034/3026] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:02:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 2464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:02:58.407926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911c8af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:58.499193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:02:58.499991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:02:58.501276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.501276 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46 HTTP/1.1 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fe92a491-8d72-4f3f-8173-bca4de1d0e46'} Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:02:58.503530 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] Aug 24 02:02:58.507269 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.511225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:02:58.511225 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-c3803a36-f749-4e1e-8326-dc194c719530'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:58.512420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1fd06ca-0e79-4e31-ae99-4344723fadd0 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46" status: 404 len: 194 microversion: 2.1 time: 0.117055 Aug 24 02:02:58.513631 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2035/3027] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:02:58 2022] GET /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:58.519070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:58.523091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 70b365bb-3263-4136-919b-ce4d33c67ef7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:58.550591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.551212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.551733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:58.553457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.554081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.554747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:58.589305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 HTTP/1.1 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '70b365bb-3263-4136-919b-ce4d33c67ef7'} Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:02:58.597667 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 70b365bb-3263-4136-919b-ce4d33c67ef7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:02:58.601492 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10eec7e6-ccf6-4938-bb42-45b583ca4275 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7" status: 404 len: 111 microversion: 2.1 time: 0.086626 Aug 24 02:02:58.607017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2036/3028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:58 2022] GET /compute/v2.1/servers/70b365bb-3263-4136-919b-ce4d33c67ef7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:02:58.640405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1379428282"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:02:58.644631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:58.652818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.654005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.654595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:58.655542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:02:58.657712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:02:58.658326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:02:59.029886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-434f1023-f4a2-4eb9-89fa-6c6d810a903f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33/action" status: 202 len: 0 microversion: 2.1 time: 0.417176 Aug 24 02:02:59.033406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2037/3029] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:02:58 2022] POST /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:02:59.043387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4efd44ec-a126-4ab0-a44b-21db326a9cd3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:02:59.044281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4efd44ec-a126-4ab0-a44b-21db326a9cd3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:02:59.282395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4efd44ec-a126-4ab0-a44b-21db326a9cd3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:02:59.289838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4efd44ec-a126-4ab0-a44b-21db326a9cd3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1241 microversion: 2.1 time: 0.254891 Aug 24 02:02:59.294109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2038/3030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:02:59 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1241 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:02:59.308565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72c94917-eb31-4376-aca4-fed705cdae11 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91133c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:00.069622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72c94917-eb31-4376-aca4-fed705cdae11 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.773693 Aug 24 02:03:00.070289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2039/3031] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:02:59 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:00.086422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:00.086915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:00.102121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:00.102970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:00.103602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:00.104640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:00.105339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:00.107594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:00.162598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 HTTP/1.1 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b722ee50-5b9c-4349-84b8-43caee2c5063'} Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:00.167315 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:00.171407 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:00.174952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:00.176074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-970b2743-8165-4fca-b585-5fb30e32393b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 404 len: 111 microversion: 2.1 time: 0.104597 Aug 24 02:03:00.180686 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2040/3032] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:00 2022] DELETE /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:00.186697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66a34c60-0698-450b-b48c-bf6d2fa04625 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b911d9f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:00.259009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66a34c60-0698-450b-b48c-bf6d2fa04625 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 200 len: 1414 microversion: 2.1 time: 0.076554 Aug 24 02:03:00.259960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2041/3033] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:00 2022] GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:00.265921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0c1c198-dc79-467d-ba79-a0da6cda1708 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b911d9dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-867872533", "description": "tempest-description-1982116925"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:00.827772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0c1c198-dc79-467d-ba79-a0da6cda1708 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.566494 Aug 24 02:03:00.828446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2042/3034] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:03:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:01.148679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c781bca1-e330-4a4c-90da-75cd0d0a3d8d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Action: 'create', calling method: .version_select at 0x7f6b910d9dc0>, body: {"keypair": {"name": "tempest-keypair-870267976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHa/9l7XWu+BbdjsMSRGCdA2m4YUjOL8heYAqyWk1sGfogguJwJ6NSuxiPuLSIwrfB4mfToHRljd3n2aHsutv18cN6SQS0E/JNk8Et5WPWdulr+1L/M8jM9+ubNbtDNbA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:01.168554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c781bca1-e330-4a4c-90da-75cd0d0a3d8d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for project c952c01ab0934348b3d059e83be27a95. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:01.174611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c781bca1-e330-4a4c-90da-75cd0d0a3d8d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for user c98376383bf54782b73f9d595192fd2d and project c952c01ab0934348b3d059e83be27a95. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:01.185443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:01.205713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c781bca1-e330-4a4c-90da-75cd0d0a3d8d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.376028 Aug 24 02:03:01.206406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2043/3035] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:03:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:01.211199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:01.211815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: b722ee50-5b9c-4349-84b8-43caee2c5063] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:01.217964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:01.218627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:01.219792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:01.220671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:01.221330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:01.221915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:01.246911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 HTTP/1.1 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b722ee50-5b9c-4349-84b8-43caee2c5063'} Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:01.249074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. Aug 24 02:03:01.254186 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:01.256288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance b722ee50-5b9c-4349-84b8-43caee2c5063 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:01.257477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99b5978f-a1a0-436e-96d3-996a6615b406 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063" status: 404 len: 111 microversion: 2.1 time: 0.049814 Aug 24 02:03:01.258638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2044/3036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:01 2022] GET /compute/v2.1/servers/b722ee50-5b9c-4349-84b8-43caee2c5063 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:01.264198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:01.264877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:01.283574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:01.284063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:01.285001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:01.286103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:01.286720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:01.287303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:01.394889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:01.405929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c74f575-867a-447f-b1b1-ae0fb5e414a7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1299 microversion: 2.1 time: 0.143040 Aug 24 02:03:01.414851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2045/3037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:01 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:01.427056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83ef4436-b453-4b6b-b6df-759ce1ede627 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b91086700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1137011506", "description": "tempest-description-2097145528"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:01.981560 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83ef4436-b453-4b6b-b6df-759ce1ede627 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.564291 Aug 24 02:03:01.983254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2046/3038] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:03:01 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:01.991200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:01.992022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:01.998899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:01.999745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:02.000996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:02.001970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:02.002789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:02.004552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:02.022787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd HTTP/1.1 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd'} Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:02.025013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.028708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.032599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:02.034022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bb2264f-d505-4a73-b33e-8262b5f130fb tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 404 len: 111 microversion: 2.1 time: 0.049490 Aug 24 02:03:02.035518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2047/3039] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:01 2022] DELETE /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:02.041199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9f5aee3-211e-4e5a-a7c0-3aac8c5e2487 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b910d2c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:02.101651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9f5aee3-211e-4e5a-a7c0-3aac8c5e2487 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 200 len: 1414 microversion: 2.1 time: 0.064692 Aug 24 02:03:02.107332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2048/3040] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:02 2022] GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 1414 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:02.118631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:02.120860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:02.129839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:02.130635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:02.131232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:02.132133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:02.134146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:02.134767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:02.198268 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd HTTP/1.1 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd'} Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:02.202417 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. Aug 24 02:03:02.208087 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:02.222046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:02.223198 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2611bef9-9417-4e20-b214-3e5e4082ee24 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd" status: 404 len: 111 microversion: 2.1 time: 0.114865 Aug 24 02:03:02.233920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2049/3041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:02 2022] GET /compute/v2.1/servers/034fe1e6-1ef1-48f2-8924-f01d4b6a2bcd => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:02.270074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-954940291", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "3d600fec-519b-4c08-a3ed-6b3145c95c73"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:02.396072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] validate_networks() for [('3d600fec-519b-4c08-a3ed-6b3145c95c73', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:03:04.058696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:04.059868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:04.060390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:04.063745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:04.063911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:04.080935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:04.081429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:04.081869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:04.087453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:04.088268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:04.092867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:04.138314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Getting quotas for project 01be30d45d214564b7cc7bfdd1dc62ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:04.158814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Getting quotas for user 2e317f2628594867bcb0d228ade52975 and project 01be30d45d214564b7cc7bfdd1dc62ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:04.175266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:03:04.178023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:03:04.269709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9f4e084-f9b7-421d-84b7-ca0b48d39d20 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.033814 Aug 24 02:03:04.273967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2050/3042] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:03:04.280271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:04.281057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:04.288676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:04.289203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:04.289643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:04.290353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:04.290810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:04.291235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:04.630574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:04.633177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:04.655824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3caf7845-ccf7-4305-8372-4519036b8f11 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1366 microversion: 2.1 time: 0.377685 Aug 24 02:03:04.657331 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2051/3043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:04 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:04.679426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c20d66ca-158d-4db9-80d8-27214e07d213 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9109d3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:04.749107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c20d66ca-158d-4db9-80d8-27214e07d213 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 200 len: 1414 microversion: 2.1 time: 0.090679 Aug 24 02:03:04.752115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2052/3044] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:04 2022] GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:04.757050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fa83f6-b757-4b07-8b05-ea129fa44e33", "name": "network-vif-plugged", "status": "completed", "tag": "68b7eb3f-bc70-4f23-bb03-70e106066712"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:04.775254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:04.794637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:04.795774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:04.810875 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] Creating event network-vif-plugged:68b7eb3f-bc70-4f23-bb03-70e106066712 for instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 on n-h2-854121-3 Aug 24 02:03:04.832460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5c4352f6-0156-4225-aa5d-a4b5044cfd3f req-44457759-6c18-454b-850c-d97e5f2125d8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078636 Aug 24 02:03:04.833604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2053/3045] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:04.840741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc3a7963-fa4f-48e8-a736-7caccd7173dc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:04.849208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc3a7963-fa4f-48e8-a736-7caccd7173dc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:05.612845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc3a7963-fa4f-48e8-a736-7caccd7173dc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:05.641457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc3a7963-fa4f-48e8-a736-7caccd7173dc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1215 microversion: 2.1 time: 0.800770 Aug 24 02:03:05.642410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2054/3046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:04 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1215 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:05.656963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a92bf2-2056-40da-9531-f7c02a166c3b", "tag": "414c45bb-85a6-4450-8e8d-6eb6eb8acddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:05.710374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:05.710917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:05.711424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:05.754680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] Creating event network-changed:414c45bb-85a6-4450-8e8d-6eb6eb8acddb for instance 13a92bf2-2056-40da-9531-f7c02a166c3b on n-h1-854121-3 Aug 24 02:03:05.796058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cf751d4d-5105-4347-b289-d9e80cae25c9 req-b99c5979-4952-4a31-bbd4-aabecfa26572 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146114 Aug 24 02:03:05.799514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2055/3047] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:05.818585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:05.824928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:05.846093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:05.846588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:05.847046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:05.847742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:05.848199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:05.857397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:06.801881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:06.815292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c1587bd-f535-404a-8728-eca03a9849e0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1366 microversion: 2.1 time: 1.009473 Aug 24 02:03:06.816372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2056/3048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:05 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1366 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:06.833630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec957eab-82d6-4959-a061-03d3614ae7ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91133c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:14.123167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:15.633806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:15.828677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:16.807436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=11 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:25.527360 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec957eab-82d6-4959-a061-03d3614ae7ce tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 200 len: 1423 microversion: 2.1 time: 18.709173 Aug 24 02:03:25.527987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2057/3049] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:06 2022] GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 1423 bytes in 18710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:25.532742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:25.533356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:25.539674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.540169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.541012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.544147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.545064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.546955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.689535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:25.697288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e8de5ed-58c0-4747-83a2-48cd786e6c9c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1315 microversion: 2.1 time: 0.168004 Aug 24 02:03:25.697816 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2058/3050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:25 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:25.703559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:25.710946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:25.717974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.718494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.718934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.719632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.720264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.720748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.879061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:25.887771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-42c0878c-146e-4e96-9202-e64b5b875cf1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1366 microversion: 2.1 time: 0.188770 Aug 24 02:03:25.897288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2059/3051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:25 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:25.902465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:25.903169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:25.909463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.909919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.910358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.911059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.911512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.911934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.926690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 HTTP/1.1 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0096410f-c55c-4bbe-a2d7-c22f89245511'} Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:25.928361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:25.932374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:25.934606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:25.935474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06e145b4-8a67-45dc-88d1-f0f2c066ca26 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 404 len: 111 microversion: 2.1 time: 0.036918 Aug 24 02:03:25.936028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2060/3052] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:25 2022] DELETE /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:25.943917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e402c6b-8b19-4c9a-b236-222f3fc5707c", "tag": "b72a9a31-f4ca-44b2-9419-54c8f81e07f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:25.954293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.954832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.955374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:25.966625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] Creating event network-changed:b72a9a31-f4ca-44b2-9419-54c8f81e07f4 for instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c on n-h2-854121-3 Aug 24 02:03:25.974662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-45096c85-9a2e-444f-8d35-a7d428622e75 req-f6be014c-0171-46f6-920b-082484f117e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034380 Aug 24 02:03:25.974662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2061/3053] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:25.978002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a92bf2-2056-40da-9531-f7c02a166c3b", "name": "network-vif-plugged", "status": "completed", "tag": "414c45bb-85a6-4450-8e8d-6eb6eb8acddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:25.988094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:25.988662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:25.989124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:26.000574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] Creating event network-vif-plugged:414c45bb-85a6-4450-8e8d-6eb6eb8acddb for instance 13a92bf2-2056-40da-9531-f7c02a166c3b on n-h1-854121-3 Aug 24 02:03:26.005572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5631407f-bd2f-403a-afce-678bfdacdf3a req-93b9900e-ef59-4973-a4ce-96b5c82f06b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Aug 24 02:03:26.006167 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2062/3054] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:26.385051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1523423500", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "c38e8856-7cec-4f76-bfd2-e03605877ff1"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:26.480489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] validate_networks() for [('c38e8856-7cec-4f76-bfd2-e03605877ff1', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:03:26.944821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:26.945891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:26.946935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:26.947583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:26.948216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:26.960284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:26.961160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:26.961840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:26.962805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:26.963481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:26.964221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:26.993802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:27.000795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for user 3fcba851bcb3469d9863b8e2c05c9def and project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:27.016848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:03:27.020336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:03:27.083130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d231bb2a-1c65-4243-bcf0-c7fb893b20b1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075543 Aug 24 02:03:27.090996 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2063/3055] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:03:27.098244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd467ba0-aac3-4c03-b5d1-62948155d723 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91232820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:27.181478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd467ba0-aac3-4c03-b5d1-62948155d723 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 200 len: 1423 microversion: 2.1 time: 0.088020 Aug 24 02:03:27.190025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2064/3056] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:27 2022] GET /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:27.202244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:27.203558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: 0096410f-c55c-4bbe-a2d7-c22f89245511] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:27.219424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.220065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.220640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.221481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.222012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.222507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.248265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 HTTP/1.1 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0096410f-c55c-4bbe-a2d7-c22f89245511'} Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:27.253259 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. Aug 24 02:03:27.257829 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:27.260524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance 0096410f-c55c-4bbe-a2d7-c22f89245511 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:27.262061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84db9510-d83e-4f73-8e2f-48a33a82df9b tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511" status: 404 len: 111 microversion: 2.1 time: 0.064440 Aug 24 02:03:27.262954 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2065/3057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:27 2022] GET /compute/v2.1/servers/0096410f-c55c-4bbe-a2d7-c22f89245511 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:27.269032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:27.270533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:27.277887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.278782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.279106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.280331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.281088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.281706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.450161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:27.458088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56745248-b772-41f0-b58e-259b9ff6ca6f tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1315 microversion: 2.1 time: 0.193940 Aug 24 02:03:27.459621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2066/3058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:27 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:27.469992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:27.469992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:27.477613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.477948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.478505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.479229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:27.479614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:27.480043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:27.658348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:27.670345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6461e19f-6c3a-4e9e-a0f6-68686d63b493 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1366 microversion: 2.1 time: 0.209582 Aug 24 02:03:27.671294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2067/3059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:27 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:27.680661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4dc01b0c-e921-4b2a-9b8a-20d02ab2e8c6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:27.681410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4dc01b0c-e921-4b2a-9b8a-20d02ab2e8c6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:27.753312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4dc01b0c-e921-4b2a-9b8a-20d02ab2e8c6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:27.761807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4dc01b0c-e921-4b2a-9b8a-20d02ab2e8c6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1218 microversion: 2.1 time: 0.088413 Aug 24 02:03:27.762374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2068/3060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:27 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:27.769746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ce3ce25-4c6b-47f0-a104-122b89b82d9a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9109c9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:28.734020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ce3ce25-4c6b-47f0-a104-122b89b82d9a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 204 len: 0 microversion: 2.1 time: 0.970026 Aug 24 02:03:28.734849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2069/3061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:27 2022] DELETE /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 0 bytes in 972 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:03:28.741577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:28.742933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:28.758557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:28.768299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:28.768907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:28.769676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:28.770261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:28.770595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:28.788023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 HTTP/1.1 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'dfd70666-4f4f-4932-b661-f801dcc16441'} Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:28.789648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55c5304b-70d4-4dd6-94b7-fe050648f5e4 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 404 len: 111 microversion: 2.1 time: 0.055227 Aug 24 02:03:28.793889 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2070/3062] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:28 2022] DELETE /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:28.802812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e402c6b-8b19-4c9a-b236-222f3fc5707c", "name": "network-vif-plugged", "status": "completed", "tag": "b72a9a31-f4ca-44b2-9419-54c8f81e07f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:28.820539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:28.821340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:28.822302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:28.842078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] Creating event network-vif-plugged:b72a9a31-f4ca-44b2-9419-54c8f81e07f4 for instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c on n-h2-854121-3 Aug 24 02:03:28.850355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-be9c1bac-f61d-4c15-a03a-984eae6ddafe req-eadcc886-a86e-4fdd-918f-ef7c98916b79 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057314 Aug 24 02:03:28.859714 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2071/3063] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:28.866843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:28.867611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:28.875601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:28.876898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:28.877349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:28.878284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:28.878746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:28.879177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.125949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:29.139485 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce01bb17-9ff0-4af5-8f16-e709715e3fe7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1315 microversion: 2.1 time: 0.277011 Aug 24 02:03:29.140768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2072/3064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:28 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:29.158661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:29.159431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:29.165715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.166469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.167295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.168004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.168658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.169310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.402885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:29.419430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-692d5992-e842-40bb-921b-6d51ad64f14c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1556 microversion: 2.1 time: 0.270957 Aug 24 02:03:29.421069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2073/3065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:29 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1556 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:29.431728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:29.435458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:29.444525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.445649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.446355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.448118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.449091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.449914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.488495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:03:29.653649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac734a2f-675a-47a1-a4c0-fbf7c3953ffb tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 204 len: 0 microversion: 2.1 time: 0.229182 Aug 24 02:03:29.654276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2074/3066] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:29 2022] DELETE /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:03:29.669883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:29.670793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:29.677542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.678301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.678905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:29.679787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:29.685382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:29.686016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:30.020874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:30.032007 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6acf8a95-d1bf-40fc-b7cf-00eaa33d971b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1318 microversion: 2.1 time: 0.376526 Aug 24 02:03:30.033438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2075/3067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:29 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:30.042684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:30.043546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] [instance: dfd70666-4f4f-4932-b661-f801dcc16441] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:30.053748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:30.055201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:30.069533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:30.073751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:30.078535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:30.079882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:30.097392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] HTTP exception thrown: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Request method failure captured: Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 HTTP/1.1 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYUjoSS7JivQWm0jU25uut29-IlwZbB9sphtQ8CzLAPnT0tue83fSjiKAionsDrQmh-Lw6SQqPnS0W9bSEP6cLQ_DvMBYgcF9wXZhwxGWwdPrH0Pri0hwP3F6FPOyRvSxzR-UkJAzxQHA-ktThhJMYWtJVMIxMYD24mCrin6Xl5hvNs Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_005c578132f34fde8611eb817e0f0c7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 005c578132f34fde8611eb817e0f0c7a Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-400652747 Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14c3e6fc474345239f16575d5b5439ef Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-400652747-project Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'dfd70666-4f4f-4932-b661-f801dcc16441'} Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:30.099275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:30.104062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] Returning 404 to user: Instance dfd70666-4f4f-4932-b661-f801dcc16441 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:30.105837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7406b727-1762-4cc0-bf66-4ce6ebe26655 tempest-DeleteServersTestJSON-400652747 tempest-DeleteServersTestJSON-400652747-project] 10.222.0.49 "GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441" status: 404 len: 111 microversion: 2.1 time: 0.069865 Aug 24 02:03:30.117701 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2076/3068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:30 2022] GET /compute/v2.1/servers/dfd70666-4f4f-4932-b661-f801dcc16441 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:30.123585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:30.124091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:30.132431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:30.132975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:30.133423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:30.134152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:30.134617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:30.135052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:30.314901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dad41c5-ac0c-4d98-90a0-2104a1585952 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195861 Aug 24 02:03:30.316168 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2077/3069] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:03:30 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:30.321152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1288820302", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "b1581d10-276f-4f25-861c-edcd3a3366ea"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:30.421241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] validate_networks() for [('b1581d10-276f-4f25-861c-edcd3a3366ea', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:03:31.478528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:31.479216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:31.479443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:31.480058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:31.480638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:31.495335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:31.495816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:31.496246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:31.500552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:31.501061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:31.501501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:31.551327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:31.557305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for user 19d2def105dc41a78e79aedb36fbe5b0 and project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:31.611491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:03:31.618249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:03:31.707453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bd0a741-0f8e-42fa-905d-e7c2f18caa4c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389920 Aug 24 02:03:31.708675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2078/3070] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:03:31.713803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:31.714688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:31.732027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:31.733706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:31.734227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:31.737385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:31.737926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:31.740548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.208972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:32.224690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9836aaf1-eea9-4824-a25f-4df7036059d7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1502 microversion: 2.1 time: 0.514616 Aug 24 02:03:32.233127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2079/3071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:31 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1502 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:32.241550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fa83f6-b757-4b07-8b05-ea129fa44e33", "name": "network-vif-unplugged", "status": "completed", "tag": "68b7eb3f-bc70-4f23-bb03-70e106066712"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:32.269728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.270621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.271029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.323064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] Creating event network-vif-unplugged:68b7eb3f-bc70-4f23-bb03-70e106066712 for instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 on n-h2-854121-3 Aug 24 02:03:32.369964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-79d11459-3754-488b-a6a9-541fe095f1ba req-cd88cc73-0eb9-44af-90b0-5263ec9e9474 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134995 Aug 24 02:03:32.371849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2080/3072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:32.424405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:32.425716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:32.454109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.455671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.456232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.459599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.460767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.463238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.834576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:32.843061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2801a289-eb08-4117-bdc2-7e245874c664 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1318 microversion: 2.1 time: 0.468110 Aug 24 02:03:32.843675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2081/3073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:32 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:32.864394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb885c1-58d5-4cde-8fe5-90ebaf803680", "tag": "3d44391e-b0ad-47ce-a148-bdaa183fd54b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:32.885805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.886591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.887902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.910921 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] Creating event network-changed:3d44391e-b0ad-47ce-a148-bdaa183fd54b for instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 on n-h1-854121-3 Aug 24 02:03:32.936070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b4980002-c206-4d44-9e73-9ad722689cc7 req-d3388211-763e-4e4a-9464-7b3cb1551adf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066519 Aug 24 02:03:32.945017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2082/3074] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:32.958033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:32.959348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:32.976397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.977187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.979430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:32.980405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:32.982302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:32.987657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:33.015697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:33.078121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:33.089151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b25615a-1831-4700-a278-85a6e6827ba8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1260 microversion: 2.1 time: 0.142211 Aug 24 02:03:33.090330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2083/3075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:32 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1260 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:33.097850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-867872533"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:33.098887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:33.108512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:33.112641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:33.113007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:33.113738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:33.114214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:33.114938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:33.388336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Adding security group ca85b3db-0c65-47fc-91a3-496e2ca70970 to port b72a9a31-f4ca-44b2-9419-54c8f81e07f4 Aug 24 02:03:34.050630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e0e0ffc-c369-4f13-a7e5-2e714c4c9a9a tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action" status: 202 len: 0 microversion: 2.1 time: 0.957480 Aug 24 02:03:34.050630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2084/3076] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:33 2022] POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:34.055713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a92bf2-2056-40da-9531-f7c02a166c3b", "tag": "414c45bb-85a6-4450-8e8d-6eb6eb8acddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:34.092299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.092834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.093318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.154821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] Creating event network-changed:414c45bb-85a6-4450-8e8d-6eb6eb8acddb for instance 13a92bf2-2056-40da-9531-f7c02a166c3b on n-h1-854121-3 Aug 24 02:03:34.161393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-741e0a02-c6f8-41fc-b7e0-f519fc730a75 req-1c07e3d3-5f8b-45c3-b216-1ba74465fd8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109821 Aug 24 02:03:34.161874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2085/3077] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:34.178240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:34.179532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:34.193706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.210937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.211231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.221088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.224569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.225287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.455136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:34.466862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd0fb49c-f1ac-4ac6-9cc9-b0dc06fc53e4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1318 microversion: 2.1 time: 0.303263 Aug 24 02:03:34.467999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2086/3078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:34 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:34.474812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91207700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:34.607130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use.", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:34.607876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.607876 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970 HTTP/1.1 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: exception: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ca85b3db-0c65-47fc-91a3-496e2ca70970'} Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:34.611089 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] Aug 24 02:03:34.614949 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:34.620310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 400 to user: Security Group ca85b3db-0c65-47fc-91a3-496e2ca70970 in use. Aug 24 02:03:34.620310 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3385a244-9a25-40b8-99a8-50041a708e51'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:34.620310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00a2239f-a53c-4577-b05f-a35e5933f06b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970" status: 400 len: 185 microversion: 2.1 time: 0.149778 Aug 24 02:03:34.620310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2087/3079] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:34 2022] DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970 => generated 185 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:34.627505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:34.628462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:34.637719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.638588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.639251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.640335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.641066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.641734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.722604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:34.732985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-633561b1-4760-4275-a5d2-2e5e007fc81c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1266 microversion: 2.1 time: 0.110317 Aug 24 02:03:34.747108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2088/3080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:34 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:34.758270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:34.760654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:34.781693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.782209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.782643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.783352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:34.784007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:34.784631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:34.975736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e8f9b39-5151-4ef5-ad6b-6d07ae38ebda tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action" status: 202 len: 0 microversion: 2.1 time: 0.226578 Aug 24 02:03:34.979236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2089/3081] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:34 2022] POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:34.993741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:34.997851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:35.019781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:35.021887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:35.023648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:35.025326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:35.025326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:35.027740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:35.735348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:35.743497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c71b4dc8-fddf-4201-bc18-7b33fe80f767 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1572 microversion: 2.1 time: 0.761194 Aug 24 02:03:35.744134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2090/3082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:34 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1572 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:35.774957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e402c6b-8b19-4c9a-b236-222f3fc5707c", "tag": "b72a9a31-f4ca-44b2-9419-54c8f81e07f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:35.798756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:35.799249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:35.809429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:35.830104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] Creating event network-changed:b72a9a31-f4ca-44b2-9419-54c8f81e07f4 for instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c on n-h2-854121-3 Aug 24 02:03:35.837429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f06b1494-bbf5-4a49-af70-4b6e3242ac91 req-e2dd1bc9-4248-40ca-a7aa-0e3cee6d5bd4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092046 Aug 24 02:03:35.838572 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2091/3083] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:35.855536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1653838430", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8e3fa2ed-755a-485f-b199-d1ec81db0a9e"}], "security_groups": [{"name": "tempest-securitygroup--1977842946"}], "key_name": "tempest-keypair-870267976", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "4eec3d05-60b7-48cf-879a-a6241ec9fc7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:35.879357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:36.075725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] validate_networks() for [('8e3fa2ed-755a-485f-b199-d1ec81db0a9e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:03:36.799987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for project c952c01ab0934348b3d059e83be27a95. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:36.805980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for user c98376383bf54782b73f9d595192fd2d and project c952c01ab0934348b3d059e83be27a95. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:36.820494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:36.821305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:36.822108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:36.822682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:36.823258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:36.835220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:36.835961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:36.836628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:36.837809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:36.838471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:36.839135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:36.859549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for project c952c01ab0934348b3d059e83be27a95. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:36.865895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Getting quotas for user c98376383bf54782b73f9d595192fd2d and project c952c01ab0934348b3d059e83be27a95. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:36.932640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:03:36.935238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4eec3d05-60b7-48cf-879a-a6241ec9fc7a',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:03:37.156703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44a58522-4d46-414b-83dc-c1ca0e7ab711 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.317332 Aug 24 02:03:37.157454 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2092/3084] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:35 2022] POST /compute/v2.1/servers => generated 407 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:03:37.174846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:37.177922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:37.186826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.189503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.189974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.190689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.191156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.191603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.407413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:37.416310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4348788d-93d3-4622-b502-b575e24811aa tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1318 microversion: 2.1 time: 0.247423 Aug 24 02:03:37.418448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2093/3085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:37 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:37.423961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:37.424568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:37.431133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.431628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.432157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.432912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.433377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.433809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.678815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:37.690345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dccb2f27-7140-4ca2-bf2f-ca2a269c23c0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.270646 Aug 24 02:03:37.704813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2094/3086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:37 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:37.710893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fa83f6-b757-4b07-8b05-ea129fa44e33", "name": "network-vif-deleted", "tag": "68b7eb3f-bc70-4f23-bb03-70e106066712"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:37.738377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.742097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.745469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.766615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] Creating event network-vif-deleted:68b7eb3f-bc70-4f23-bb03-70e106066712 for instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 on n-h2-854121-3 Aug 24 02:03:37.777718 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3837cca0-0502-4c24-a761-b2ba11b3d580 req-93d37f69-4bdb-4f5d-bf5e-9d551026287d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070653 Aug 24 02:03:37.779841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2095/3087] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:37.787969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:37.789119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:37.799844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.800883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.802951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:37.804150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:37.804887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:37.805526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.010564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:38.018939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31e78249-9be8-4f82-8c04-1a775538a442 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1570 microversion: 2.1 time: 0.236763 Aug 24 02:03:38.020025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2096/3088] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:37 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1570 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:38.031459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:38.033629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:38.043411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:38.044113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:38.044557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.045631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:38.046978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:38.047412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.136860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:38.146186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f17dc02-612b-4d60-b7fc-dbacc61839e6 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1171 microversion: 2.1 time: 0.119081 Aug 24 02:03:38.147052 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2097/3089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:38 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1171 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:38.152088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb885c1-58d5-4cde-8fe5-90ebaf803680", "name": "network-vif-plugged", "status": "completed", "tag": "3d44391e-b0ad-47ce-a148-bdaa183fd54b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:38.163069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:38.163994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:38.164699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.219786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] Creating event network-vif-plugged:3d44391e-b0ad-47ce-a148-bdaa183fd54b for instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 on n-h1-854121-3 Aug 24 02:03:38.227928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-79be57f4-b93e-4812-998e-146439475fca req-b444dff1-47c3-4a43-8356-5e13d442cbbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078752 Aug 24 02:03:38.235463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2098/3090] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:38.247483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1137011506"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:38.248155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:38.260028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:38.260531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:38.261043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.261743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:38.265827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:38.266453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:38.505741 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Adding security group 8a891ea7-8687-49d2-9b36-3981378942b0 to port b72a9a31-f4ca-44b2-9419-54c8f81e07f4 Aug 24 02:03:38.987162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-962a73b2-ba78-4c26-aedc-7cf1cb449c59 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action" status: 202 len: 0 microversion: 2.1 time: 0.750112 Aug 24 02:03:38.991610 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2099/3091] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:38 2022] POST /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:38.993747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:38.994367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:39.010349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.010989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.011431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.012145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.012590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.013044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.334304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:39.345300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23681376-0f14-4167-b8bd-7570943ceac6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1318 microversion: 2.1 time: 0.355612 Aug 24 02:03:39.346740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2100/3092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:38 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:39.363097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:39.363877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:39.371941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.372482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.373661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.377475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.377475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.377475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.648765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:39.662155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae28bbae-2157-4b1f-9429-d5f42e9a5b35 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.313608 Aug 24 02:03:39.663230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2101/3093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:39 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:39.691002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911fbaf0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:39.916418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use.", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:39.917155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.917155 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0 HTTP/1.1 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: exception: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8a891ea7-8687-49d2-9b36-3981378942b0'} Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:39.919177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 400 to user: Security Group 8a891ea7-8687-49d2-9b36-3981378942b0 in use. Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-7acbcf88-bf4e-4316-9c09-9052377a56ae'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-138f406a-3d19-4c82-a45e-ad9e8a3ae296 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0" status: 400 len: 185 microversion: 2.1 time: 0.256296 Aug 24 02:03:39.924261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2102/3094] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:39 2022] DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0 => generated 185 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:39.930797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e402c6b-8b19-4c9a-b236-222f3fc5707c", "tag": "b72a9a31-f4ca-44b2-9419-54c8f81e07f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:39.938995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.939583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.940026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.951516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] Creating event network-changed:b72a9a31-f4ca-44b2-9419-54c8f81e07f4 for instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c on n-h2-854121-3 Aug 24 02:03:39.957552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c89af890-3c5b-4b78-a4ab-d65994fd58a3 req-72ecc8f4-33dd-4d3f-9f99-33b901db78b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034739 Aug 24 02:03:39.961332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2103/3095] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:39.967250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:39.967356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:39.973924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.974425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.974854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:39.975560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:39.976013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:39.976444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:40.138319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:40.147818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45137845-1c79-42a8-904b-5194b97ee680 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1227 microversion: 2.1 time: 0.185500 Aug 24 02:03:40.151668 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2104/3096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:39 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1227 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:40.167954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a", "tag": "9dfd45e0-4dbc-4d19-9866-05b95dc8bb76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:40.197439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:40.203440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:40.206382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:40.255366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] Creating event network-changed:9dfd45e0-4dbc-4d19-9866-05b95dc8bb76 for instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a on n-h2-854121-3 Aug 24 02:03:40.261985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7343fd15-105b-4a11-8a15-05d334e4e25b req-19302318-84e3-4035-9b1b-b558da178867 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107612 Aug 24 02:03:40.262895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2105/3097] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:40.276808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:40.277644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:40.285354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:40.286752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:40.288571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:40.292009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:40.292628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:40.293758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:40.331584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:40.339513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:03:40.551656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-229802a5-a11d-4296-ad1c-95fe02407e47 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 204 len: 0 microversion: 2.1 time: 0.287007 Aug 24 02:03:40.555324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2106/3098] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:40 2022] DELETE /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:03:40.564014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:40.565615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:40.572369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:40.573194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:40.573864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:40.575494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:40.576198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:40.579559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:41.362667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:41.372956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e81e652b-d44d-4a6b-9585-cc08799f35db tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1508 microversion: 2.1 time: 0.814411 Aug 24 02:03:41.373760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2107/3099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:40 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1508 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:41.380471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:41.381555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:41.396827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:41.397753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:41.398347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:41.399351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:41.400152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:41.400692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:41.894925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:41.903902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-245c4aad-a4f7-41ef-82d0-9cb19b9e0110 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1645 microversion: 2.1 time: 0.528346 Aug 24 02:03:41.909094 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2108/3100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:41 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1645 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:41.922310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:41.922938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:41.941355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:41.942904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:41.943506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:41.944996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:41.946107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:41.946995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.257557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:42.267134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d603a2f4-bdd3-4a2f-8e0d-7c0c24bc7c83 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.361548 Aug 24 02:03:42.280030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2109/3101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:41 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:42.280030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:42.280030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:42.303815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.304325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.308762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.309560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.310035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.310607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.419778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:42.432149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bbb5a8b-f115-49cb-a842-480e97b4bee8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1237 microversion: 2.1 time: 0.160256 Aug 24 02:03:42.432779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2110/3102] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:42 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1237 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:42.446517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:42.448022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:42.465872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.467049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.467498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.468808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.469272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.469702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.825257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:42.840403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b354038-1c41-4a4f-9f7d-bcdad568faff tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1508 microversion: 2.1 time: 0.405842 Aug 24 02:03:42.841087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2111/3103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:42 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:42.863906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:42.866849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:42.883098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.884244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.884698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:42.885440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:42.885901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:42.886335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.007667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:43.008292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:43.008975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:43.009604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:43.010212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:43.086430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:43.095191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.095850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.096437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.098052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.098773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.099838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.133808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4d798ed-900a-414e-a3ca-dd57975a4f1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "POST /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680/action" status: 202 len: 1110 microversion: 2.1 time: 0.273942 Aug 24 02:03:43.135170 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2112/3104] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:42 2022] POST /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680/action => generated 1110 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 02:03:43.141451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:43.142325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:43.154677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.155533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.156652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.157666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.158287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.158880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.497386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:43.536382 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac66b26b-f1d4-4fa1-a2da-62dc927f18a5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1645 microversion: 2.1 time: 0.399413 Aug 24 02:03:43.539487 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2113/3105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:43 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1645 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:43.554461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:43.555305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:43.579068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.585334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.585913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.586922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.587979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.588541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.839136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:43.847926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbec59e8-49ee-4e1d-8945-7671dbae5e0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.307047 Aug 24 02:03:43.848504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2114/3106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:43 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:43.855374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:43.855988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:43.862643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.863328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.863769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:43.864466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:43.864956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:43.865544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:44.223534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:44.236504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b5daf22-86d0-496e-9d9d-dbbba0f49d53 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.384114 Aug 24 02:03:44.246895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2115/3107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:43 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:44.276895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:44.280983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:44.289410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:44.289999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:44.290531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:44.291415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:44.292004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:44.292646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:44.650008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:44.666184 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ffadf0d-91cb-4304-ae34-afc16b174af8 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1305 microversion: 2.1 time: 0.416670 Aug 24 02:03:44.666788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2116/3108] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:44 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1305 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:45.091641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81279fbd-1eed-4f9a-94a6-dd3f68f26a8e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1727471164", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:45.097355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-81279fbd-1eed-4f9a-94a6-dd3f68f26a8e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] HTTP exception thrown: min_count must be <= max_count Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81279fbd-1eed-4f9a-94a6-dd3f68f26a8e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Request method failure captured: Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 184 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYb_4NlGC2d_L6lwEEF7ef7Fop4ZpXbAPOu_UktoBXPbSZ15v714bdVpIy1Zson_-n_rUtZuon8obkaZrok30YIo-1zKRemTCXN2HOQDY7lK5NJKNa3B3e4eYz0AHusYFM4wY5dplf0MMRVeOsVwkU7uoBmV6bfdOoVfK8C1kdmfftQ Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d836ea0e3dda42659f90559a76bf7876 Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1727471164", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: exception: min_count must be <= max_count Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1727471164', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 24 02:03:45.100285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:45.106043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81279fbd-1eed-4f9a-94a6-dd3f68f26a8e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Returning 400 to user: min_count must be <= max_count {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:45.107464 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81279fbd-1eed-4f9a-94a6-dd3f68f26a8e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.439753 Aug 24 02:03:45.108636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2117/3109] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 24 02:03:45.131175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586c4759-844f-4fae-9c7c-03d17b3115ee", "tag": "f028dde8-f39d-469d-8ffb-a0948dcc47e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:45.168150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:45.168650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:45.169119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:45.198910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] Creating event network-changed:f028dde8-f39d-469d-8ffb-a0948dcc47e3 for instance 586c4759-844f-4fae-9c7c-03d17b3115ee on n-h1-854121-3 Aug 24 02:03:45.213180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-711cdfba-66c2-4515-8dd7-c45f81939f54 req-00739d06-eea1-432a-9cb3-7d993021dfab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102932 Aug 24 02:03:45.214957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2118/3110] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:45.226936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:45.232067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:45.256132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:45.259089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:45.260437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:45.266378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:45.266871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:45.267291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:45.812319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:45.831201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2fe07fb-3ddc-44d7-a21a-0e1e27e313fc tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 200 len: 1645 microversion: 2.1 time: 0.613178 Aug 24 02:03:45.833737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2119/3111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:45 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 1645 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:45.856272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:45.861006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:45.888360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:45.889184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:45.893684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:45.895956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:45.896652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:45.898733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:46.345257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:46.357055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-335e9213-13c5-40c5-8a36-a21ab0f082c0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.517797 Aug 24 02:03:46.358102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2120/3112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:45 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:46.364469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:46.366715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:46.383960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:46.388647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:46.390079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:46.391009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:46.398628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:46.399739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:46.404801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:46.649871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:46.659304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0677f204-fc58-42a6-b7b2-87dca0b13ff1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.298448 Aug 24 02:03:46.665027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2121/3113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:46 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:46.680535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a460cc3f-3a8e-4798-963a-556d51d8c30e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2124866546", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "max_count": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a460cc3f-3a8e-4798-963a-556d51d8c30e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Request method failure captured: Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 168 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYb_4NlGC2d_L6lwEEF7ef7Fop4ZpXbAPOu_UktoBXPbSZ15v714bdVpIy1Zson_-n_rUtZuon8obkaZrok30YIo-1zKRemTCXN2HOQDY7lK5NJKNa3B3e4eYz0AHusYFM4wY5dplf0MMRVeOsVwkU7uoBmV6bfdOoVfK8C1kdmfftQ Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d836ea0e3dda42659f90559a76bf7876 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2124866546", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "max_count": 0}} Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2124866546', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'max_count': 0}}} Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 0 Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:03:46.684880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a460cc3f-3a8e-4798-963a-556d51d8c30e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a460cc3f-3a8e-4798-963a-556d51d8c30e tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020049 Aug 24 02:03:46.689058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2122/3114] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:46.707595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:46.711127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:46.730500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:46.731403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:46.732698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:46.735061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:46.736079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:46.736938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:46.850631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:46.879153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:46.936372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:46.953020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d13c98db-095a-42fa-832c-8cd6fac7bb39 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1305 microversion: 2.1 time: 0.263869 Aug 24 02:03:46.957234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2123/3115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:46 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:46.965724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a", "name": "network-vif-plugged", "status": "completed", "tag": "9dfd45e0-4dbc-4d19-9866-05b95dc8bb76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:46.985996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:46.986665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:46.987204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.001540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] Creating event network-vif-plugged:9dfd45e0-4dbc-4d19-9866-05b95dc8bb76 for instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a on n-h2-854121-3 Aug 24 02:03:47.007304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6a838047-010c-4aca-afa2-3e1d1ebe3e3d req-5b0f6e7e-24ff-46ad-9b47-5f1d08a32658 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047651 Aug 24 02:03:47.007917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2124/3116] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:47.014099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-041355ea-3cef-4d1b-b6e7-ea33b23306c1 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-334356582", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "max_count": 2.5}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-041355ea-3cef-4d1b-b6e7-ea33b23306c1 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Request method failure captured: Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 169 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYb_4NlGC2d_L6lwEEF7ef7Fop4ZpXbAPOu_UktoBXPbSZ15v714bdVpIy1Zson_-n_rUtZuon8obkaZrok30YIo-1zKRemTCXN2HOQDY7lK5NJKNa3B3e4eYz0AHusYFM4wY5dplf0MMRVeOsVwkU7uoBmV6bfdOoVfK8C1kdmfftQ Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d836ea0e3dda42659f90559a76bf7876 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-334356582", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "max_count": 2.5}} Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-334356582', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'max_count': 2.5}}} Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:03:47.025486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-041355ea-3cef-4d1b-b6e7-ea33b23306c1 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-041355ea-3cef-4d1b-b6e7-ea33b23306c1 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020959 Aug 24 02:03:47.033730 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2125/3117] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:47.036505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:47.037498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:47.068060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.068634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.069259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.069831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.071474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.074799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.117435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c HTTP/1.1 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4e402c6b-8b19-4c9a-b236-222f3fc5707c'} Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.119123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:47.124754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.132064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:47.133639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f94d781-0e94-4d11-baf0-9d39bed0599c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 404 len: 111 microversion: 2.1 time: 0.100781 Aug 24 02:03:47.138679 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2126/3118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:47 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:47.144867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ab486b5-4534-4c06-887c-d16ef6c22c06 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911a4550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:47.399568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ab486b5-4534-4c06-887c-d16ef6c22c06 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970" status: 202 len: 0 microversion: 2.1 time: 0.258892 Aug 24 02:03:47.405557 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2127/3119] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:47 2022] DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:47.415150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcaed3f-3431-4d33-9812-756624ec3373 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1078456404", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 0}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcaed3f-3431-4d33-9812-756624ec3373 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Request method failure captured: Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 168 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYb_4NlGC2d_L6lwEEF7ef7Fop4ZpXbAPOu_UktoBXPbSZ15v714bdVpIy1Zson_-n_rUtZuon8obkaZrok30YIo-1zKRemTCXN2HOQDY7lK5NJKNa3B3e4eYz0AHusYFM4wY5dplf0MMRVeOsVwkU7uoBmV6bfdOoVfK8C1kdmfftQ Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d836ea0e3dda42659f90559a76bf7876 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1078456404", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 0}} Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1078456404', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'min_count': 0}}} Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 0 Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:03:47.421278 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcaed3f-3431-4d33-9812-756624ec3373 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffcaed3f-3431-4d33-9812-756624ec3373 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016027 Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2128/3120] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:47 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:47.436321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e402c6b-8b19-4c9a-b236-222f3fc5707c", "name": "network-vif-deleted", "tag": "b72a9a31-f4ca-44b2-9419-54c8f81e07f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:47.443057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.443901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.444529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.459655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] Creating event network-vif-deleted:b72a9a31-f4ca-44b2-9419-54c8f81e07f4 for instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c on n-h2-854121-3 Aug 24 02:03:47.468231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-73c9cfd7-f40e-44b6-9565-788eb9ed946b req-bc07523b-ce7d-4e8f-9158-534b6f019cb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043653 Aug 24 02:03:47.468872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2129/3121] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:47.475026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:47.475919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:47.482605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.483642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.484266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.485157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.485774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.486361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.667908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:47.678805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-550e9004-6ec3-4e1e-9123-00a460e30c6e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.207593 Aug 24 02:03:47.685222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2130/3122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:47 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:47.691412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da5391f7-a0e7-402c-8a94-d141ae8e0c6e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b912de280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:47.903410 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da5391f7-a0e7-402c-8a94-d141ae8e0c6e tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0" status: 202 len: 0 microversion: 2.1 time: 0.216946 Aug 24 02:03:47.904774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2131/3123] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:47 2022] DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:47.909877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df6f370d-15cc-4e53-a0d3-1488c3487102 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-745821941", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 2.5}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df6f370d-15cc-4e53-a0d3-1488c3487102 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Request method failure captured: Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 169 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYb_4NlGC2d_L6lwEEF7ef7Fop4ZpXbAPOu_UktoBXPbSZ15v714bdVpIy1Zson_-n_rUtZuon8obkaZrok30YIo-1zKRemTCXN2HOQDY7lK5NJKNa3B3e4eYz0AHusYFM4wY5dplf0MMRVeOsVwkU7uoBmV6bfdOoVfK8C1kdmfftQ Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7557e42c3dbb4e1f8f29d14a0106c107"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7557e42c3dbb4e1f8f29d14a0106c107 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1864339280 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d836ea0e3dda42659f90559a76bf7876 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1864339280-project Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-745821941", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 2.5}} Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-745821941', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'min_count': 2.5}}} Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 2.5 Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:03:47.914603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 24 02:03:47.919198 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:47.922187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df6f370d-15cc-4e53-a0d3-1488c3487102 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:47.923346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df6f370d-15cc-4e53-a0d3-1488c3487102 tempest-MultipleCreateNegativeTestJSON-1864339280 tempest-MultipleCreateNegativeTestJSON-1864339280-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017465 Aug 24 02:03:47.923924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2132/3124] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:47 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:03:47.938691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:47.939313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:47.943276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:47.947552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.948165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.948470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:47.949197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:47.949917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:47.950336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:48.101417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:48.109918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4fc6e552-b1cb-4576-8360-15f9b08e746b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1308 microversion: 2.1 time: 0.184480 Aug 24 02:03:48.123123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2133/3125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:47 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:48.128396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5db6a6b-dd22-48f0-997d-2e2fe02a58e1"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:48.130998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:48.137617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:48.138337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:48.138840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:48.139793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:48.140299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:48.140817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:49.368246 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bfa89951-4307-4311-8092-a3945b47d0f8 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "POST /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.243290 Aug 24 02:03:49.374144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2134/3126] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:03:48 2022] POST /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments => generated 194 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:49.379837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58a5203d-c59f-49fc-bae1-29f36dc8a9ee tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'create', calling method: .version_select at 0x7f6b916ab040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1020765818", "description": "tempest-description-257132223"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:49.548604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58a5203d-c59f-49fc-bae1-29f36dc8a9ee tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.172432 Aug 24 02:03:49.549388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2135/3127] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:03:49 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:49.554966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:49.555721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:49.565396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:49.566267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:49.567657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:49.568946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:49.569553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:49.570536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:49.766211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:49.780808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a1fec43-3737-484a-8486-a6512a1500e4 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.229574 Aug 24 02:03:49.781790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2136/3128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:49 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:49.792000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:49.804906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:49.817414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:49.818370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:49.819968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:49.820915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:49.821534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:49.822126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:49.989512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:50.002046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2220012-bb8b-42f2-8777-5f452489e15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.218694 Aug 24 02:03:50.018391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2137/3129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:49 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:50.024019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:50.024808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:50.034255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.035614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.036461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:50.039396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.040672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.041381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:50.203945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:50.213209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd6973ca-cc3f-4376-9801-6e1b2e64ef66 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1488 microversion: 2.1 time: 0.193286 Aug 24 02:03:50.213790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2138/3130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:50 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1488 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:50.228481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-080a21d6-e6a4-4010-a7c3-a0e9b63439b5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Action: 'update', calling method: .version_select at 0x7f6b9262ea60>, body: {"security_group": {"name": "tempest-sg-hth-1778916332", "description": "tempest-description-hth-1674586018"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:50.478217 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-080a21d6-e6a4-4010-a7c3-a0e9b63439b5 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa" status: 200 len: 218 microversion: 2.1 time: 0.255199 Aug 24 02:03:50.478833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2139/3131] 10.222.0.49 () {60 vars in 1290 bytes} [Wed Aug 24 02:03:50 2022] PUT /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa => generated 218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:50.490133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:50.490668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:50.500348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.500853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.505374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:50.506610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.507104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.507522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:50.553710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lazy-loading 'flavor' on Instance uuid d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:03:50.641661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99c01915-6b46-42eb-9b92-9309f7fe7b91 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.161365 Aug 24 02:03:50.646290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2140/3132] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:50 2022] POST /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:50.652601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8560e3a8-0405-4b68-afb6-0540e1840d12 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911fbaf0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:50.780596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8560e3a8-0405-4b68-afb6-0540e1840d12 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa" status: 200 len: 218 microversion: 2.1 time: 0.132761 Aug 24 02:03:50.781784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2141/3133] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:03:50 2022] GET /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa => generated 218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:50.788119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:50.789228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:50.799857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.800268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.800704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:50.801647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:50.802435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:50.803044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.009373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:51.019646 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e76ac5a2-7f45-48e5-9a83-9549a77eb2e0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1496 microversion: 2.1 time: 0.236505 Aug 24 02:03:51.037042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2142/3134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:50 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1496 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:51.042606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d121603-ffc5-48a3-a3c5-1bbcc1a287d8 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91578790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.272850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d121603-ffc5-48a3-a3c5-1bbcc1a287d8 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa" status: 202 len: 0 microversion: 2.1 time: 0.234521 Aug 24 02:03:51.273630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2143/3135] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:51 2022] DELETE /compute/v2.1/os-security-groups/3f263b19-86fd-4087-8bd4-e1223da8f1fa => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:51.278410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.279256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:51.289902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.290406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.290848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.291617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.292079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.292507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.448241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:51.466637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55e9c65d-9a7e-4a92-a779-52c6ca6def2d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.191773 Aug 24 02:03:51.467401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2144/3136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:51 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:51.472288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.473093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:51.479846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.480989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.481720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.482577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.483195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.484186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.742110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:51.752170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac239b0b-9f3c-44ff-9398-82c5812f65e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.283515 Aug 24 02:03:51.753863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2145/3137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:51 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:51.758734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.759393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:51.770168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.770947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.771399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.772113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.772569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.773609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.790046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c HTTP/1.1 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4e402c6b-8b19-4c9a-b236-222f3fc5707c'} Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:51.792170 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f136a1af-370d-4bd9-8e89-db33ece54c23 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 404 len: 111 microversion: 2.1 time: 0.038689 Aug 24 02:03:51.796602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2146/3138] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:51 2022] DELETE /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:51.809338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.810611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: 4e402c6b-8b19-4c9a-b236-222f3fc5707c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:51.824843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.825356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.825798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.826518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:51.826972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:51.827442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:51.856525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c HTTP/1.1 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4e402c6b-8b19-4c9a-b236-222f3fc5707c'} Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.858100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. Aug 24 02:03:51.862806 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.869144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Instance 4e402c6b-8b19-4c9a-b236-222f3fc5707c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:51.870058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6acb3967-5127-42ac-9a66-9d2d0a7fc6f9 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c" status: 404 len: 111 microversion: 2.1 time: 0.068525 Aug 24 02:03:51.870636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2147/3139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:51 2022] GET /compute/v2.1/servers/4e402c6b-8b19-4c9a-b236-222f3fc5707c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:03:51.879966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91869820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.917062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:51.917667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group 8a891ea7-8687-49d2-9b36-3981378942b0 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:51.918187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.918187 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0 HTTP/1.1 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8a891ea7-8687-49d2-9b36-3981378942b0'} Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:51.920193 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group 8a891ea7-8687-49d2-9b36-3981378942b0 does not exist Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-3e42bbcc-e33c-4fc0-b7bf-11326fa08b79'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-687ba192-cbbc-4def-86df-1bf2336633c6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0" status: 404 len: 194 microversion: 2.1 time: 0.046731 Aug 24 02:03:51.925438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2148/3140] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:51 2022] DELETE /compute/v2.1/os-security-groups/8a891ea7-8687-49d2-9b36-3981378942b0 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:03:51.930501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91578790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:51.962218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:51.964807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group ca85b3db-0c65-47fc-91a3-496e2ca70970 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:51.965304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.965304 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970 HTTP/1.1 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ca85b3db-0c65-47fc-91a3-496e2ca70970'} Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:51.969803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] Aug 24 02:03:51.974690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:51.979742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group ca85b3db-0c65-47fc-91a3-496e2ca70970 does not exist Aug 24 02:03:51.979742 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b1360136-7c07-4558-b045-92338bc5c122'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:51.979742 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44d8aa2a-d158-4b16-bf0e-d2041a8d6619 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970" status: 404 len: 194 microversion: 2.1 time: 0.052409 Aug 24 02:03:51.979742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2149/3141] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:51 2022] DELETE /compute/v2.1/os-security-groups/ca85b3db-0c65-47fc-91a3-496e2ca70970 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:03:51.991094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91953310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.026123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:52.026727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:52.027238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.027238 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46 HTTP/1.1 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fe92a491-8d72-4f3f-8173-bca4de1d0e46'} Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:52.029163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group fe92a491-8d72-4f3f-8173-bca4de1d0e46 does not exist Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-283fc124-690a-481d-a536-ae398d3059bf'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2910994-527c-47fe-b5f5-f6d9794b9dd7 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46" status: 404 len: 194 microversion: 2.1 time: 0.048086 Aug 24 02:03:52.036410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2150/3142] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:51 2022] DELETE /compute/v2.1/os-security-groups/fe92a491-8d72-4f3f-8173-bca4de1d0e46 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:52.047149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b911c8ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.082234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:52.082837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:52.083358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.083358 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61 HTTP/1.1 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f5040f7a-7429-46da-985a-a7a5ef3d7e61'} Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:52.085746 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group f5040f7a-7429-46da-985a-a7a5ef3d7e61 does not exist Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-a5f73ee3-b134-4140-b1bc-7549120d91e8'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29407e19-ec9d-4b4d-85a8-ffb5f917e497 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61" status: 404 len: 194 microversion: 2.1 time: 0.048687 Aug 24 02:03:52.090072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2151/3143] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:52 2022] DELETE /compute/v2.1/os-security-groups/f5040f7a-7429-46da-985a-a7a5ef3d7e61 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:52.095525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.096877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:52.103899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.104399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.105192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:52.106048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.106813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.107344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:52.113582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:52.282313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:52.292072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c83449aa-8524-4e12-9d6b-c0cbb063875c tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 200 len: 1479 microversion: 2.1 time: 0.202181 Aug 24 02:03:52.292894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2152/3144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:52 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 1479 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:52.298752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9168a040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.323446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:52.324245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group 4ffd9ac3-628d-490b-a572-5a144c68c45f not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:52.325342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.325342 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f HTTP/1.1 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4ffd9ac3-628d-490b-a572-5a144c68c45f'} Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:52.328153 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] Aug 24 02:03:52.332400 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.337658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group 4ffd9ac3-628d-490b-a572-5a144c68c45f does not exist Aug 24 02:03:52.337658 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-0f0da1b9-2e59-478e-9dcb-1df1cb217020'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:52.339440 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56fa88e3-1789-468d-aeee-736495ee5bb6 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f" status: 404 len: 194 microversion: 2.1 time: 0.044901 Aug 24 02:03:52.340555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2153/3145] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:52 2022] DELETE /compute/v2.1/os-security-groups/4ffd9ac3-628d-490b-a572-5a144c68c45f => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:52.349768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2041349711"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:52.353193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:52.362029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.362791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.363424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:52.364305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.364951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.365537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:52.720089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76de736f-4321-4e2d-abf6-7cef159053ed tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a/action" status: 202 len: 0 microversion: 2.1 time: 0.376442 Aug 24 02:03:52.723344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2154/3146] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:03:52 2022] POST /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:03:52.780298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b9168a4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.806985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:03:52.807843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Neutron security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:03:52.809404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.809404 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d HTTP/1.1 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a8456811-3c66-4eb4-a6b8-6b0b0455c35d'} Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:03:52.812210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] Aug 24 02:03:52.816648 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:52.821232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Security group a8456811-3c66-4eb4-a6b8-6b0b0455c35d does not exist Aug 24 02:03:52.821232 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-368e6ad8-7603-4805-8ef5-4af871655193'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:52.822437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d33d031d-dec2-4ce3-830b-7cb782ffc56d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d" status: 404 len: 194 microversion: 2.1 time: 0.096684 Aug 24 02:03:52.823320 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2155/3147] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:52 2022] DELETE /compute/v2.1/os-security-groups/a8456811-3c66-4eb4-a6b8-6b0b0455c35d => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:52.839199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:52.840460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:52.853485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.854743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.855422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:52.856417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:52.857262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:52.857899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:53.412812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:53.422579 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6f3a499-8295-43d9-98a1-41335c49b89d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.597852 Aug 24 02:03:53.424083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2156/3148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:52 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:53.430108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5dab055c-2299-4330-81e6-233540cfd701 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9168adc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:53.497398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5dab055c-2299-4330-81e6-233540cfd701 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.071681 Aug 24 02:03:53.498347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2157/3149] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:53 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:53.504483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:53.505141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:53.533160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:53.533869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:53.534323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:53.537314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:53.540601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:53.540601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.177423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:54.189714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5efa7cfd-0943-49cc-876b-929f29225c0a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.688198 Aug 24 02:03:54.190325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2158/3150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:53 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:54.194925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:54.195426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:54.217080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.220609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.221186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.221935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.222407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.222841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.294779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:03:54.517818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b828166-851e-4df1-af25-3aa673efe38d tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 204 len: 0 microversion: 2.1 time: 0.326200 Aug 24 02:03:54.521741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2159/3151] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:03:54 2022] DELETE /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:03:54.527355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:54.537694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:54.552185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.552991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.553589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.554464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.555075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.555768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.864661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:54.875723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aee8780b-af4d-4d31-b16a-c743d4697bb7 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.352462 Aug 24 02:03:54.879789 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2160/3152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:54 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:54.897814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dce4761b-6948-4c97-af64-c451e5d94d34 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91086310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:54.973367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dce4761b-6948-4c97-af64-c451e5d94d34 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.079164 Aug 24 02:03:54.974283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2161/3153] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:54 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:54.979406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:54.980489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:54.989212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.990272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.991312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:54.993687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:54.994499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:54.995314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:55.573782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:55.586874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58163599-3103-48ec-80ae-67f977721ed1 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1644 microversion: 2.1 time: 0.611153 Aug 24 02:03:55.587486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2162/3154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:54 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1644 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:55.604090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:55.604807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:55.619615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:55.620133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:55.625802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:55.628963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:55.629904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:55.630553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:56.009560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:56.024984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02a947a8-9b57-45eb-9c05-267ea3e40a5c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.436263 Aug 24 02:03:56.026101 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2163/3155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:55 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:56.044461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:56.048879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:56.070728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:56.071217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:56.071648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:56.072353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:56.077837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:56.078366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:56.562132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:56.574391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90f02cc1-3421-49a9-bad5-7c9179ad9d9d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.546715 Aug 24 02:03:56.575584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2164/3156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:56 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:56.583433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5b4ff37-99a0-4b09-82ae-139a1ed68376 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9109d9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:56.669804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5b4ff37-99a0-4b09-82ae-139a1ed68376 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.092836 Aug 24 02:03:56.677626 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2165/3157] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:56 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:56.695433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:56.696064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:56.712117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:56.712615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:56.713091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:56.713860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:56.714328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:56.716779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:57.101683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e317f2628594867bcb0d228ade52975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01be30d45d214564b7cc7bfdd1dc62ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:57.112128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-052312d4-fe28-4094-a906-8b55e9d0bd5b tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 200 len: 1644 microversion: 2.1 time: 0.433024 Aug 24 02:03:57.112682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2166/3158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:56 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 1644 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:57.117774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:57.118384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:57.125053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:57.125930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:57.126495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:57.127079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:57.127542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:57.127966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:57.358388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:57.370762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a255a68e-98b7-4296-ad11-b5893db19187 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.255133 Aug 24 02:03:57.371478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2167/3159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:57 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:57.385380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce129711-415a-481a-b5e1-7bb5c6643766", "name": "network-vif-deleted", "tag": "33b4ee25-9857-4059-97c3-9b2e9843c89f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:57.398108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:57.398851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:57.400516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:57.414943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] Creating event network-vif-deleted:33b4ee25-9857-4059-97c3-9b2e9843c89f for instance ce129711-415a-481a-b5e1-7bb5c6643766 on n-h2-854121-3 Aug 24 02:03:57.423208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7adbd835-5294-4ba7-90cb-72c668ad5fb5 req-8262030f-40d6-427a-9e77-0b6c37618d39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050262 Aug 24 02:03:57.424059 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2168/3160] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:57.627291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-385455111", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:57.704278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] validate_networks() for [('30e86740-4996-47ef-99e3-15e8e35a9ea8', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:03:58.243844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:03:58.244272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:03:58.246952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:03:58.247599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:03:58.248214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:03:58.264626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.265444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.266967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.268129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.268845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.269506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.298087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Getting quotas for project 5e98b31cc1014012919433e2384b0faa. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:03:58.305708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Getting quotas for user 19fff72b924c4a3db933097f93eb0d15 and project 5e98b31cc1014012919433e2384b0faa. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:03:58.321371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:03:58.324085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:03:58.375841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eaf59946-01e1-4a75-a876-7b8aa9b41d32 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942918 Aug 24 02:03:58.376469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2169/3161] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:03:58.381335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:58.382326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:58.392001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.392989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.393656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.394631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.395562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.396324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.607505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:58.616696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1d68947-a8b0-46d2-98dd-f824100ed995 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.239032 Aug 24 02:03:58.617813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2170/3162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:58 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:58.623528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fe833a8-b0ae-4785-8c66-1eff5b1758e6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91767040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:58.672644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fe833a8-b0ae-4785-8c66-1eff5b1758e6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.053634 Aug 24 02:03:58.674044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2171/3163] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:03:58 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:58.684749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:58.685373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] [instance: ce129711-415a-481a-b5e1-7bb5c6643766] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:58.698677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.699357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.700180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.701296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.701886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.703031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.734289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] HTTP exception thrown: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Request method failure captured: Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 HTTP/1.1 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYaYsMkNzX-YnUj3tR6fML_8_VMQE-y2J89eB8YUbLp7PudAqw-kLDEBp0HUey-fyKNMpnseBWrE4eMf_Dlwa9l4HsSVwqyGuJ2MEhVahfxfjii_L3KKi15fT4Gkw7DjB9adQhdmkei9RlShhXdp22BMpYEHzWuTfqcA-rD6U6x6W5k Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_01be30d45d214564b7cc7bfdd1dc62ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 01be30d45d214564b7cc7bfdd1dc62ff Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-956048741 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2e317f2628594867bcb0d228ade52975 Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsTestJSON-956048741-project Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ce129711-415a-481a-b5e1-7bb5c6643766'} Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:03:58.737547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Returning 404 to user: Instance ce129711-415a-481a-b5e1-7bb5c6643766 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64dc5d5b-7ebb-4c1e-a4d1-7b5125584000 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766" status: 404 len: 111 microversion: 2.1 time: 0.064389 Aug 24 02:03:58.742737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2172/3164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:58 2022] GET /compute/v2.1/servers/ce129711-415a-481a-b5e1-7bb5c6643766 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:03:58.751044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a", "name": "network-vif-plugged", "status": "completed", "tag": "9dfd45e0-4dbc-4d19-9866-05b95dc8bb76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:03:58.762396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.763476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.764004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.777706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] Creating event network-vif-plugged:9dfd45e0-4dbc-4d19-9866-05b95dc8bb76 for instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a on n-h2-854121-3 Aug 24 02:03:58.783907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-132ceb01-f82e-4ba8-8b1e-d028b3e73a42 req-f083eccd-796a-4b41-93a5-db6632ebf5a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042151 Aug 24 02:03:58.784870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2173/3165] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:03:58.790389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ec4d3ad-0d80-44d8-b1ec-7f06312e5f40 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:58.791095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ec4d3ad-0d80-44d8-b1ec-7f06312e5f40 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:58.878184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ec4d3ad-0d80-44d8-b1ec-7f06312e5f40 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:58.889083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ec4d3ad-0d80-44d8-b1ec-7f06312e5f40 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1223 microversion: 2.1 time: 0.102181 Aug 24 02:03:58.891880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2174/3166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:58 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:58.913375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:58.915422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:58.930620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.933993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.934794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:58.936989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:58.939229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:58.979612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:03:59.170291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:03:59.183335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ea77319-7627-42bd-9a16-aed8e3ee8ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.288615 Aug 24 02:03:59.184301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2175/3167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:58 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:03:59.195176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b077219-cbe2-4d23-8954-1702e208af0c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b925ae550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:59.432865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b077219-cbe2-4d23-8954-1702e208af0c tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/8239d7dd-d435-4670-91ec-da3bee223e2d" status: 202 len: 0 microversion: 2.1 time: 0.247349 Aug 24 02:03:59.434025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2176/3168] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:59 2022] DELETE /compute/v2.1/os-security-groups/8239d7dd-d435-4670-91ec-da3bee223e2d => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:03:59.445567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-575c494c-48b7-456f-ae8e-8940dc2c6ff8 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] Calling method '.version_select at 0x7f6b91767ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:59.770956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-575c494c-48b7-456f-ae8e-8940dc2c6ff8 tempest-SecurityGroupsTestJSON-956048741 tempest-SecurityGroupsTestJSON-956048741-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/28a6252e-927d-4dec-babc-3f850466a2e5" status: 202 len: 0 microversion: 2.1 time: 0.330678 Aug 24 02:03:59.771516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2177/3169] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:03:59 2022] DELETE /compute/v2.1/os-security-groups/28a6252e-927d-4dec-babc-3f850466a2e5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:03:59.776749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:03:59.777419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:03:59.792310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:59.793169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:59.793849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:03:59.794749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:03:59.795414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:03:59.796965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:00.019868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:00.029864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e42951d-24b1-44d5-b76e-bffbdc94720f tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.257270 Aug 24 02:04:00.034201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2178/3170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:03:59 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:00.058153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b28e2eae-ba1c-48ee-a864-63c479a548f9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b916abb80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:00.183077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b28e2eae-ba1c-48ee-a864-63c479a548f9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.147383 Aug 24 02:04:00.200292 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2179/3171] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:00 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:00.208182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:00.208460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:00.247516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:00.248029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:00.248573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:00.255780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:00.256347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:00.258976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:00.448291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:00.464142 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e95cecd-089d-4159-be60-fce29c063090 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1275 microversion: 2.1 time: 0.269868 Aug 24 02:04:00.464917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2180/3172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:00 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:00.470766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:00.471513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:00.478061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:00.478668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:00.479205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:00.480016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:00.480573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:00.481325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:01.029555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:01.039682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7c724c9-9eda-4089-b9f2-0ab97872e88e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.573623 Aug 24 02:04:01.043271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2181/3173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:00 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:01.055734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586c4759-844f-4fae-9c7c-03d17b3115ee", "name": "network-vif-plugged", "status": "completed", "tag": "f028dde8-f39d-469d-8ffb-a0948dcc47e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:01.087580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:01.088604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:01.094958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:01.123436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] Creating event network-vif-plugged:f028dde8-f39d-469d-8ffb-a0948dcc47e3 for instance 586c4759-844f-4fae-9c7c-03d17b3115ee on n-h1-854121-3 Aug 24 02:04:01.140131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-80c4107e-ca87-4a3f-bf0c-3ded3691094b req-1a540c02-25f5-4503-a5bf-62c67de5184f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088032 Aug 24 02:04:01.141075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2182/3174] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:01.159638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:01.160750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:01.169434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:01.170302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:01.171760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:01.172708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:01.173430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:01.174073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:01.706876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:01.726418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fa7b376-af28-41d4-b921-1347782b7d68 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.582094 Aug 24 02:04:01.727205 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2183/3175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:01 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:01.738217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28f45bb7-2ed6-4b73-8b82-589875bfbb27 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b918be0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:01.850883 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28f45bb7-2ed6-4b73-8b82-589875bfbb27 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.122379 Aug 24 02:04:01.852259 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2184/3176] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:01 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:01.867036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:01.867675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:01.884125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:01.884639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:01.885141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:01.891348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:01.892235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:01.892871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:02.083918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:02.094436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9135f0d8-49d4-4176-a190-7b03d700c9ae tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1281 microversion: 2.1 time: 0.238683 Aug 24 02:04:02.099490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2185/3177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:01 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1281 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:02.113330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:02.114210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:02.131563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:02.132272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:02.132906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:02.139688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:02.143230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:02.143926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:02.463889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:02.475251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a46430c-586d-43f4-b4ef-2f097c70d6dd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.374300 Aug 24 02:04:02.491730 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2186/3178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:02 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:02.759132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:02.760360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:02.773459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:02.775884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:02.776575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:02.779827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:02.782679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:02.784029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:03.185922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:03.211951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8ef3250-8e01-486c-9574-db2e091c4bc5 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1293 microversion: 2.1 time: 0.465030 Aug 24 02:04:03.225894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2187/3179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:02 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1293 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:03.239942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41ce0f35-812b-41cd-a168-bb424b21048f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91869c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:03.337870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41ce0f35-812b-41cd-a168-bb424b21048f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.109751 Aug 24 02:04:03.339557 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2188/3180] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:03 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:03.359955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:03.361071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:03.390548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:03.391265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:03.391915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:03.393783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:03.394436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:03.395051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:03.718956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:03.729876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3875f61b-94b9-46a7-bfee-e2da915fa756 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.385885 Aug 24 02:04:03.730727 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2189/3181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:03 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:03.743943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:03.743943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:03.759899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:03.762260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:03.765078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:03.769577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:03.772508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:03.773009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:03.964389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:03.975621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8a2c654-96a8-4c21-afde-8242c6da87de tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.241441 Aug 24 02:04:03.976234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2190/3182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:03 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:04.239378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:04.239988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:04.245789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:04.247216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:04.247712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:04.248187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:04.255211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:04.256164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:04.256764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.203275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:05.220020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-709212bf-c034-42f5-9c09-ba38b000e294 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1483 microversion: 2.1 time: 0.988232 Aug 24 02:04:05.222313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2191/3183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:04 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1483 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:05.250733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:05.258391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:05.274391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.275313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.276111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.277040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.277656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.278241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.323151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ee5aaa8-f74a-4826-9d10-f02abc84f29f tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099391 Aug 24 02:04:05.324354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2192/3184] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:04:05 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:05.330390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f943b045-9f51-4b51-a23e-9a4771be81f6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9167faf0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:05.422958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f943b045-9f51-4b51-a23e-9a4771be81f6 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.096980 Aug 24 02:04:05.423554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2193/3185] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:05 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:05.437564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:05.441381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:05.456586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.459881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.460347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.461133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.461624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.468848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.698727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:05.711828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b4ffc56-3e5b-4da7-a88f-4e79c3843a03 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.286299 Aug 24 02:04:05.714000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2194/3186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:05 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:05.728204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:05.729218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:05.749283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.750076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.750696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:05.751602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:05.752264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:05.752967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.101075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:06.113887 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ceeedaf-101b-4ba9-8d7a-65c52820c15a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.398617 Aug 24 02:04:06.114496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2195/3187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:05 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:06.126246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bd1b01-7630-4db7-b8c8-bb794fec46b5", "tag": "8eb015a5-c6d0-4ab6-a8ce-7f697831735e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:06.149421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:06.149903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:06.150324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.190488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] Creating event network-changed:8eb015a5-c6d0-4ab6-a8ce-7f697831735e for instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 on n-h2-854121-3 Aug 24 02:04:06.212294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-134804ec-9b29-4245-9651-f1ab844df186 req-ed15bd9f-5c0a-47fd-bcc3-d75af3ed128c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096248 Aug 24 02:04:06.213239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2196/3188] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:06.221305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:06.222231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:06.231443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:06.232265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:06.232980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.233994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:06.234674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:06.235314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.541087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3349a9ec-f1a8-427c-86b4-b6b2491539f9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.326342 Aug 24 02:04:06.541708 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2197/3189] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:04:06 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:06.547755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:06.548544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:06.561936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:06.565422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:06.567507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.568508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:06.571763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:06.572435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:06.757527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lazy-loading 'services' on Instance uuid 369425a8-ad82-4f7d-96be-266689912a83 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:04:06.926261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa6acf08-eb73-45dd-a929-13ad06824882 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments/e5db6a6b-dd22-48f0-997d-2e2fe02a58e1" status: 202 len: 0 microversion: 2.1 time: 0.383025 Aug 24 02:04:06.927475 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2198/3190] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:04:06 2022] DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments/e5db6a6b-dd22-48f0-997d-2e2fe02a58e1 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:04:06.960891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2748def0-b687-497d-ba47-981a558ce675 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b92482e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:07.032548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2748def0-b687-497d-ba47-981a558ce675 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.103560 Aug 24 02:04:07.040858 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2199/3191] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:06 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:07.062457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:07.063544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:07.076534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:07.077126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:07.077565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:07.078403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:07.078859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:07.079282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:07.106382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:07.480795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:07.495527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf54e073-a84f-42b1-9faf-a3c58feeebb8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.452667 Aug 24 02:04:07.496764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2200/3192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:07 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:07.505643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:07.512128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:07.523641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:07.524400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:07.525080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:07.526177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:07.526892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:07.527542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:08.162310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:08.172178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7d1e032-f8cb-4341-a6f9-1fe32af61b4b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.674094 Aug 24 02:04:08.193422 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2201/3193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:07 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:08.254665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed5f8ff9-6954-4b78-a8ac-e0c2d80946d8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b911aa940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:08.285283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:08.382425 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed5f8ff9-6954-4b78-a8ac-e0c2d80946d8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.187785 Aug 24 02:04:08.392706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2202/3194] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:08 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:08.520132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:08.521599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:08.532752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:08.542839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:08.543566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:08.549430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:08.550245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:08.553384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:08.887932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:09.570814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:09.611220 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d74d52c4-93f2-4930-9d19-0e642cd71ad5 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 1.091972 Aug 24 02:04:09.613409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2203/3195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:08 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:09.635951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:09.645268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:09.668021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:09.671954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:09.673546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:09.675019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:09.677661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:09.678327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:10.297933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:10.317431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef9c6dea-df76-4d92-b70b-346903271d4f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1515 microversion: 2.1 time: 0.694805 Aug 24 02:04:10.318110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2204/3196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:09 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1515 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:10.343899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f00e11e5-b292-425e-81a0-b245e7c8754e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9168a160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:10.482192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f00e11e5-b292-425e-81a0-b245e7c8754e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.162989 Aug 24 02:04:10.485971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2205/3197] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:10 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:10.507115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:10.508319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:10.537755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:10.540070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:10.557121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:10.564103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:10.565299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:10.568093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.017620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:11.040241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41b1fce7-97f2-4031-bc07-d4c3f446d895 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1483 microversion: 2.1 time: 0.552855 Aug 24 02:04:11.041086 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2206/3198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:10 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1483 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:11.055047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586c4759-844f-4fae-9c7c-03d17b3115ee", "tag": "f028dde8-f39d-469d-8ffb-a0948dcc47e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:11.089519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:11.093125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:11.096085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.138155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] Creating event network-changed:f028dde8-f39d-469d-8ffb-a0948dcc47e3 for instance 586c4759-844f-4fae-9c7c-03d17b3115ee on n-h1-854121-3 Aug 24 02:04:11.151584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-67cb3daf-6a4c-4cb5-b36d-e0e68736486f req-409fb2dc-e27e-4938-8e06-69f6bc6005c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108518 Aug 24 02:04:11.156172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2207/3199] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:11.164648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:11.174048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:11.190612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:11.193829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:11.194616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.196882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:11.200253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:11.200970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.581112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:11.591037 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01b0fa5b-af93-4b3a-8714-1fb6653f2b83 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.430788 Aug 24 02:04:11.592278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2208/3200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:11 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:11.611782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:11.612837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:11.625831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:11.626755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:11.627410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.628642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:11.629432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:11.630076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:11.946095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:11.955821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a48342b0-0c0d-4451-b49f-08961edad6f8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.361898 Aug 24 02:04:11.957272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2209/3201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:11 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:11.963426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c1b1daa-1972-41df-8521-102a3f347e02 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b924991f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:12.036111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c1b1daa-1972-41df-8521-102a3f347e02 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.077548 Aug 24 02:04:12.048301 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2210/3202] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:11 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:12.203792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bd1b01-7630-4db7-b8c8-bb794fec46b5", "name": "network-vif-plugged", "status": "completed", "tag": "8eb015a5-c6d0-4ab6-a8ce-7f697831735e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:12.227272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:12.227801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:12.229649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:12.253683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] Creating event network-vif-plugged:8eb015a5-c6d0-4ab6-a8ce-7f697831735e for instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 on n-h2-854121-3 Aug 24 02:04:12.259032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a2b3aa63-388b-45eb-92d6-b419b6e50c62 req-5a4f3349-3f83-4b2d-afb6-0d82e9c9f05d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059359 Aug 24 02:04:12.260005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2211/3203] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:12.612879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:12.613594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:12.623805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:12.624301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:12.624770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:12.625505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:12.626039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:12.626366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:12.875386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:12.912161 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee58690d-ea97-49cc-bb36-74aac3e2a2e6 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.302547 Aug 24 02:04:12.930672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2212/3204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:12 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:12.984073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:12.984701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:13.003932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:13.004357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:13.004826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:13.011373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:13.011770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:13.017066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:13.295129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:13.311782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58cb55e2-8c19-4c35-86b9-f5699b916e9f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.327394 Aug 24 02:04:13.313787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2213/3205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:12 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:13.326816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e78e0723-b8d7-494e-86ca-59d2b56a4000 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91953550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:13.440323 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e78e0723-b8d7-494e-86ca-59d2b56a4000 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.124286 Aug 24 02:04:13.441196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2214/3206] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:13 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:13.938557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:13.939499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:13.961324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:13.971819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:13.972546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:13.975113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:13.978014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:13.979727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:14.503715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:14.519623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c533c7a9-2afc-46e8-941a-618bf50dce1d tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1323 microversion: 2.1 time: 0.585318 Aug 24 02:04:14.521969 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2215/3207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:13 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1323 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:14.532329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb885c1-58d5-4cde-8fe5-90ebaf803680", "name": "network-vif-unplugged", "status": "completed", "tag": "3d44391e-b0ad-47ce-a148-bdaa183fd54b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:14.586422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:14.587341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:14.590249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:14.642894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] Creating event network-vif-unplugged:3d44391e-b0ad-47ce-a148-bdaa183fd54b for instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 on n-h1-854121-3 Aug 24 02:04:14.656322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2a88c238-f924-4335-bd25-6bf938b925b1 req-71c9c5ae-3fe6-47a1-84cf-010933b5db6e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130400 Aug 24 02:04:14.659964 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2216/3208] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:14.674984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:14.678572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:14.708303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:14.709280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:14.709932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:14.713862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:14.714655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:14.715311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:15.194044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:15.210676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3de5a2b-2d5f-4976-b267-fed04b037950 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.549077 Aug 24 02:04:15.218121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2217/3209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:14 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:15.258846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11c5723b-f101-4258-91d4-81d1a18784ec tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b918539d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:15.364183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11c5723b-f101-4258-91d4-81d1a18784ec tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.131088 Aug 24 02:04:15.376743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2218/3210] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:15 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:15.554056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:15.561062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:15.598465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:15.602243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:15.605256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:15.609099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:15.610342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:15.611574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:16.120344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:16.132412 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2bc2927-ee27-4018-b15f-89b074321c0e tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1518 microversion: 2.1 time: 0.588332 Aug 24 02:04:16.151984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2219/3211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:15 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1518 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:16.253443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:16.254492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:16.264264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:16.265422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:16.269513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:16.271916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:16.272988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:16.274700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:16.669191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:16.706798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33dc49c2-6a94-43a9-9f4f-18836dc46fbe tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.466500 Aug 24 02:04:16.732380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2220/3212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:16 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:16.739528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f19068bd-1e02-4923-8e9c-cd76bcfde405 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b925ae0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:16.835830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f19068bd-1e02-4923-8e9c-cd76bcfde405 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.100993 Aug 24 02:04:16.836690 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2221/3213] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:16 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:16.853014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39843365-5698-411b-a3c3-ad9ca56fe188 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1443324375", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39843365-5698-411b-a3c3-ad9ca56fe188 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 243 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1443324375", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1443324375', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '30e86740-4996-47ef-99e3-15e8e35a9ea8'}]}}} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:16.859429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:16.864423 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.872462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39843365-5698-411b-a3c3-ad9ca56fe188 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:16.873917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39843365-5698-411b-a3c3-ad9ca56fe188 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.034457 Aug 24 02:04:16.874983 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2222/3214] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:16 2022] POST /compute/v2.1/servers => generated 175 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:04:16.888455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:16.890975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 159ba5e1-68d2-42de-aa72-9bf67a6beb4f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:16.900482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] HTTP exception thrown: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/159ba5e1-68d2-42de-aa72-9bf67a6beb4f/metadata HTTP/1.1 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '159ba5e1-68d2-42de-aa72-9bf67a6beb4f'} Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:16.909629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 404 to user: Instance 159ba5e1-68d2-42de-aa72-9bf67a6beb4f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11ba4262-e531-41ad-8525-2d30173c4d44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/159ba5e1-68d2-42de-aa72-9bf67a6beb4f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.029709 Aug 24 02:04:16.914309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2223/3215] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:04:16 2022] GET /compute/v2.1/servers/159ba5e1-68d2-42de-aa72-9bf67a6beb4f/metadata => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:04:17.237476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c6fde28-01fd-4f4f-bab3-c19aa0a5e74c tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-363553578", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c6fde28-01fd-4f4f-bab3-c19aa0a5e74c tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 498 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-363553578", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-363553578', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '30e86740-4996-47ef-99e3-15e8e35a9ea8'}]}}} Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:04:17.242253 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.245844 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.250029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c6fde28-01fd-4f4f-bab3-c19aa0a5e74c tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:17.261419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c6fde28-01fd-4f4f-bab3-c19aa0a5e74c tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.032817 Aug 24 02:04:17.271760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2224/3216] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:17 2022] POST /compute/v2.1/servers => generated 687 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:04:17.359685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4db98243-e1a9-4af2-8545-75c4cd4cefb2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-149029736", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4db98243-e1a9-4af2-8545-75c4cd4cefb2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 499 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-149029736", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-149029736', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '30e86740-4996-47ef-99e3-15e8e35a9ea8'}]}}} Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:04:17.366862 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.370486 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.375456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4db98243-e1a9-4af2-8545-75c4cd4cefb2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:17.376859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4db98243-e1a9-4af2-8545-75c4cd4cefb2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022174 Aug 24 02:04:17.389955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2225/3217] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:17 2022] POST /compute/v2.1/servers => generated 689 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 02:04:17.484668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1acb83d4-e3b2-4d7a-91fd-b2e55be72355 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1503697459", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1acb83d4-e3b2-4d7a-91fd-b2e55be72355 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 754 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1503697459", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1503697459', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '30e86740-4996-47ef-99e3-15e8e35a9ea8'}]}}} Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:04:17.490007 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:04:17.492578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:04:17.495006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.495006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.495006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1acb83d4-e3b2-4d7a-91fd-b2e55be72355 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:17.495006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1acb83d4-e3b2-4d7a-91fd-b2e55be72355 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014552 Aug 24 02:04:17.508320 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2226/3218] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:17 2022] POST /compute/v2.1/servers => generated 1197 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 24 02:04:17.599656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5996d5e3-5ae9-4f13-9cdb-e069bd552b64 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-934044666", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5996d5e3-5ae9-4f13-9cdb-e069bd552b64 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 1265 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-934044666", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "30e86740-4996-47ef-99e3-15e8e35a9ea8"}]}} Aug 24 02:04:17.606334 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-934044666', 'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '30e86740-4996-47ef-99e3-15e8e35a9ea8'}]}}} Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.615383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:04:17.622438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5996d5e3-5ae9-4f13-9cdb-e069bd552b64 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5996d5e3-5ae9-4f13-9cdb-e069bd552b64 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.012507 Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2227/3219] 10.222.0.49 () {60 vars in 1148 bytes} [Wed Aug 24 02:04:17 2022] POST /compute/v2.1/servers => generated 2221 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 24 02:04:17.629674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:17.630206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:17.638012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:17.638521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:17.647555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:17.648210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:17.648693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:17.652000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:17.745025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d22c1ec-9255-4fea-8e71-b70b25434cb1 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135057 Aug 24 02:04:17.746622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2228/3220] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:04:17 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:04:17.763124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:17.764731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 1576e553-16ed-483a-b9b2-d0e719480f50] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:17.771199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] HTTP exception thrown: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1576e553-16ed-483a-b9b2-d0e719480f50/metadata/test2 HTTP/1.1 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '1576e553-16ed-483a-b9b2-d0e719480f50', 'id': 'test2'} Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:17.773110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:17.777143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:17.777143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:17.777143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. Aug 24 02:04:17.777143 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:17.779120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 404 to user: Instance 1576e553-16ed-483a-b9b2-d0e719480f50 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:17.781001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e82d69b-b1f4-4bdb-8a41-057b97864c44 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/1576e553-16ed-483a-b9b2-d0e719480f50/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024714 Aug 24 02:04:17.783441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2229/3221] 10.222.0.49 () {58 vars in 1281 bytes} [Wed Aug 24 02:04:17 2022] GET /compute/v2.1/servers/1576e553-16ed-483a-b9b2-d0e719480f50/metadata/test2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:04:17.801402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:17.804426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:17.821894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:17.822943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:17.824282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:17.825573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:17.826294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:17.828138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.176709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:18.188526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec7765e-c30c-48af-862a-d6a962a4ba27 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.394583 Aug 24 02:04:18.190213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2230/3222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:17 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:18.207450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:18.208213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:18.222582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.223569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.224311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.227335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.230745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.233402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.319076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:04:18.328935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:18.543282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fad9370f-eb42-4546-ad72-cc42cb70b8f2 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "DELETE /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 204 len: 0 microversion: 2.1 time: 0.349948 Aug 24 02:04:18.547604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2231/3223] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:18 2022] DELETE /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:18.552171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11078b9b-eda3-4039-b347-ae14344485ab tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9241c1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:18.642185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11078b9b-eda3-4039-b347-ae14344485ab tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.095482 Aug 24 02:04:18.645727 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2232/3224] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:18 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:18.653651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:18.658569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:18.667431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.668334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.669073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.670020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.670633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.671167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.710093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f37fc3c-bead-4dc9-983a-1cb7a67943fc tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062932 Aug 24 02:04:18.711269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2233/3225] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:04:18 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:04:18.726678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:18.727618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:18.756224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.757694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.759233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:18.760149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:18.761994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:18.763106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.001514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:19.010547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7668a264-329f-4cd6-bb3a-37b3788f3adf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1524 microversion: 2.1 time: 0.292699 Aug 24 02:04:19.013749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2234/3226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:18 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1524 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:19.037511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:19.039638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:19.054386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.056430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.057066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.057812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.058276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.058711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.092991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:04:19.277230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14292581-9ce4-4b2a-a87f-21d7010701b4 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 204 len: 0 microversion: 2.1 time: 0.261054 Aug 24 02:04:19.278373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2235/3227] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:19 2022] DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:19.284507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb885c1-58d5-4cde-8fe5-90ebaf803680", "name": "network-vif-plugged", "status": "completed", "tag": "3d44391e-b0ad-47ce-a148-bdaa183fd54b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:19.305677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.306398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.307058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.323862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] Creating event network-vif-plugged:3d44391e-b0ad-47ce-a148-bdaa183fd54b for instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 on n-h1-854121-3 Aug 24 02:04:19.351911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-00133dd9-dee9-4ac2-87ee-15136353b873 req-7192ab09-332d-4141-b21c-28d183408076 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070866 Aug 24 02:04:19.352905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2236/3228] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:19.358491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:19.359157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:19.367458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.368055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.368785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.369583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.370117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.370635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.666856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:19.682720 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5bfff0c1-c57c-434c-91b8-09d08c2212fb tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.328451 Aug 24 02:04:19.685408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2237/3229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:19 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:19.703599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:19.708020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:19.729654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.731052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.732349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:19.732617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:19.733343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:19.733934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:20.188257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:20.197293 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c427209-d8fb-4ae6-b4f7-6fb3b7dffda3 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1681 microversion: 2.1 time: 0.508008 Aug 24 02:04:20.202302 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2238/3230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:19 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1681 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:20.214106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8beb192b-3dbc-4b30-ba36-63631205fee4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b92a004c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:20.330219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8beb192b-3dbc-4b30-ba36-63631205fee4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.119873 Aug 24 02:04:20.332813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2239/3231] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:20 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:20.340040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:20.343312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:20.372063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:20.378227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:20.380039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:20.381042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:20.384461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:20.385323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:20.693788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:20.706151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f50ea012-bc13-480e-bfeb-7cb485ab23cf tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1524 microversion: 2.1 time: 0.371855 Aug 24 02:04:20.713050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2240/3232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:20 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1524 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:20.722310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:20.725504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:20.738013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:20.741375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:20.742098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:20.743037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:20.745792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:20.746445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:21.147621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:21.157117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf94809e-5991-4026-b872-63fbe6684a30 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.442624 Aug 24 02:04:21.163159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2241/3233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:20 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:21.170717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bd1b01-7630-4db7-b8c8-bb794fec46b5", "name": "network-vif-deleted", "tag": "8eb015a5-c6d0-4ab6-a8ce-7f697831735e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:21.216559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:21.244515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:21.245103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:21.287059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] Creating event network-vif-deleted:8eb015a5-c6d0-4ab6-a8ce-7f697831735e for instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 on n-h2-854121-3 Aug 24 02:04:21.300027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bb8a4716-b760-4277-b5e2-74b0ea3524fc req-6bb0347e-efe6-4b3f-bbcd-fcf13495f895 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135413 Aug 24 02:04:21.302512 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2242/3234] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:21.332457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:21.334159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:21.351658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:21.352159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:21.352776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:21.353565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:21.354029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:21.354500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:22.195663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:22.210725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f65af4e-6b4b-4d97-9912-d1dd95b91058 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1681 microversion: 2.1 time: 0.907035 Aug 24 02:04:22.212082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2243/3235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:21 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1681 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:22.221987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09dce3dc-d079-4227-8f87-f396260de060 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91853940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:22.361508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09dce3dc-d079-4227-8f87-f396260de060 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1440 microversion: 2.1 time: 0.148015 Aug 24 02:04:22.372115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2244/3236] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:22 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1440 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:22.379910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:22.380925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:22.390684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:22.393870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:22.394666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:22.396388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:22.397171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:22.397891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:22.471286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:22.473790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:22.477412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:22.478165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lazy-loading 'fault' on Instance uuid 86bd1b01-7630-4db7-b8c8-bb794fec46b5 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:04:22.572133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fff72b924c4a3db933097f93eb0d15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e98b31cc1014012919433e2384b0faa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:22.583185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4d70072-0e5b-4b15-acdf-763124fd0741 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 200 len: 1313 microversion: 2.1 time: 0.208137 Aug 24 02:04:22.589324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2245/3237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:22 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:22.596901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:22.597558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:22.620272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:22.624105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:22.626967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:22.627727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:22.628188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:22.632813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:23.110523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:23.125690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bc68a36-376e-4924-93b7-4ecad00ef635 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1521 microversion: 2.1 time: 0.535129 Aug 24 02:04:23.129576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2246/3238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:22 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:23.237958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:23.239257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:23.245831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:23.246321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:23.246757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:23.247464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:23.247917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:23.248377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:23.544011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd501b317174afcbfdfe4cedadc6b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '448f19d0920242d2a897f4c7b992f703', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:23.556255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-401b094d-d2e3-42ea-908b-48d14dce01fb tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 200 len: 1681 microversion: 2.1 time: 0.322745 Aug 24 02:04:23.557295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2247/3239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:23 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:23.564327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-506fc76c-faa6-41cc-b72c-cc3517b7880a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b91756a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:23.642069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-506fc76c-faa6-41cc-b72c-cc3517b7880a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1449 microversion: 2.1 time: 0.083359 Aug 24 02:04:23.642817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2248/3240] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:23 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1449 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:23.648925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:23.650092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] [instance: 86bd1b01-7630-4db7-b8c8-bb794fec46b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:23.661239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:23.662141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:23.662979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:23.663960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:23.665033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:23.666236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:23.705998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] HTTP exception thrown: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Request method failure captured: Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 HTTP/1.1 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcNDbBRnkCYvYXB_NQb4T0iXyVvCNGaPUOAZbYrmYDvsoT-bMZRRQEYLPMpjKbpUFhKCs2ZvSPs6nY3Frda_b4_7MH_38eclGtwREOmka_fNkvZZkCGSSN-3_r7zTTzIlmvL-_d1ModYtb8Nlcu4vSm8nYfsy5bZ5KJmL-5ziz7tSs Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5e98b31cc1014012919433e2384b0faa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5e98b31cc1014012919433e2384b0faa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5e98b31cc1014012919433e2384b0faa Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1462524596 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19fff72b924c4a3db933097f93eb0d15 Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1462524596-project Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '86bd1b01-7630-4db7-b8c8-bb794fec46b5'} Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:23.710013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] Returning 404 to user: Instance 86bd1b01-7630-4db7-b8c8-bb794fec46b5 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:23.714867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec476d6-98e2-4206-ac99-fadfd36e75a8 tempest-ServerMetadataNegativeTestJSON-1462524596 tempest-ServerMetadataNegativeTestJSON-1462524596-project] 10.222.0.49 "GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5" status: 404 len: 111 microversion: 2.1 time: 0.068525 Aug 24 02:04:23.716020 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2249/3241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:23 2022] GET /compute/v2.1/servers/86bd1b01-7630-4db7-b8c8-bb794fec46b5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:04:23.725919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e2e55d0-f581-47d0-800f-6a5c1cdc770a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9192f9d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:23.853272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e2e55d0-f581-47d0-800f-6a5c1cdc770a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 200 len: 1449 microversion: 2.1 time: 0.134773 Aug 24 02:04:23.855043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2250/3242] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:23 2022] GET /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 1449 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:23.872965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1a8e8cf-81da-4dcf-ae25-2dc21d4b8668 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9251e940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:24.978429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1a8e8cf-81da-4dcf-ae25-2dc21d4b8668 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 204 len: 0 microversion: 2.1 time: 1.109051 Aug 24 02:04:24.980429 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2251/3243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:23 2022] DELETE /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:04:24.987437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369425a8-ad82-4f7d-96be-266689912a83", "name": "network-vif-deleted", "tag": "a4715124-541c-4d5c-8596-108ce5262f71"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:25.005086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.006013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.006611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.018670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] Creating event network-vif-deleted:a4715124-541c-4d5c-8596-108ce5262f71 for instance 369425a8-ad82-4f7d-96be-266689912a83 on n-h1-854121-3 Aug 24 02:04:25.026247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-894993d7-a97c-45e8-bee2-db9a039d7403 req-2f9c4f27-7221-4fa2-8ed2-e0643c3a97a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043741 Aug 24 02:04:25.030297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2252/3244] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:25.036781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:25.038035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:25.042100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:25.047172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.047874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.048512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.049584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.050255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.050938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.076115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:25.453784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:25.462851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-605c80a2-c8a7-48f2-9d88-cdeaf8dedf42 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1506 microversion: 2.1 time: 0.430881 Aug 24 02:04:25.464120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2253/3245] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:25 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:25.470821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:25.472080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:25.479296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.480511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.481254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.482372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.483092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.486202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.527135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] HTTP exception thrown: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Request method failure captured: Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 HTTP/1.1 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZxuq4OeRmCXEu9vMKj8XfUYal2GKFCG6jH8Ep1JarplaQRoTiuaVVfeQBXhHAU9Wz0A3adOGgMkWBUlBwGFAe6ubi-3EJ3i8Li6k7eQuZug9qvcc5-kVlkaO7pKLdnpgOxq0DGekp6MJx6IFsjIMoHdZ_tg2FaWyVEgbOOVMx-Ck0 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_448f19d0920242d2a897f4c7b992f703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: dcd501b317174afcbfdfe4cedadc6b0b Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '369425a8-ad82-4f7d-96be-266689912a83'} Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:25.528955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:25.534972 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:25.555702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Returning 404 to user: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:25.561667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-796d8973-b848-4914-992c-31e8eb026416 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 404 len: 111 microversion: 2.1 time: 0.095443 Aug 24 02:04:25.566387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2254/3246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:25 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:04:25.595793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:25.596319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:25.612784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.616785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.617476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.620330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.626404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.629965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.733935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:04:25.917532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8a5370b-4c1f-41ec-9754-59536fd48cef tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 204 len: 0 microversion: 2.1 time: 0.348450 Aug 24 02:04:25.918494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2255/3247] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:25 2022] DELETE /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:25.925703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:25.928641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:25.936286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.937481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.938170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:25.939139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:25.939831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:25.960631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:26.286696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:26.299643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1793794c-814a-4c69-988b-d2f1e47adb32 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 200 len: 1506 microversion: 2.1 time: 0.378970 Aug 24 02:04:26.300574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2256/3248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:25 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 1506 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:26.305216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a", "name": "network-vif-unplugged", "status": "completed", "tag": "9dfd45e0-4dbc-4d19-9866-05b95dc8bb76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:26.316834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:26.317556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:26.317987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:26.329979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] Creating event network-vif-unplugged:9dfd45e0-4dbc-4d19-9866-05b95dc8bb76 for instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a on n-h2-854121-3 Aug 24 02:04:26.338025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3fbce0fe-6078-4685-8bd2-4493c1a959c7 req-23530460-504c-4528-83a9-3e4aa621f319 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035418 Aug 24 02:04:26.339774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2257/3249] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:26.346742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6ef2dcd-e937-409f-a7f2-c1de502e2f1c tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '.version_select at 0x7f6b917e7550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:26.382976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6ef2dcd-e937-409f-a7f2-c1de502e2f1c tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048089594" status: 202 len: 0 microversion: 2.1 time: 0.041680 Aug 24 02:04:26.388789 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2258/3250] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048089594 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:04:26.395235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-858118329", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "b1581d10-276f-4f25-861c-edcd3a3366ea"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:26.476028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] validate_networks() for [('b1581d10-276f-4f25-861c-edcd3a3366ea', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:04:28.040797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:04:28.042950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:04:28.043897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:04:28.044540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:04:28.045857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:04:28.058252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:28.059046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:28.062692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:28.065139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:28.066374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:28.070902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:28.122514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:04:28.129348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Getting quotas for user 19d2def105dc41a78e79aedb36fbe5b0 and project 5b8606a33a074d37b2f8f732f6583517. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:04:28.148235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:04:28.151777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:04:28.231822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba6399d5-5e39-4056-8e48-bd28cb143aa8 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841196 Aug 24 02:04:28.232904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2259/3251] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:04:28.245636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:28.246441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:28.257666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:28.258472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:28.259136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:28.260591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:28.261335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:28.262121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:28.379439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:04:28.643170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77c7ff84-0e06-45f3-a429-dcefd6d35d2e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 204 len: 0 microversion: 2.1 time: 0.400266 Aug 24 02:04:28.644787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2260/3252] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:28 2022] DELETE /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:28.660275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79e62885-0417-4369-8ec7-42af5069f2d2 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:28.661304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79e62885-0417-4369-8ec7-42af5069f2d2 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:28.829108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79e62885-0417-4369-8ec7-42af5069f2d2 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:28.847537 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79e62885-0417-4369-8ec7-42af5069f2d2 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1207 microversion: 2.1 time: 0.200342 Aug 24 02:04:28.850894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2261/3253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:28 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1207 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:29.485243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-3052249", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "c38e8856-7cec-4f76-bfd2-e03605877ff1"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:29.646279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] validate_networks() for [('c38e8856-7cec-4f76-bfd2-e03605877ff1', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:04:31.627983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:04:31.629146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:04:31.629811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:04:31.630386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:04:31.630967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:04:31.659875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:31.665500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:31.665959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:31.666785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:31.667255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:31.667686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:31.741492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:04:31.765777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for user 3fcba851bcb3469d9863b8e2c05c9def and project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:04:31.795042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:04:31.798342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:04:31.878118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c25036d-c62c-4484-8bb1-b84c93e9a5e6 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397066 Aug 24 02:04:31.884467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2262/3254] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:04:31.895430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:31.896396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:31.913086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:31.914996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:31.915598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:31.917533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:31.919238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:31.919761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:32.080475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:32.105118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f9490fa-c7f3-4d55-acd4-484ff1077086 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1265 microversion: 2.1 time: 0.214927 Aug 24 02:04:32.106344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2263/3255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:31 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:32.115883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a", "name": "network-vif-deleted", "tag": "9dfd45e0-4dbc-4d19-9866-05b95dc8bb76"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:32.144953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:32.145764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:32.146453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:32.205864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] Creating event network-vif-deleted:9dfd45e0-4dbc-4d19-9866-05b95dc8bb76 for instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a on n-h2-854121-3 Aug 24 02:04:32.222567 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ba3609d2-3a2d-4e58-b17b-ca09dd8c005f req-dffdc46f-679b-455e-b720-3c2f0cede7f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114553 Aug 24 02:04:32.253361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2264/3256] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:32.268434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1dcf7d87-16d5-4f68-bd3c-04ac06c8c8ae tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:32.271389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1dcf7d87-16d5-4f68-bd3c-04ac06c8c8ae tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:32.498800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1dcf7d87-16d5-4f68-bd3c-04ac06c8c8ae tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:32.512227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1dcf7d87-16d5-4f68-bd3c-04ac06c8c8ae tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1215 microversion: 2.1 time: 0.253040 Aug 24 02:04:32.512854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2265/3257] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:32 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1215 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:33.055990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb885c1-58d5-4cde-8fe5-90ebaf803680", "name": "network-vif-deleted", "tag": "3d44391e-b0ad-47ce-a148-bdaa183fd54b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:33.082495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:33.085271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:33.085838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:33.113165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] Creating event network-vif-deleted:3d44391e-b0ad-47ce-a148-bdaa183fd54b for instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 on n-h1-854121-3 Aug 24 02:04:33.132481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98fbd694-36c8-46a5-aca0-99caae0feb22 req-7ad6e2ac-8c3c-415c-ba1a-6bc1b4684f82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080608 Aug 24 02:04:33.137548 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2266/3258] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 24 02:04:33.166320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:33.168634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:33.189814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:33.192854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:33.195287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:33.196199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:33.196822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:33.201961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:34.610667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:34.625986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca4a309e-acc0-4a5f-83cf-d948b9d69df3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 1.483670 Aug 24 02:04:34.640762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2267/3259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:33 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:34.649572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:34.650461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:34.657969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:34.658847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:34.659514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:34.660457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:34.661131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:34.662267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:34.814641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:34.829214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23919d17-e875-48c0-af1d-847db504a2ed tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1273 microversion: 2.1 time: 0.185757 Aug 24 02:04:34.844662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2268/3260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:34 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:34.861934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791fff1e-d394-467a-bdd1-c7814fd550c2", "tag": "59a6f8b8-85dc-4c18-90a9-a2f050045e38"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:34.886429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:34.887550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:34.888325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:34.910403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] Creating event network-changed:59a6f8b8-85dc-4c18-90a9-a2f050045e38 for instance 791fff1e-d394-467a-bdd1-c7814fd550c2 on n-h2-854121-3 Aug 24 02:04:34.917973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-88cf3f6c-c975-49b8-85d2-93fbfa00d43f req-22e059f9-7c3c-4975-a562-125d60e9c185 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070611 Aug 24 02:04:34.919282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2269/3261] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:35.657906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:35.659760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:35.671041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:35.672003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:35.672817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:35.673841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:35.674627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:35.675482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.030669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:36.043101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b5a8c33-8615-442d-bcd7-744b0820d70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 0.393552 Aug 24 02:04:36.045570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2270/3262] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:35 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:36.059119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:36.059638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:36.081773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.082069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.082542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.083225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.083747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.084111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.442792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:36.473801 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e63045c0-471c-46d0-8368-6a98ed029ca1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.405531 Aug 24 02:04:36.476196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2271/3263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:36 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:36.485763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:36.486923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:36.499138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.500249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.500438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.501468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.503136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.503670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.533132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] HTTP exception thrown: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Request method failure captured: Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 HTTP/1.1 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZxuq4OeRmCXEu9vMKj8XfUYal2GKFCG6jH8Ep1JarplaQRoTiuaVVfeQBXhHAU9Wz0A3adOGgMkWBUlBwGFAe6ubi-3EJ3i8Li6k7eQuZug9qvcc5-kVlkaO7pKLdnpgOxq0DGekp6MJx6IFsjIMoHdZ_tg2FaWyVEgbOOVMx-Ck0 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_448f19d0920242d2a897f4c7b992f703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: dcd501b317174afcbfdfe4cedadc6b0b Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '369425a8-ad82-4f7d-96be-266689912a83'} Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:36.534902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Returning 404 to user: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:36.539132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e757bd8-72bf-4f94-9a79-3ccf9b169009 tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 404 len: 111 microversion: 2.1 time: 0.058768 Aug 24 02:04:36.541356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2272/3264] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:36 2022] DELETE /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:04:36.554062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:36.556017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] [instance: 369425a8-ad82-4f7d-96be-266689912a83] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:36.580213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.581192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.584480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.587306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:36.589821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:36.591126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:36.627638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] HTTP exception thrown: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Request method failure captured: Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 HTTP/1.1 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZxuq4OeRmCXEu9vMKj8XfUYal2GKFCG6jH8Ep1JarplaQRoTiuaVVfeQBXhHAU9Wz0A3adOGgMkWBUlBwGFAe6ubi-3EJ3i8Li6k7eQuZug9qvcc5-kVlkaO7pKLdnpgOxq0DGekp6MJx6IFsjIMoHdZ_tg2FaWyVEgbOOVMx-Ck0 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/448f19d0920242d2a897f4c7b992f703"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_448f19d0920242d2a897f4c7b992f703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 448f19d0920242d2a897f4c7b992f703 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1701995677 Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: dcd501b317174afcbfdfe4cedadc6b0b Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1701995677-project Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '369425a8-ad82-4f7d-96be-266689912a83'} Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:36.629390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:36.634906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] Returning 404 to user: Instance 369425a8-ad82-4f7d-96be-266689912a83 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:36.640273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b96fcf16-ae19-45d7-89be-a6b9bd84bacf tempest-AttachSCSIVolumeTestJSON-1701995677 tempest-AttachSCSIVolumeTestJSON-1701995677-project] 10.222.0.49 "GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83" status: 404 len: 111 microversion: 2.1 time: 0.090134 Aug 24 02:04:36.640273 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2273/3265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:36 2022] GET /compute/v2.1/servers/369425a8-ad82-4f7d-96be-266689912a83 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:04:37.065165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:37.065702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:37.078964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.082069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.082490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.083203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.083671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.084103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.499654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:37.518221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29ce4756-ae16-449d-bb82-f6e5085ec11b tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 0.457688 Aug 24 02:04:37.519276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2274/3266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:37 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:37.524950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:37.526252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:37.546601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.547412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.547952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.548647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.549572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.549769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.599959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bde11398-3538-433a-82f4-4e794bfaf5ef tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/ips" status: 200 len: 150 microversion: 2.1 time: 0.079351 Aug 24 02:04:37.600963 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2275/3267] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:04:37 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:37.605627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:37.606235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:37.616761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.617867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.618526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.619605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:37.620295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:37.621004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:37.627568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:38.363753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:38.376357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f03dc01c-488b-410b-8870-6541a5cdda40 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.774127 Aug 24 02:04:38.378035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2276/3268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:37 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:38.539034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:38.539946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:38.552060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:38.555298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:38.559246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:38.560941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:38.566299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:38.567119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:39.937382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:39.954303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65cbe336-2e48-4d17-939e-0ac87e3d1c72 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 1.414538 Aug 24 02:04:39.957383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2277/3269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:38 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:39.992248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:40.008387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:40.026175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:40.027888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:40.028360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:40.033026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:40.033533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:40.033991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:40.690186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:40.698925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4198ed1-f20e-42d4-8896-d396cac0c0e3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.714963 Aug 24 02:04:40.705391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2278/3270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:39 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:40.713774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284dd8e2-45a9-4021-b442-64bd71bfe894"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:40.720391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:40.738004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:40.738617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:40.739670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:40.745470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:40.745991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:40.746717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:41.370705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44d62c62-4871-4153-a43c-7bb9f7669cfe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663665 Aug 24 02:04:41.371715 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2279/3271] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:04:40 2022] POST /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:41.395174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:41.396102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:41.413440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:41.427230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:41.429472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:41.430200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:41.435284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:41.448593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:41.455888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:41.718842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:42.331816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:42.342326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2d55f9e-70e2-4c84-a1ab-6a1d22e74b57 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 0.969172 Aug 24 02:04:42.349526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2280/3272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:41 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:42.361079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:42.361947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:42.384316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:42.389529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:42.390177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:42.391077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:42.391698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:42.402976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:42.506183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:43.073014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:43.088908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b62eebb-a6c5-415f-958a-0a02daeeee94 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.736803 Aug 24 02:04:43.089504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2281/3273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:42 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:43.122559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08bdce99-6184-44e9-8f33-9e77c90260b3", "tag": "4edc2a99-547a-4439-b65c-feea40690819"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:43.145367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:43.146287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:43.146885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:43.182039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] Creating event network-changed:4edc2a99-547a-4439-b65c-feea40690819 for instance 08bdce99-6184-44e9-8f33-9e77c90260b3 on n-h2-854121-3 Aug 24 02:04:43.188203 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-017f1521-676d-4907-bd43-666f77ba9024 req-d4b58bf9-12f2-40f1-bde4-2fee582f88bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084943 Aug 24 02:04:43.190419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2282/3274] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:43.204548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791fff1e-d394-467a-bdd1-c7814fd550c2", "name": "network-vif-plugged", "status": "completed", "tag": "59a6f8b8-85dc-4c18-90a9-a2f050045e38"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:43.224221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:43.225123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:43.226733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:43.242439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] Creating event network-vif-plugged:59a6f8b8-85dc-4c18-90a9-a2f050045e38 for instance 791fff1e-d394-467a-bdd1-c7814fd550c2 on n-h2-854121-3 Aug 24 02:04:43.250258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f687a02f-d7d7-4666-9b80-e49d368dab98 req-d368f8f2-9521-40e3-80e1-4f3446134e98 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057601 Aug 24 02:04:43.251255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2283/3275] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:43.371737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:43.372934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:43.383059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:43.386318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:43.388243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:43.392358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:43.395975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:43.399263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:43.899669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:43.916385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bd3bc8b-a160-4551-87c7-2f69b8298b2d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 0.541332 Aug 24 02:04:43.917446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2284/3276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:43 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:44.114917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:44.116556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:44.128875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:44.129766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:44.131111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:44.133504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:44.133986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:44.134428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:44.456140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:44.467619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25181e27-3285-4744-93b7-72074622388e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.361087 Aug 24 02:04:44.473033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2285/3277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:44 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:44.939484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:44.940384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:44.956803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:44.960410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:44.961382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:44.964608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:44.973773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:44.974196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:46.361146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:46.379660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df741419-12f8-47c3-ba78-dd90fd4ae70e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1307 microversion: 2.1 time: 1.444414 Aug 24 02:04:46.390473 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2286/3278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:44 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1307 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:04:46.397497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:46.399055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:46.407772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:46.408287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:46.408755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:46.409480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:46.410247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:46.411007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:47.070768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:47.080984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8c944fc-ae0c-4d0f-873c-b5622bcf063c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.688680 Aug 24 02:04:47.082123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2287/3279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:46 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:47.535106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1595277938", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:47.656199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:04:48.595629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:04:48.596897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:04:48.597530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:04:48.598266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:04:48.598834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:04:48.621058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:48.621809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:48.622809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:48.623740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:48.624355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:48.625254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:48.663164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:04:48.678791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:04:48.706876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:04:48.709253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:04:48.824834 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88b4b8f5-64ce-46f8-9d66-11fafee2a9f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.741465 Aug 24 02:04:48.835375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2288/3280] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:04:48.852460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:48.876588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:48.877738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Searching by: {'deleted': False, 'project_id': 'c952c01ab0934348b3d059e83be27a95'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:04:48.892755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:48.895906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:48.897238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:48.900756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:48.901798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:48.903053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:49.028699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:04:49.126895 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2d8de61-dea7-4a0a-b30b-39999b89e892 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.289860 Aug 24 02:04:49.130605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2289/3281] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:04:48 2022] GET /compute/v2.1/servers => generated 344 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:49.141692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:49.146274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:49.159738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:49.164013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:49.165397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:49.167167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:49.170623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:49.172824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:49.512538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:49.544290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d7c73f5-8be7-46d8-964d-a02733aa7753 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1487 microversion: 2.1 time: 0.412280 Aug 24 02:04:49.549069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2290/3282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:49 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1487 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:49.567585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:49.568980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:49.595443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:49.595710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:49.596259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:49.597016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:49.597330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:49.610756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:50.164150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:50.180705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01e41509-a8f4-4a7b-b1a7-e27795dde5f5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.629247 Aug 24 02:04:50.182956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2291/3283] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:49 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:50.201835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:50.205028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:50.221718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:50.222785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:50.225209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:50.226453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:50.242815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:50.244410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:50.398360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:50.417168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d427e86c-86db-46f5-bf12-f71faa940cc6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1189 microversion: 2.1 time: 0.232769 Aug 24 02:04:50.423180 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2292/3284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:50 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1189 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:50.434077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:50.449925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:50.451384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Searching by: {'deleted': False, 'project_id': 'c952c01ab0934348b3d059e83be27a95'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:04:50.462647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:50.464226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:50.465176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:50.466100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:50.467277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:50.481238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:50.516601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:50.551503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:04:50.663434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:50.680574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:50.683230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:50.683871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:51.441851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-041fff39-52be-4097-9353-ffdfa3db139c tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.017226 Aug 24 02:04:51.442452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2293/3285] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:04:50 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:51.453488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-629988472"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:51.465331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:51.483340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:51.486362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:51.490416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:51.491167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:51.492430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:51.493053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:52.170549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b3b3a32-14f5-4870-8423-121e6a69616f tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "POST /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2/action" status: 202 len: 0 microversion: 2.1 time: 0.726610 Aug 24 02:04:52.180096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2294/3286] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:04:51 2022] POST /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:04:52.194699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:52.196564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:52.218995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:52.219527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:52.219957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:52.221377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:52.221833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:52.222259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:52.805433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:52.817715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec261ce6-e864-4f0a-90fc-87cce220fdf9 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.633858 Aug 24 02:04:52.818315 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2295/3287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:52 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:52.843123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:52.843867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:52.862723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:52.869918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:52.870610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:52.873669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:52.876397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:52.879032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:53.376589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:53.394790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0c9617c-acb4-49ad-b9d7-d32adfc16760 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.565791 Aug 24 02:04:53.398553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2296/3288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:52 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:53.406352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d484283-2192-4e68-a2dc-0fd9a1956a69 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:53.421931 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d484283-2192-4e68-a2dc-0fd9a1956a69 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021349 Aug 24 02:04:53.423178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2297/3289] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:04:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:53.448763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bdce99-6184-44e9-8f33-9e77c90260b3", "name": "network-vif-plugged", "status": "completed", "tag": "4edc2a99-547a-4439-b65c-feea40690819"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:53.473146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:53.476051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:53.476764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:53.503421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] Creating event network-vif-plugged:4edc2a99-547a-4439-b65c-feea40690819 for instance 08bdce99-6184-44e9-8f33-9e77c90260b3 on n-h2-854121-3 Aug 24 02:04:53.512344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7b0f0752-4922-40ce-a4bd-ebd3bebf81d3 req-49328b95-dee8-4e01-a839-2934eedca093 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087672 Aug 24 02:04:53.512992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2298/3290] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:53.518294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5b2c596-a625-4fdc-86ff-571c07c5f014 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9153c820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:53.741361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5b2c596-a625-4fdc-86ff-571c07c5f014 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17" status: 200 len: 1413 microversion: 2.1 time: 0.226908 Aug 24 02:04:53.742044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2299/3291] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:53 2022] GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 => generated 1413 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:53.748678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:53.752431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:53.767883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:53.768618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:53.771370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:53.772372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:53.773078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:53.773738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:53.868242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:04:54.029476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-391556c8-07c1-4de9-a42a-f3958c91f272 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "DELETE /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 204 len: 0 microversion: 2.1 time: 0.283629 Aug 24 02:04:54.034227 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2300/3292] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:04:53 2022] DELETE /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:54.047113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0aaef836-7570-4641-80c9-d2a37ad88ff0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b916e2ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:54.119271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0aaef836-7570-4641-80c9-d2a37ad88ff0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17" status: 200 len: 1413 microversion: 2.1 time: 0.077809 Aug 24 02:04:54.120099 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2301/3293] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:54 2022] GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:54.131879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:54.133610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:54.148213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:54.150191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:54.153200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:54.154516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:54.155000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:54.155967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:54.801709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:54.819118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-302af091-b521-464e-ad78-791691d00061 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1315 microversion: 2.1 time: 0.695041 Aug 24 02:04:54.820595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2302/3294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:54 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:54.846373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:54.848195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:54.858256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:54.860768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:54.861646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:54.864502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:54.865657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:54.866645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:55.080507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:55.094380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c3d6e4e-d098-40ac-beb2-041c8f0b374a tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1608 microversion: 2.1 time: 0.271980 Aug 24 02:04:55.095186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2303/3295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:54 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1608 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:55.103181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93693398-0054-42d1-a185-139f23fee16a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b914bf430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:55.415334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93693398-0054-42d1-a185-139f23fee16a tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17" status: 204 len: 0 microversion: 2.1 time: 0.318840 Aug 24 02:04:55.416119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2304/3296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:55 2022] DELETE /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:04:55.429700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:55.430414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:55.450855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:55.451631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:55.452332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:55.453317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:55.454128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:55.454798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:55.975266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:55.984334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67b5a994-a80b-48ea-878b-7ee5bac55446 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.566894 Aug 24 02:04:55.985716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2305/3297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:55 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:55.993552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e04718e-0d60-4d8a-b96a-a96d01f84637", "tag": "878afc8b-810d-4d43-8dcb-79518e066151"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:56.015875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:56.016606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:56.017327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:56.031056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] Creating event network-changed:878afc8b-810d-4d43-8dcb-79518e066151 for instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 on n-h1-854121-3 Aug 24 02:04:56.037936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ed8289bf-b9a4-4f21-b00c-94f09a019734 req-04811094-4d18-4f8e-9ae8-a3adbd73c167 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049742 Aug 24 02:04:56.039625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2306/3298] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:56.046373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-962f9b20-7684-4515-ab70-eeed91e5f020 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b926ce430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:56.077751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-962f9b20-7684-4515-ab70-eeed91e5f020 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Image not found. Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-962f9b20-7684-4515-ab70-eeed91e5f020 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 HTTP/1.1 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0dd56ea5-5234-41be-885e-0d1872c85e17'} Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0dd56ea5-5234-41be-885e-0d1872c85e17 Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:04:56.080357 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dd56ea5-5234-41be-885e-0d1872c85e17 could not be found. Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-962f9b20-7684-4515-ab70-eeed91e5f020 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:04:56.085962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-962f9b20-7684-4515-ab70-eeed91e5f020 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17" status: 404 len: 62 microversion: 2.1 time: 0.041835 Aug 24 02:04:56.094003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2307/3299] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:04:56 2022] GET /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:04:56.098687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:56.099417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:56.106598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:56.107126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:56.107565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:56.108268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:56.110579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:56.111204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:56.577233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:56.585804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5201a1b-9779-4735-90af-1a82f29b4ca8 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1505 microversion: 2.1 time: 0.491182 Aug 24 02:04:56.597345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2308/3300] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:56 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:56.609722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:56.610735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:56.617194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:56.618004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:56.618928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:56.619878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:56.620571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:56.621279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.045326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:57.057348 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-787c0d62-4ade-4460-bcac-f3ed82b7d713 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1505 microversion: 2.1 time: 0.458859 Aug 24 02:04:57.057941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2309/3301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:56 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:57.070155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:57.071189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:57.080814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.081578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.082269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.083252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.083969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.084632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.432681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:57.445278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba6c33c9-abea-45c2-b795-2dcf1c69e77d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1608 microversion: 2.1 time: 0.386003 Aug 24 02:04:57.451707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2310/3302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:57 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1608 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:57.465175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:57.467621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:57.478094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.478928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.481147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.482168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.485100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.485868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.906365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:57.917027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-230fc4cd-1009-4ddd-864a-59862044d072 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1505 microversion: 2.1 time: 0.463576 Aug 24 02:04:57.938928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2311/3303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:57 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:57.952859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:57.954393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:57.973725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.974244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.974683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:57.975394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:57.975849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:57.976300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.025724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:04:58.290165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:58.306453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6482c698-0c04-4b5d-bd3c-84af8e584c2d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.365044 Aug 24 02:04:58.307348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2312/3304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:57 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:58.329233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:58.332994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:58.352740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.353344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.353799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.355635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.356601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.358105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.504854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6f7db4e-efb7-48c2-973c-1d032a1d9b3f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "PUT /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1077 microversion: 2.1 time: 0.192840 Aug 24 02:04:58.518071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2313/3305] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:04:58 2022] PUT /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1077 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:58.523165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:58.523785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:58.531108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.532141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.532817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.533518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.534127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.534756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.736832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:58.746822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6b5bfd3-c0b2-4f88-8b28-889bdbac1bd9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1505 microversion: 2.1 time: 0.227489 Aug 24 02:04:58.748811 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2314/3306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:58 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:58.768455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586c4759-844f-4fae-9c7c-03d17b3115ee", "name": "network-vif-deleted", "tag": "f028dde8-f39d-469d-8ffb-a0948dcc47e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:58.794011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.795460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.796089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.823152 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] Creating event network-vif-deleted:f028dde8-f39d-469d-8ffb-a0948dcc47e3 for instance 586c4759-844f-4fae-9c7c-03d17b3115ee on n-h1-854121-3 Aug 24 02:04:58.833945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9982a164-64eb-4701-8635-4dca6da13c14 req-137c8571-b5ce-4e53-a45f-4832ab6864f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083494 Aug 24 02:04:58.834905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2315/3307] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:04:58.840628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:58.843000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:58.854353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.855092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.855610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:58.856684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:58.858136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:58.858584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:59.019141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:59.028501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46d12a5b-a2e3-4610-87df-d6f7b5cf84d9 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1540 microversion: 2.1 time: 0.192210 Aug 24 02:04:59.029619 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2316/3308] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:58 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1540 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:59.055765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:59.063816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:59.085550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:59.086296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:59.087172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:59.088075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:59.088711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:59.089370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:59.540929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:59.549298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be8aa795-dbba-4e7f-8247-271584b91ef3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1503 microversion: 2.1 time: 0.497327 Aug 24 02:04:59.549880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2317/3309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:59 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1503 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:59.557612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:04:59.558230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:04:59.578627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:59.579168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:59.579595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:59.583297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:59.583951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:59.584569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:04:59.884087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:04:59.900429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ba13734-798b-4c8a-8b64-3e2f3c4c756d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.343199 Aug 24 02:04:59.902461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2318/3310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:04:59 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:04:59.928322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791fff1e-d394-467a-bdd1-c7814fd550c2", "name": "network-vif-plugged", "status": "completed", "tag": "59a6f8b8-85dc-4c18-90a9-a2f050045e38"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:04:59.973391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:04:59.976710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:04:59.977890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:00.030262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] Creating event network-vif-plugged:59a6f8b8-85dc-4c18-90a9-a2f050045e38 for instance 791fff1e-d394-467a-bdd1-c7814fd550c2 on n-h2-854121-3 Aug 24 02:05:00.057519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c04073c0-9f8b-4f49-aa83-5d042b2e6e2e req-fc096e10-a8e0-4094-99a6-b9f360b0751e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146191 Aug 24 02:05:00.060865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2319/3311] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:00.082400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:00.090135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:00.112854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:00.113364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:00.113813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:00.116972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:00.117686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:00.121690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:00.509552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:00.663419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:00.772258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:00.781677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f331fec6-6179-42a5-ada1-4a33a3f769c5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1503 microversion: 2.1 time: 0.719429 Aug 24 02:05:00.789961 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2320/3312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:00 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1503 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:00.795007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:00.797451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:00.808128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:00.819703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:00.820436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:00.827802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:00.828553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:00.829481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.287307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:01.297448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7089127-abe5-4cf3-b11c-78f412f5110d tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1487 microversion: 2.1 time: 0.506059 Aug 24 02:05:01.301185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2321/3313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:00 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1487 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:01.325996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:01.329780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:01.341518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.343911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.345218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.346063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.349079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.349638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.430647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:01.439911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeaa1e31-2411-46b9-8139-da2ae187dee0 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1252 microversion: 2.1 time: 0.125658 Aug 24 02:05:01.441000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2322/3314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:01 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1252 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:01.446887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:01.451299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:01.454879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:01.486538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.487298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.487950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.490444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.490922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.491556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.649420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:01.652450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:01.652994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:01.654076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:01.655265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:01.753614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:01.760657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.761538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.762131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.763842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.765138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.765728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.802263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-500faa45-8a52-4385-952c-f5b305a33d45 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "POST /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3/action" status: 202 len: 1109 microversion: 2.1 time: 0.359940 Aug 24 02:05:01.803637 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2323/3315] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:05:01 2022] POST /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3/action => generated 1109 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 24 02:05:01.808689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:01.809533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:01.817474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.818179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.818925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:01.819800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:01.820249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:01.820673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:02.084293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:02.093436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63d9ff3c-4242-4b53-ac6f-bf812073920c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.288445 Aug 24 02:05:02.097604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2324/3316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:01 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:02.118053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-872766f1-17c3-4dcf-a28d-74f0ee643904 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: .version_select at 0x7f6b914bf310>, body: {"keypair": {"name": "tempest-keypair-1436537364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF95RxiOYjqO2V+AMgGBJaUb7fqVAfuLzdX8+JV2OEAyTcBosYK6Vi+70HNo6h92+cXHNwa5TPjj00LQ1n4wjHRjPJBwytFCF4A+9o5NXnEavApKFHD2cRmUrMKW6CoayA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:02.181280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-872766f1-17c3-4dcf-a28d-74f0ee643904 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:02.207776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-872766f1-17c3-4dcf-a28d-74f0ee643904 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:02.250225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-872766f1-17c3-4dcf-a28d-74f0ee643904 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135758 Aug 24 02:05:02.251009 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2325/3317] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:05:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:02.263554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:02.264091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:02.272083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:02.272780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:02.273540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:02.274327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:02.274923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:02.275422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:02.324161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:05:02.439777 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e744ec62-44e7-473c-8123-db05cdefdd10 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 204 len: 0 microversion: 2.1 time: 0.180113 Aug 24 02:05:02.447752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2326/3318] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:02 2022] DELETE /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:05:02.458836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:02.459900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:02.468583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:02.469412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:02.470102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:02.471028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:02.471782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:02.472481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:02.492165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:02.727775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:02.740148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-453d1648-009a-43fc-a3ce-ad2f201498a4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.290070 Aug 24 02:05:02.741071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2327/3319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:02 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:03.131242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Calling method '.version_select at 0x7f6b926ce5e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:03.135589 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:05:03.135589 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:05:03.140140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.140878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.142949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.166404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.167110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.167717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.180932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.181868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.182467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.191387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1166daa-ffe3-4946-b0ef-b5decb4ccc41 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1946459367-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.448949 Aug 24 02:05:03.192367 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2328/3320] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:05:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:03.206106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e3fcad3-9ce3-4931-9a95-1052907b28a9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9251e040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:03.261853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4e3fcad3-9ce3-4931-9a95-1052907b28a9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Image not found. Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e3fcad3-9ce3-4931-9a95-1052907b28a9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 HTTP/1.1 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0dd56ea5-5234-41be-885e-0d1872c85e17'} Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0dd56ea5-5234-41be-885e-0d1872c85e17 to delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0dd56ea5-5234-41be-885e-0d1872c85e17 could not be found. Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.264482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e3fcad3-9ce3-4931-9a95-1052907b28a9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e3fcad3-9ce3-4931-9a95-1052907b28a9 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17" status: 404 len: 62 microversion: 2.1 time: 0.072355 Aug 24 02:05:03.268643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2329/3321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:03 2022] DELETE /compute/v2.1/images/0dd56ea5-5234-41be-885e-0d1872c85e17 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:05:03.276572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:03.277880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:03.290237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.291014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.291853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.293089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.294579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.295498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.459678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:03.471285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88771eaf-d9a0-4488-806c-05b51f2c127d tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1252 microversion: 2.1 time: 0.203530 Aug 24 02:05:03.489087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2330/3322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:03 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1252 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:03.491526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:03.492138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:03.510760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.511559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.512169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.513140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.513767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.514358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:03.946097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:03.955503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c24a288-72cd-408d-8040-52a7f65bd06c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.467643 Aug 24 02:05:03.969154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2331/3323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:03 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:03.974144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04718e-0d60-4d8a-b96a-a96d01f84637", "name": "network-vif-plugged", "status": "completed", "tag": "878afc8b-810d-4d43-8dcb-79518e066151"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:03.996866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:03.997393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:03.997834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:04.016480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] Creating event network-vif-plugged:878afc8b-810d-4d43-8dcb-79518e066151 for instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 on n-h1-854121-3 Aug 24 02:05:04.024088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0e3412f4-25f1-4331-8671-6a66a871b2d1 req-76e25ce7-79ad-4e72-abd4-3f6adc0d7855 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053528 Aug 24 02:05:04.024940 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2332/3324] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:04.035078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:04.035526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:04.048465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:04.048992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:04.049430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:04.050147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:04.050600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:04.051031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:04.116300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:05:04.229757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Instance is already in deleting state, ignoring this request Aug 24 02:05:04.230605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0b6db9d-06ae-4daf-a326-e47c67792bf1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 204 len: 0 microversion: 2.1 time: 0.204724 Aug 24 02:05:04.231434 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2333/3325] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:04 2022] DELETE /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:05:04.247032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:04.247699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:04.264920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:04.265421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:04.265860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:04.266632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:04.267010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:04.267439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.081276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:05.101476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-669e7431-6e4d-4730-a628-655ba146f315 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.860471 Aug 24 02:05:05.102412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2334/3326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:04 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:05.135278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:05.135909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:05.158663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.161285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.162850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.163874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.165705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.166420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.614435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d2def105dc41a78e79aedb36fbe5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b8606a33a074d37b2f8f732f6583517', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:05.632465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28c2fcf5-9a02-4c2f-8f34-d550e1e510b1 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 200 len: 1493 microversion: 2.1 time: 0.509652 Aug 24 02:05:05.645226 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2335/3327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:05 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 1493 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:05.659005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:05.659889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:05.675807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.678189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.679642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.682904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.683601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.684563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.846731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98376383bf54782b73f9d595192fd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c952c01ab0934348b3d059e83be27a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:05.859864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc077d0b-9915-4c46-bd6c-52fe03a8cff3 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 200 len: 1252 microversion: 2.1 time: 0.213178 Aug 24 02:05:05.861018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2336/3328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:05 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 1252 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:05.865809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:05.867935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:05.890374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.891123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.891720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:05.892615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:05.893260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:05.893842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:06.447972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:06.462806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e646979-978b-4d9e-a6f6-8ed4898c6952 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1293 microversion: 2.1 time: 0.600513 Aug 24 02:05:06.464470 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2337/3329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:05 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1293 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:06.472470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791fff1e-d394-467a-bdd1-c7814fd550c2", "name": "network-vif-unplugged", "status": "completed", "tag": "59a6f8b8-85dc-4c18-90a9-a2f050045e38"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:06.500827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:06.501349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:06.502488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:06.524951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] Creating event network-vif-unplugged:59a6f8b8-85dc-4c18-90a9-a2f050045e38 for instance 791fff1e-d394-467a-bdd1-c7814fd550c2 on n-h2-854121-3 Aug 24 02:05:06.533721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3e37eac4-4695-433b-b6dd-f9a1437173a3 req-44ce25bc-5787-4c55-b762-0d88f4da14cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067709 Aug 24 02:05:06.534356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2338/3330] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:06.541812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:06.542762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:06.550573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:06.551274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:06.551983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:06.553228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:06.553969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:06.554813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:06.773653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:06.785674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80ba2c05-d40b-48b9-9b0e-3256a2d1b51c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.248911 Aug 24 02:05:06.787586 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2339/3331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:06 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:06.795365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1716590975", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "802f15e4-b690-4ef7-b7bc-f44a2f083514"}], "security_groups": [{"name": "tempest-securitygroup--991342273"}], "key_name": "tempest-keypair-1436537364", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:07.161973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] validate_networks() for [('802f15e4-b690-4ef7-b7bc-f44a2f083514', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:08.326273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:08.327436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:08.328155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:08.328808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:08.329427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:08.366445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:08.368106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:08.368847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:08.371743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:08.373259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:08.375420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:08.441618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:08.470571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:08.534998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:08.556258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:08.791404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97e7d171-4ae1-476c-aacc-0342d74695ca tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.998461 Aug 24 02:05:08.797694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2340/3332] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:08.888228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:08.891771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 791fff1e-d394-467a-bdd1-c7814fd550c2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:08.899831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:08.901426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:08.902449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:08.903656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:08.904980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:08.906037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:08.937024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 HTTP/1.1 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '791fff1e-d394-467a-bdd1-c7814fd550c2'} Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:08.940003 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. Aug 24 02:05:08.945831 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:08.948460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance 791fff1e-d394-467a-bdd1-c7814fd550c2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:08.949604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af551b71-0840-40c8-a796-42e7416c6739 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2" status: 404 len: 111 microversion: 2.1 time: 0.150454 Aug 24 02:05:08.953955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2341/3333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:08 2022] GET /compute/v2.1/servers/791fff1e-d394-467a-bdd1-c7814fd550c2 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:08.977788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791fff1e-d394-467a-bdd1-c7814fd550c2", "name": "network-vif-deleted", "tag": "59a6f8b8-85dc-4c18-90a9-a2f050045e38"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:09.010519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.011010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.011541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.071458 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] Creating event network-vif-deleted:59a6f8b8-85dc-4c18-90a9-a2f050045e38 for instance 791fff1e-d394-467a-bdd1-c7814fd550c2 on n-h2-854121-3 Aug 24 02:05:09.080607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4eab96c9-6e3e-40e2-b9ec-77f71cfac867 req-5548541d-f972-4c6c-96ee-07b8defa9e83 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125000 Aug 24 02:05:09.086598 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2342/3334] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:09.097977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:09.098769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] [instance: 586c4759-844f-4fae-9c7c-03d17b3115ee] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:09.113782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.114511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.115413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.116362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.117272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.118979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.139297 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] HTTP exception thrown: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Request method failure captured: Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee HTTP/1.1 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbTLQATgprwUvfLCCuifqlKnthlGJJbmo-ISt15c7GW6sPitPOSesOUmOyjhZuaM6u7y7OH4gfaht8pc7CG-brLUvHr7ZpLpq4pQR57KLrP_c9Cm-h0_dyL-HiMvI95JP86qvu5tW0KtdqAXcdulpUxphCDp0KfaGm6g2ewAlUtFYY Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c952c01ab0934348b3d059e83be27a95 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestBootFromVolume-177615608 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c952c01ab0934348b3d059e83be27a95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c952c01ab0934348b3d059e83be27a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c952c01ab0934348b3d059e83be27a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c952c01ab0934348b3d059e83be27a95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestBootFromVolume-177615608 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c952c01ab0934348b3d059e83be27a95 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestBootFromVolume-177615608 Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestBootFromVolume-177615608-project Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c98376383bf54782b73f9d595192fd2d Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestBootFromVolume-177615608-project Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '586c4759-844f-4fae-9c7c-03d17b3115ee'} Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:09.141346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. Aug 24 02:05:09.145489 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.147616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Returning 404 to user: Instance 586c4759-844f-4fae-9c7c-03d17b3115ee could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:09.149811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d7388e0-e3f1-42f5-a7af-0f3a9211e175 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee" status: 404 len: 111 microversion: 2.1 time: 0.061742 Aug 24 02:05:09.150971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2343/3335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:09 2022] GET /compute/v2.1/servers/586c4759-844f-4fae-9c7c-03d17b3115ee => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:09.158448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:09.159369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:09.167753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.168496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.169868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.171031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.171708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.172252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.393939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:09.412574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89a29c3d-30ba-4bf8-9aa2-061204f496e2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1473 microversion: 2.1 time: 0.260196 Aug 24 02:05:09.426977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2344/3336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:09 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:09.436483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:09.439718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:09.480157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.482086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.486379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.487837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.491724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.492970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.728573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:09.740069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1180032b-05f3-4009-b097-1f7ad71ecdaf tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.310523 Aug 24 02:05:09.752739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2345/3337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:09 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:09.752739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:09.752739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:09.755229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.755879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.758411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.758411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:09.758411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:09.758411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:09.872607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:09.884919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4f5eee5-9c22-466e-b1f6-d854c78e8b89 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1246 microversion: 2.1 time: 0.142174 Aug 24 02:05:09.886698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2346/3338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:09 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:09.895697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7ad02d1-5135-4862-bbd7-5c3f718e72dc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b914a8430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:09.928943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e7ad02d1-5135-4862-bbd7-5c3f718e72dc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Image not found. Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7ad02d1-5135-4862-bbd7-5c3f718e72dc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 HTTP/1.1 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c6e88d0d-5ac1-4f0f-9532-b026dda43f50'} Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c6e88d0d-5ac1-4f0f-9532-b026dda43f50 to delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c6e88d0d-5ac1-4f0f-9532-b026dda43f50 could not be found. Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.931876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7ad02d1-5135-4862-bbd7-5c3f718e72dc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7ad02d1-5135-4862-bbd7-5c3f718e72dc tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50" status: 404 len: 62 microversion: 2.1 time: 0.046886 Aug 24 02:05:09.936047 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2347/3339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:09 2022] DELETE /compute/v2.1/images/c6e88d0d-5ac1-4f0f-9532-b026dda43f50 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:05:09.943145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea9e0183-d565-4f36-8068-5cc7b2664a50 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] Calling method '.version_select at 0x7f6b914a8670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:10.015541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea9e0183-d565-4f36-8068-5cc7b2664a50 tempest-ServersTestBootFromVolume-177615608 tempest-ServersTestBootFromVolume-177615608-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870267976" status: 202 len: 0 microversion: 2.1 time: 0.078782 Aug 24 02:05:10.021137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2348/3340] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:05:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870267976 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:05:10.036043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-790265210", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:10.151241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:12.305305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:12.305892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:12.306374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:12.306935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:12.308752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:12.330552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.331098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.331544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:12.332289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.334113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.334583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:12.362296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:12.370639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:12.386198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:12.391132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:12.406857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:12.446502 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34c1bfba-9657-43c5-b039-f35dc4bbe573 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.424165 Aug 24 02:05:12.454202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2349/3341] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:12.460110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:12.465657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:12.485432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.486222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.488860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:12.490231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.490851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.491520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:12.522201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:12.523530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a HTTP/1.1 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a'} Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:12.526416 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:12.531813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:12.546225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:12.547363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7aa2d065-97e9-4319-817f-f38d95c1fed3 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 404 len: 111 microversion: 2.1 time: 0.091958 Aug 24 02:05:12.551286 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2350/3342] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:12 2022] DELETE /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:12.556237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:12.557096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:12.577955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.578717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.579324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:12.580205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:12.580903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:12.581502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:13.461907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:13.472014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d5d5072-2d5e-4842-a5f6-b213e7148430 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.919466 Aug 24 02:05:13.482919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2351/3343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:12 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:13.501077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:13.501926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:13.508925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:13.509669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:13.510269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:13.511153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:13.511767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:13.512351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:14.839296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:14.854639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e10c99f7-1249-45dd-87c0-3188da22df21 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 1.369065 Aug 24 02:05:14.868700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2352/3344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:13 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:14.875279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:14.876432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:14.897808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:14.898322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:14.904366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:14.906815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:14.907507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:14.907966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:14.943387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:05:15.073766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-659a949b-3c6f-4fe0-86a3-e6b7d1050dca tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 204 len: 0 microversion: 2.1 time: 0.214570 Aug 24 02:05:15.075172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2353/3345] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:14 2022] DELETE /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:05:15.084652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.085548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.093948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.094419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.094866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.095641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.096106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.096888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.118757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a HTTP/1.1 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a'} Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.120579 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3a502eb-98ea-4d94-acb4-99e4d18c6d54 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a" status: 404 len: 111 microversion: 2.1 time: 0.043763 Aug 24 02:05:15.124939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2354/3346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] GET /compute/v2.1/servers/d91f65ff-4293-4d4d-b4b1-4e9ebb1b0e2a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:15.130969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.133010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.141730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.142231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.143284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.144006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.144465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.145711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.436150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:15.448577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-872d272d-436a-4c48-b219-fabdbbc53d62 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.323535 Aug 24 02:05:15.451401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2355/3347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:15.458137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.459626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.482408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.489488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.489856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.490793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.492023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.493856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.612032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:15.624754 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1eeb61a-f26b-4eaa-a0bb-b3d2248ddeb6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1266 microversion: 2.1 time: 0.171126 Aug 24 02:05:15.626795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2356/3348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:15.632333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a57e12cc-8d1f-4641-ab5f-3cb7bbdee2a5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b9146f820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.693375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a57e12cc-8d1f-4641-ab5f-3cb7bbdee2a5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Image not found. Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a57e12cc-8d1f-4641-ab5f-3cb7bbdee2a5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 HTTP/1.1 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a82682ef-3c24-4a78-9592-d5ffeb077076'} Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a82682ef-3c24-4a78-9592-d5ffeb077076 to delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a82682ef-3c24-4a78-9592-d5ffeb077076 could not be found. Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.709970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:05:15.714656 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.721224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a57e12cc-8d1f-4641-ab5f-3cb7bbdee2a5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:15.722273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a57e12cc-8d1f-4641-ab5f-3cb7bbdee2a5 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076" status: 404 len: 62 microversion: 2.1 time: 0.094322 Aug 24 02:05:15.726371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2357/3349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] DELETE /compute/v2.1/images/a82682ef-3c24-4a78-9592-d5ffeb077076 => generated 62 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:05:15.732574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.733288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.741022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.741774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.742384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.743257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.743877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.744469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.766607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 HTTP/1.1 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '45fa83f6-b757-4b07-8b05-ea129fa44e33'} Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:15.768565 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.775556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.781841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:15.783041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bc995b2-1c58-4b67-bb5b-8ae8c67b1751 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 404 len: 111 microversion: 2.1 time: 0.055063 Aug 24 02:05:15.788243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2358/3350] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:15 2022] DELETE /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:15.794056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.794851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 45fa83f6-b757-4b07-8b05-ea129fa44e33] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.802998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.803657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.804210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.805129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.805711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.806249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.841003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 HTTP/1.1 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '45fa83f6-b757-4b07-8b05-ea129fa44e33'} Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.847546 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance 45fa83f6-b757-4b07-8b05-ea129fa44e33 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:15.853077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc57cf37-2eb4-42de-b371-a05ca577e4a4 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33" status: 404 len: 111 microversion: 2.1 time: 0.062149 Aug 24 02:05:15.856796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2359/3351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] GET /compute/v2.1/servers/45fa83f6-b757-4b07-8b05-ea129fa44e33 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:15.865139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c64fba8a-45e7-4ae9-a97a-a5f13438390e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '.version_select at 0x7f6b914a8040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.895781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c64fba8a-45e7-4ae9-a97a-a5f13438390e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Image not found. Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c64fba8a-45e7-4ae9-a97a-a5f13438390e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 HTTP/1.1 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f05e9db4-ee09-424b-953c-6849ad7d3f31'} Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f05e9db4-ee09-424b-953c-6849ad7d3f31 to delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f05e9db4-ee09-424b-953c-6849ad7d3f31 could not be found. Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.897556 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:05:15.901603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:15.904691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c64fba8a-45e7-4ae9-a97a-a5f13438390e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:15.905807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c64fba8a-45e7-4ae9-a97a-a5f13438390e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31" status: 404 len: 62 microversion: 2.1 time: 0.044490 Aug 24 02:05:15.906547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2360/3352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] DELETE /compute/v2.1/images/f05e9db4-ee09-424b-953c-6849ad7d3f31 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:05:15.911393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:15.912331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:15.919963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.929339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.929826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:15.930647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:15.931176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:15.931673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:16.452382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:16.464035 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cca45ae2-b7e2-4b3b-be43-1c6d9d79dfa5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.556183 Aug 24 02:05:16.466897 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2361/3353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:15 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:16.476031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:16.483392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:16.514677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:16.516085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:16.516796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:16.518211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:16.518888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:16.519530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:16.540096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 HTTP/1.1 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '20df93e9-de2c-4d28-9630-e0e53bc4c7f0'} Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:16.542013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:16.547747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:16.549488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:16.550526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a37bb16-28e5-4665-9741-b77a5825d84e tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 404 len: 111 microversion: 2.1 time: 0.080678 Aug 24 02:05:16.555296 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2362/3354] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:16 2022] DELETE /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:16.568381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8", "tag": "34b09f1d-cb15-4a16-ac65-60e36a03d55b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:16.586809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:16.587483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:16.589634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:16.615587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] Creating event network-changed:34b09f1d-cb15-4a16-ac65-60e36a03d55b for instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 on n-h1-854121-3 Aug 24 02:05:16.622359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-90b88490-1fdf-44ca-acfc-1ac4206907b1 req-69b92cf4-8872-4212-97c8-4448f5cb4732 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064882 Aug 24 02:05:16.627920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2363/3355] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:16.636776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:16.637701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:16.651877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:16.652884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:16.654132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:16.655052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:16.655672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:16.656307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:17.454584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:17.467294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dda0bcc3-9572-410c-bccb-d5ca9bf69a93 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.836983 Aug 24 02:05:17.469554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2364/3356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:16 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:17.487127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:17.488555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] [instance: 20df93e9-de2c-4d28-9630-e0e53bc4c7f0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:17.518160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:17.518958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:17.519639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:17.520600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:17.521305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:17.521955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:17.546244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] HTTP exception thrown: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Request method failure captured: Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 HTTP/1.1 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYZczfoJ0ka4_d66IMhsWCTwy7ltrcK8E0c2zO6dBfZ2PfFA8ZRU3S_vCcbNdYT6rQ_ERI2JFwFFkntBCsPsKT6DzbStwLKk7zcIE533LWNJ0HxPQje4ifkbRAq9666K2h7-Lh969tpWZuRkqvq3ALjtTvEeSiEiH486bYbCql-oqJA Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5b8606a33a074d37b2f8f732f6583517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5b8606a33a074d37b2f8f732f6583517 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesTestJSON-2114055643 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 19d2def105dc41a78e79aedb36fbe5b0 Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesTestJSON-2114055643-project Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '20df93e9-de2c-4d28-9630-e0e53bc4c7f0'} Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:17.548327 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. Aug 24 02:05:17.552502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:17.559302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] Returning 404 to user: Instance 20df93e9-de2c-4d28-9630-e0e53bc4c7f0 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:17.561071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7cf2f7f-3851-40d5-beab-ebaa8d7209d0 tempest-ImagesTestJSON-2114055643 tempest-ImagesTestJSON-2114055643-project] 10.222.0.49 "GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0" status: 404 len: 111 microversion: 2.1 time: 0.090720 Aug 24 02:05:17.568103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2365/3357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:17 2022] GET /compute/v2.1/servers/20df93e9-de2c-4d28-9630-e0e53bc4c7f0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:17.577005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:17.577914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:17.593458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:17.594330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:17.595075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:17.598133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:17.598916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:17.600895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:18.265847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:18.278830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dffa3151-7351-4635-9a14-b31044e4a95c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.708846 Aug 24 02:05:18.280092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2366/3358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:17 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:18.305018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:18.306096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:18.326083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:18.333328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:18.334120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:18.338554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:18.339294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:18.340327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:18.709274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:18.727759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5034792b-5dbf-4ee0-9105-25fcfcb9a774 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.443427 Aug 24 02:05:18.737422 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2367/3359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:18 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:18.746856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:18.752563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:18.765145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:18.771149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:18.771886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:18.773282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:18.774105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:18.774904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:19.186519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:19.196889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cbe6d33-0d0c-4c41-a07e-3c4bfc4edcbd tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1514 microversion: 2.1 time: 0.457748 Aug 24 02:05:19.198771 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2368/3360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:18 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1514 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:19.299492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:19.300104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:19.307405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:19.308235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:19.308941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:19.309917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:19.310588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:19.311319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:19.751461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:19.773524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3418160a-98f6-4a3f-9e80-fcb8cbe439c4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.477538 Aug 24 02:05:19.792999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2369/3361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:19 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:05:19.802351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:19.803633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:19.815169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:19.816059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:19.816761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:19.817890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:19.818627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:19.819392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:20.315796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:20.333595 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4575e66-8d48-47b0-ba97-78a4fb38461e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.538625 Aug 24 02:05:20.334192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2370/3362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:19 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:20.338947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:20.339566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:20.380286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:20.380898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:20.381332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:20.382042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:20.382500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:20.382922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:20.878848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:20.883106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:20.888816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3940552-10a6-476f-99d8-58b2efb6d5ee tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.553590 Aug 24 02:05:20.901642 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2371/3363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:20 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:20.910785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:20.912445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:20.922943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:20.924307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:20.925411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:20.926378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:20.927060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:20.927692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:21.773677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:21.785316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-769cb198-c1d5-4870-8279-d7ffc4c364eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.882338 Aug 24 02:05:21.803254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2372/3364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:20 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:21.811123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c67381bb-5bf9-4f3a-a19b-4be89be6974f", "tag": "f6471a31-6ca9-4e65-a8ff-41f470643b80"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:21.832617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:21.834056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:21.835370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:21.856209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] Creating event network-changed:f6471a31-6ca9-4e65-a8ff-41f470643b80 for instance c67381bb-5bf9-4f3a-a19b-4be89be6974f on n-h2-854121-3 Aug 24 02:05:21.869496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dc5f2535-57bd-48f8-b993-2e4d39d089e8 req-2129e014-9dba-4e63-bbb6-a6db1a60731e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063789 Aug 24 02:05:21.870612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2373/3365] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:21.888765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:21.890380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:21.904743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:21.905423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:21.907450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:21.908335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:21.908920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:21.910095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:22.348698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:22.379070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:22.383777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:22.409592 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c25e5526-86cd-49f9-8c72-29a0cc210472 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.536423 Aug 24 02:05:22.429206 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2374/3366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:21 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:22.442588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:22.447083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:22.469460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:22.473689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:22.474110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:22.477962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:22.482293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:22.484161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:22.957157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:22.965492 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-972a3b61-4065-4707-9d6a-f3585df4cf90 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.535095 Aug 24 02:05:22.966988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2375/3367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:22 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:22.971727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:22.972341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:22.989318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:22.990651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:22.991316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:22.992327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:22.993018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:22.993657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:23.391183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:23.414019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bd33186-997c-469f-b8bd-17b1b3ca8bd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.445195 Aug 24 02:05:23.437651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2376/3368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:22 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:23.459863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:23.460997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:23.481638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:23.482498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:23.483692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:23.484772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:23.485651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:23.486349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:23.842964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:23.856779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfee306e-e150-4e6b-a79c-c24c9e35e418 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.416965 Aug 24 02:05:23.857698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2377/3369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:23 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:23.936427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bdce99-6184-44e9-8f33-9e77c90260b3", "name": "network-vif-unplugged", "status": "completed", "tag": "4edc2a99-547a-4439-b65c-feea40690819"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:23.953987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:23.956138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:23.958784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:23.989129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] Creating event network-vif-unplugged:4edc2a99-547a-4439-b65c-feea40690819 for instance 08bdce99-6184-44e9-8f33-9e77c90260b3 on n-h2-854121-3 Aug 24 02:05:24.000244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7c29db29-b99c-4353-9120-7286ab9b79bf req-edb3cd6c-a895-42a3-8e2c-dd5a76c0b6eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068683 Aug 24 02:05:24.005371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2378/3370] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:24.012029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:24.012801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:24.028807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.031291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.031764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:24.038020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.038526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.039137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:24.483762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:24.498962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73966e2b-8174-45e4-ae1c-20410f3f0f52 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.492081 Aug 24 02:05:24.499869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2379/3371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:24 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:24.508175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:24.515866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:24.527042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.527664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.532241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:24.533171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.533831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.534457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:24.850500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:24.859800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54c33b65-49c5-43a9-9427-357740261876 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.358700 Aug 24 02:05:24.861021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2380/3372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:24 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:24.881389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:24.882048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:24.894886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.897371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.897994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:24.898892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:24.900797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:24.901404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:25.159130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:25.177235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56bc8367-cf0e-4a67-b53f-4e75f89d2009 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.301872 Aug 24 02:05:25.182469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2381/3373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:24 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:25.488455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a64159b-fdb4-4f0b-b22c-cbd55c6da7b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Action: 'create', calling method: .version_select at 0x7f6b91406a60>, body: {"keypair": {"name": "tempest-keypair-540739081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxd5av4G1lELdwC0cV7M8uGX/Ex5dkQFrYW+URZRVAn1YdQp4EuDgPxviIJxMk0XAe/NZx+PE3m2e6apolEbBaeFvqjIe5ubwnH4R08V1tiDfBCzJIDa8yBgOjUevCleQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:25.531878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0a64159b-fdb4-4f0b-b22c-cbd55c6da7b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Getting quotas for project a4bf1499aec34fe5a9be0b8c83fa0d42. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:25.546180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0a64159b-fdb4-4f0b-b22c-cbd55c6da7b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Getting quotas for user 888486438a2747f1ba4eeb34cb04bb02 and project a4bf1499aec34fe5a9be0b8c83fa0d42. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:25.594532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a64159b-fdb4-4f0b-b22c-cbd55c6da7b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.124231 Aug 24 02:05:25.596000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2382/3374] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 02:05:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 24 02:05:25.602723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:25.603555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:25.629677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:25.631080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:25.633804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:25.634553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:25.639212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:25.639890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:25.970280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:25.980149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf0fa6cb-825f-4f91-802b-4eff6599bfd4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.381131 Aug 24 02:05:25.999679 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2383/3375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:25 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:26.013640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:26.014179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:26.055375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:26.056288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:26.057118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:26.058163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:26.058928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:26.060978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:26.928216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:26.953819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ad79ee3-d22b-411a-b9a8-0ea101457bac tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.952887 Aug 24 02:05:26.955033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2384/3376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:25 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:26.961163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:26.962015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:26.971107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:26.972102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:26.973573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:26.975600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:26.980818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:26.982417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:27.477590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:27.491808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b5bc191-50f6-427e-a198-f9047fbc58f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.534460 Aug 24 02:05:27.493864 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2385/3377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:26 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:27.505566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:27.506587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:27.532205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:27.539326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:27.541570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:27.544848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:27.545558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:27.546740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:28.094184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:28.104033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40b3a6e1-2f4f-45e4-882f-9b48e7842cd2 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.607749 Aug 24 02:05:28.113693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2386/3378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:27 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:28.132110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:28.132808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:28.161427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:28.167183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:28.167768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:28.169997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:28.170545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:28.172272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:28.695815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:28.710239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b81e0a3-9724-48fc-9021-a92b286c20e0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.582039 Aug 24 02:05:28.720400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2387/3379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:28 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:28.725647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:28.726442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:28.732747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:28.733547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:28.734244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:28.735201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:28.737522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:28.739157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:29.366948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:29.375651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f65ce65-cf4b-4946-b144-99d84279c339 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.653754 Aug 24 02:05:29.380935 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2388/3380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:28 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:29.869245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ced3db6-e129-4c4f-a690-0f8b53f441a4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Action: 'create', calling method: .version_select at 0x7f6b913e8b80>, body: {"keypair": {"name": "tempest-keypair-622030358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJW2M4ctclRhpDdMjfNi4Ta/XRfh1OauoCEGKpQtE0UdYYGTVuPDDh8V2QETOLEKcEJp4jvBdRHebu/yXUiBKy/fiwDHI+P43cVNEJECzCFLme19+u71+igt38cnAjl0mg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:29.894704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ced3db6-e129-4c4f-a690-0f8b53f441a4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for project adccd0d3681b4e288623abbaebb5fc68. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:29.907381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ced3db6-e129-4c4f-a690-0f8b53f441a4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for user 977f49b5afbb4b3b88afcef4a6e58ce4 and project adccd0d3681b4e288623abbaebb5fc68. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:29.913735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:29.990817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ced3db6-e129-4c4f-a690-0f8b53f441a4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.607396 Aug 24 02:05:29.992096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2389/3381] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:05:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:30.002557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8", "name": "network-vif-plugged", "status": "completed", "tag": "34b09f1d-cb15-4a16-ac65-60e36a03d55b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:30.016834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.017435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.017871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.041871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] Creating event network-vif-plugged:34b09f1d-cb15-4a16-ac65-60e36a03d55b for instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 on n-h1-854121-3 Aug 24 02:05:30.048874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e4d6d751-b533-419f-8e20-d34d415abbb2 req-ea0769e4-0596-4028-a1ca-67c1a2ef2169 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055135 Aug 24 02:05:30.050078 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2390/3382] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:30.061184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:30.062551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:30.071667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.072651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.073407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.074249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.075576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.076419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.428917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:30.438678 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48991cd1-5d31-4a9f-9672-81e10f365ca4 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.382475 Aug 24 02:05:30.442191 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2391/3383] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:30 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:30.450783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:30.452498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:30.461640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.465048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.466193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.467196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.467718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.469291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.508112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:30.740579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:30.750935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf402ffe-16d8-4a2d-a2d3-4ab2e35699ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.304947 Aug 24 02:05:30.764234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2392/3384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:30 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:30.764234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:30.764234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:30.780896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.785430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.786754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:30.787578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:30.788643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:30.789298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:31.033530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:31.042617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d58497af-e685-4f7e-af39-28f8cea421cb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1367 microversion: 2.1 time: 0.289056 Aug 24 02:05:31.048381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2393/3385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:30 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:31.056467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-507032315", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0bc4c7db-b87b-485a-a93b-8c41edd3f621"}, {"port": "143cc44b-46f2-443b-a1db-394f635ebbca", "tag": "port-1"}, {"port": "07470c0b-930b-4fc1-8448-66f023775793", "tag": "port-2"}, {"uuid": "82cf6d2e-18ac-40a2-a322-4f4cf49b5b36", "tag": "net-1"}, {"uuid": "82cf6d2e-18ac-40a2-a322-4f4cf49b5b36"}, {"uuid": "8e2a00f3-0a64-4cd1-b4f0-ac0b0f280d9c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "8e2a00f3-0a64-4cd1-b4f0-ac0b0f280d9c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f0c24882-2e3c-4654-b88b-e7c665c02997", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ac550d2f-c04e-4eb6-8ad0-fcbaccaafd50", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3a871b28-52b0-4287-899b-c884a8556118", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--957294273"}], "key_name": "tempest-keypair-540739081", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:31.303619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] validate_networks() for [('0bc4c7db-b87b-485a-a93b-8c41edd3f621', None, None, None, None, None), (None, None, '143cc44b-46f2-443b-a1db-394f635ebbca', None, None, None), (None, None, '07470c0b-930b-4fc1-8448-66f023775793', None, None, None), ('82cf6d2e-18ac-40a2-a322-4f4cf49b5b36', None, None, None, None, None), ('82cf6d2e-18ac-40a2-a322-4f4cf49b5b36', None, None, None, None, None), ('8e2a00f3-0a64-4cd1-b4f0-ac0b0f280d9c', '10.2.2.100', None, None, None, None), ('8e2a00f3-0a64-4cd1-b4f0-ac0b0f280d9c', '10.2.2.200', None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:36.157748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:36.158349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:36.158843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:36.159257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:36.159671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:36.178058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:36.182648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:36.183435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:36.185803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:36.186540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:36.188652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:36.233356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Getting quotas for project a4bf1499aec34fe5a9be0b8c83fa0d42. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:36.245934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Getting quotas for user 888486438a2747f1ba4eeb34cb04bb02 and project a4bf1499aec34fe5a9be0b8c83fa0d42. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:36.501221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:36.504168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f0c24882-2e3c-4654-b88b-e7c665c02997',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ac550d2f-c04e-4eb6-8ad0-fcbaccaafd50',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a871b28-52b0-4287-899b-c884a8556118',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:36.966588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28290cd6-b1cf-4c6c-8325-b6858e6c38a1 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.916281 Aug 24 02:05:36.972997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2394/3386] 10.222.0.49 () {62 vars in 1189 bytes} [Wed Aug 24 02:05:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 5924 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:05:36.982694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:36.983925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:36.992255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:36.993314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:36.993768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:36.994844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:36.995322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:36.995838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:37.334887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:37.361622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f80dc4c-faef-4094-a21e-974b3ee2ec84 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1520 microversion: 2.1 time: 0.387228 Aug 24 02:05:37.368504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2395/3387] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:36 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:37.384676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:37.385666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:37.394803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:37.396693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:37.401184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:37.402257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:37.405304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:37.406016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:37.663573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:37.672090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94e8415c-0fb7-4f74-b336-6ddbf2ff44ee tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.302042 Aug 24 02:05:37.675507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2396/3388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:37 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:37.680424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:37.681071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:37.702355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:37.702973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:37.703420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:37.704138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:37.704818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:37.705984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:38.395096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:38.409443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99cf61f8-f8c1-4c80-b7a5-81a2922b25b3 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1557 microversion: 2.1 time: 0.732759 Aug 24 02:05:38.410275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2397/3389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:37 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1557 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:38.414745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bdce99-6184-44e9-8f33-9e77c90260b3", "name": "network-vif-plugged", "status": "completed", "tag": "4edc2a99-547a-4439-b65c-feea40690819"}, {"server_uuid": "c67381bb-5bf9-4f3a-a19b-4be89be6974f", "name": "network-vif-plugged", "status": "completed", "tag": "f6471a31-6ca9-4e65-a8ff-41f470643b80"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:38.458788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:38.459270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:38.459699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:38.491166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Creating event network-vif-plugged:4edc2a99-547a-4439-b65c-feea40690819 for instance 08bdce99-6184-44e9-8f33-9e77c90260b3 on n-h2-854121-3 Aug 24 02:05:38.492222 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] Creating event network-vif-plugged:f6471a31-6ca9-4e65-a8ff-41f470643b80 for instance c67381bb-5bf9-4f3a-a19b-4be89be6974f on n-h2-854121-3 Aug 24 02:05:38.503074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7e11296f-7f97-4543-af0c-229e8d58407b req-71fdc8c3-f764-45d5-ab3c-70bb6f68c6ce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.090040 Aug 24 02:05:38.504559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2398/3390] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:38.743402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1298082311", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:38.871032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:39.362462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:39.363769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:39.364636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:39.365234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:39.366691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:39.386963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:39.387890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:39.388850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:39.390373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:39.391332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:39.393035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:39.447674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Getting quotas for project 1c3391637b8e414b895e9def0e60576f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:39.455319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Getting quotas for user 289c59701d81423aa29b8f2120f2d95f and project 1c3391637b8e414b895e9def0e60576f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:39.475061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:39.481955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:39.547936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d32a8fc-d83a-4792-ac18-a8277c89ea55 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041022 Aug 24 02:05:39.549362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2399/3391] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:39.555045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1191312153", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8f072b43-3f03-409f-bede-6c37d6d22e69"}], "security_groups": [{"name": "tempest-securitygroup--234177597"}], "key_name": "tempest-keypair-622030358", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:39.797109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] validate_networks() for [('8f072b43-3f03-409f-bede-6c37d6d22e69', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:40.921186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:40.921858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:40.922233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:40.922661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:40.923068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:40.942097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:40.942908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:40.943627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:40.946129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:40.949098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:40.953061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:41.004606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for project adccd0d3681b4e288623abbaebb5fc68. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:41.019549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for user 977f49b5afbb4b3b88afcef4a6e58ce4 and project adccd0d3681b4e288623abbaebb5fc68. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:41.035122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:41.037363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:41.107344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cafdfef3-3ae2-4ff1-b9ee-23f0eba98fcc tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.556345 Aug 24 02:05:41.108375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2400/3392] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:41.122564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:41.125464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:41.149493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:41.149988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:41.150788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:41.151129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:41.151586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:41.152016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:41.352344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:41.382988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:41.387879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:41.391657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72b0ff36-b389-4bed-947d-6142da343d9a tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1592 microversion: 2.42 time: 0.280268 Aug 24 02:05:41.434878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2401/3393] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:05:41 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1592 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:05:41.456069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:41.459196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:41.490758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:41.492354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:41.492836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:41.493565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:41.494026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:41.499110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:42.240654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:42.258750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-733d8ed6-1b10-474a-9526-68ab2e481ff5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1505 microversion: 2.1 time: 0.822090 Aug 24 02:05:42.259760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2402/3394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:41 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1505 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:42.272265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:42.275139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:42.288574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:42.289097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:42.289537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:42.290241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:42.290693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:42.291115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:42.614934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b25461f-16cf-42f5-891c-f772ab557e9a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.353382 Aug 24 02:05:42.615536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2403/3395] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:05:42 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/os-interface => generated 284 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:42.620923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:42.621560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:42.635004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:42.636350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:42.639229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:42.640582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:42.641732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:42.643792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:43.538186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:43.554513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1901ae10-81ab-44b5-8f78-58cebb472607 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1308 microversion: 2.1 time: 0.935944 Aug 24 02:05:43.555144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2404/3396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:42 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1308 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:43.566707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:43.567324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:43.583006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:43.583431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:43.583875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:43.589039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:43.589536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:43.590205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:43.732608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:43.749163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34d1820e-c4c2-4273-87c5-9baaff37f427 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1275 microversion: 2.1 time: 0.187347 Aug 24 02:05:43.750785 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2405/3397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:43 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:44.118634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-218162b6-3905-47ce-8f61-818942f9e8b7 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Action: 'create', calling method: .version_select at 0x7f6b91406af0>, body: {"keypair": {"name": "tempest-keypair-1952247024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYC5EVOmMUmwqHHhy71hD4hBCxSycuxRxwSS9jyHL/ONkawKPVsCupqTuaAUnSfM2bGBX7lYgsVFBS7M70ZUultM50zpsiGYo5MfPy77kHjBwc3f5wh9dgEmPO0LvZcmQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:44.181576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-218162b6-3905-47ce-8f61-818942f9e8b7 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for project e51e4b940d5d4759b4cda90d112baa02. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:44.188501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-218162b6-3905-47ce-8f61-818942f9e8b7 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for user 26fe513e27f44c3eb907d3d8890f4cdd and project e51e4b940d5d4759b4cda90d112baa02. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:44.255555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-218162b6-3905-47ce-8f61-818942f9e8b7 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.503117 Aug 24 02:05:44.264900 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2406/3398] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:05:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:44.270386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:44.271326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:44.280240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:44.280995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:44.281659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:44.282534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:44.283151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:44.284396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:44.860356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:44.873277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58c6088b-7e1b-4d5d-b365-88aa52d32883 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1299 microversion: 2.1 time: 0.606895 Aug 24 02:05:44.887005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2407/3399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:44 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1299 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:44.887005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:44.887005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:44.894492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:44.895235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:44.896016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:44.897000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:44.897724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:44.898339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:45.556840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:45.573023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4eeb071f-b2d0-4da4-a297-94f44ed88e79 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 200 len: 1505 microversion: 2.1 time: 0.687631 Aug 24 02:05:45.574584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2408/3400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:44 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:45.589504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:45.601822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:45.607100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:45.611991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:45.612831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:45.613470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:45.614385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:45.615712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:45.616942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:46.308123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:46.333417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:46.335552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:46.339260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd3e7e75-a2d7-4055-b051-4d09ff247fc8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1705 microversion: 2.42 time: 0.762135 Aug 24 02:05:46.341326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2409/3401] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:05:45 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1705 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:05:46.357895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c67381bb-5bf9-4f3a-a19b-4be89be6974f", "name": "network-vif-deleted", "tag": "f6471a31-6ca9-4e65-a8ff-41f470643b80"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:46.370970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:46.372637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:46.373427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:46.388042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] Creating event network-vif-deleted:f6471a31-6ca9-4e65-a8ff-41f470643b80 for instance c67381bb-5bf9-4f3a-a19b-4be89be6974f on n-h2-854121-3 Aug 24 02:05:46.394311 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c7834c65-dbf6-47c7-85ed-b741991cdf2e req-223e6e9d-b212-4d8f-a281-ecc16fc80a13 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049684 Aug 24 02:05:46.395685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2410/3402] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:46.402557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:46.403578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:46.412311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:46.413592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:46.414472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:46.415490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:46.416228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:46.417460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:46.526552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:46.551516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f0f23b4-1429-4191-8b8a-ec2e7de6c0a9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1287 microversion: 2.1 time: 0.154292 Aug 24 02:05:46.564835 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2411/3403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:46 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1287 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:46.564835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:46.564835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:46.584480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:46.585132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:46.585652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:46.586459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:46.587003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:46.587510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.034132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:47.056112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-245dfa01-1797-4af9-8dca-171f072aa5ab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1317 microversion: 2.1 time: 0.501595 Aug 24 02:05:47.061942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2412/3404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:46 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:47.068494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:47.069226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:47.084518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.085263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.089391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.090892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.091515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.097352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.155612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:05:47.159780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:47.391481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8c1e0ed-153f-4377-8452-26d7950ad7ea tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 204 len: 0 microversion: 2.1 time: 0.327345 Aug 24 02:05:47.392150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2413/3405] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:05:47 2022] DELETE /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:05:47.418894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:47.419680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:47.428054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.433425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.434877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.435806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.436456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.437160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.753510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:47.762082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55560ddd-8faa-4e9b-a52a-9c686f28ca8e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1366 microversion: 2.1 time: 0.368731 Aug 24 02:05:47.766703 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2414/3406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:47 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:47.775532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:47.781026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:47.798922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.799730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.800392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:47.801362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:47.802027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:47.802659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:48.345985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:48.360201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:48.361770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:48.362984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e37185a0-22a3-4f08-aaa7-dc292613f880 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1751 microversion: 2.42 time: 0.594954 Aug 24 02:05:48.383851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2415/3407] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:05:47 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1751 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:05:48.391053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:48.391688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:48.405296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:48.406065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:48.406246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:48.407145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:48.407768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:48.408364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:48.447823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:48.449177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:48.449833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:48.450454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lazy-loading 'fault' on Instance uuid c67381bb-5bf9-4f3a-a19b-4be89be6974f {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:05:48.607230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:48.616611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70008daf-2586-4cae-b6eb-47606bcd676e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 200 len: 1298 microversion: 2.1 time: 0.231655 Aug 24 02:05:48.617672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2416/3408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:48 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 1298 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:48.622622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1404571957", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "c38e8856-7cec-4f76-bfd2-e03605877ff1"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:48.744819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] validate_networks() for [('c38e8856-7cec-4f76-bfd2-e03605877ff1', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:50.275798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:50.280258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:50.281981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:50.285187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:50.287069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:50.307530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:50.313488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:50.326090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:50.329770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:50.340630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:50.343071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:50.394957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:50.409979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Getting quotas for user 3fcba851bcb3469d9863b8e2c05c9def and project 7bdf5f642ad44132a9e7320cbaedae81. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:50.461194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:50.467818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:50.571718 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b367fc4-5fa7-4272-bed8-0abca150a9ba tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952691 Aug 24 02:05:50.578564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2417/3409] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:50.583635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:50.583635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:50.613589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:50.614652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:50.617728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:50.618592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:50.622030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:50.622900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.085538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:51.097332 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1db20d59-2bc1-4ed5-99cb-2ff93f010820 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1317 microversion: 2.1 time: 0.523228 Aug 24 02:05:51.110166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2418/3410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:50 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:51.111278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8", "tag": "34b09f1d-cb15-4a16-ac65-60e36a03d55b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:51.125927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.128597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.129651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.165065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] Creating event network-changed:34b09f1d-cb15-4a16-ac65-60e36a03d55b for instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 on n-h1-854121-3 Aug 24 02:05:51.180589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-13380e2f-0fe0-41f0-a908-7720a5c1de18 req-c90e3ea0-b202-4552-8aab-9b1fbffc84a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080707 Aug 24 02:05:51.181248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2419/3411] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:51.193136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:51.222301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.224439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.228328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.251271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] Creating event network-changed:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:05:51.264542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3f461939-a71c-47b1-9447-80d966dd720e req-e523a076-2a8c-4f56-8cc1-f898bcce8b4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075433 Aug 24 02:05:51.265462 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2420/3412] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:51.284480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:51.286461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:51.295512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.297030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.297761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.298825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.299819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.300579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.656444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:51.682237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a510794e-55f3-42b5-b2f1-88c15a807a98 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1366 microversion: 2.1 time: 0.413496 Aug 24 02:05:51.683003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2421/3413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:51 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:51.700128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:51.700688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:51.708309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.711301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.711301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:51.711301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:51.711301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:51.711301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:52.045774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:52.062866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:52.066668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:52.068462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62f6cb8e-33b5-4f8c-b43a-524b8f1f14fc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1797 microversion: 2.42 time: 0.382314 Aug 24 02:05:52.071656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2422/3414] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:05:51 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1797 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:05:52.082079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:52.083925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:52.092959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:52.093753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:52.094369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:52.095382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:52.095993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:52.096590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:52.115179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f HTTP/1.1 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c67381bb-5bf9-4f3a-a19b-4be89be6974f'} Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:52.117262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:05:52.123024 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:05:52.125220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:05:52.128012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d9a9a7e-6269-43c9-986a-e9765e5c5c03 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 404 len: 111 microversion: 2.1 time: 0.053743 Aug 24 02:05:52.129277 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2423/3415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:52 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:05:52.140291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2107158556", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "770b8bdb-8845-43cc-b2d0-b5cc3c44657f"}], "security_groups": [{"name": "tempest-securitygroup--310864877"}], "key_name": "tempest-keypair-1952247024", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:52.378587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] validate_networks() for [('770b8bdb-8845-43cc-b2d0-b5cc3c44657f', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:53.927372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=37 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:53.931221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for project e51e4b940d5d4759b4cda90d112baa02. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:53.948355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for user 26fe513e27f44c3eb907d3d8890f4cdd and project e51e4b940d5d4759b4cda90d112baa02. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:53.983039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:53.987433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:53.987951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:53.988372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:53.988816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:54.023298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.024604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.025832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:54.028956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.031800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.032490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:54.065081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for project e51e4b940d5d4759b4cda90d112baa02. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:54.075021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Getting quotas for user 26fe513e27f44c3eb907d3d8890f4cdd and project e51e4b940d5d4759b4cda90d112baa02. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:54.096359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:54.128817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:54.256560 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3b26270-fceb-4218-829c-a33b807c8447 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.125965 Aug 24 02:05:54.267563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2424/3416] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:54.277863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:54.281578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:54.297771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.298279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.299939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:54.300690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.307663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.308270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:54.740288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:54.757532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f58aa3da-7297-4cad-bd5c-8a9b3738376a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1318 microversion: 2.1 time: 0.480374 Aug 24 02:05:54.758578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2425/3417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:54 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:54.763555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:54.769814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:54.784989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.785688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.786300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:54.787185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:54.787807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:54.788557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:55.661287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:55.672879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6fc9af7-1cf1-4e45-aa50-40f4807a6b0b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1317 microversion: 2.1 time: 0.912673 Aug 24 02:05:55.674201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2426/3418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:54 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:55.680433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-6223773", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:55.812926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:05:56.925700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:05:56.926278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:05:56.926678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:05:56.927083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:05:56.927507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:05:56.939836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:56.940347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:56.940830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:56.941685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:56.942154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:56.942578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:56.963454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:05:56.969557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:05:56.983974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:05:56.986589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:05:57.040987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06069549-d5e6-485e-9204-701c380a2f75 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365214 Aug 24 02:05:57.047815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2427/3419] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:05:57.053131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:57.053767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:57.061124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:57.061667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:57.062152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:57.062923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:57.063469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:57.063939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:57.688033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:57.702131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-984dee79-e9df-4205-bff3-386c1e305ff8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1366 microversion: 2.1 time: 0.653090 Aug 24 02:05:57.702722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2428/3420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:57 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1366 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:57.726420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:57.727050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:57.730103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:57.734326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:57.734975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:57.735424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:57.736241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:57.736701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:57.747273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.014585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.026531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.029023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.029969 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8633f7ce-adec-4f50-b82a-4cdb810e1f0e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1843 microversion: 2.42 time: 0.312624 Aug 24 02:05:58.030655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2429/3421] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:05:57 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1843 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:05:58.035872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08bdce99-6184-44e9-8f33-9e77c90260b3", "name": "network-vif-deleted", "tag": "4edc2a99-547a-4439-b65c-feea40690819"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:58.050871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.051357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.051824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.064728 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] Creating event network-vif-deleted:4edc2a99-547a-4439-b65c-feea40690819 for instance 08bdce99-6184-44e9-8f33-9e77c90260b3 on n-h2-854121-3 Aug 24 02:05:58.069937 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e537a6c6-1131-41db-a446-150cb425ebb8 req-a8153870-884d-4d3a-ae6e-e0973f55e474 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038130 Aug 24 02:05:58.070707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2430/3422] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:58.075817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d3e7e0-0dee-447c-8509-afe124ceb3b1", "tag": "424562d2-8a8a-4316-b297-9f0d65fd6171"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:58.085777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.086271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.086701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.098545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] Creating event network-changed:424562d2-8a8a-4316-b297-9f0d65fd6171 for instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 on n-h2-854121-3 Aug 24 02:05:58.103589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8203c6de-a378-4fbc-80a0-551c28638e90 req-04545ec7-fe16-4bed-a51f-4175bc140b88 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031430 Aug 24 02:05:58.104391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2431/3423] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:58.111186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:58.111882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:58.118350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.118841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.119278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.119977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.120433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.120973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.198458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.209934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8436f2f8-5732-4d50-a696-aef8a0f1f1ac tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1340 microversion: 2.1 time: 0.102499 Aug 24 02:05:58.211158 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2432/3424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:58 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1340 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:58.217141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:58.217999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:58.225397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.226123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.245466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.246757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.247193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.247633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.578364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.582260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:05:58.587976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6efffbf6-d61f-4f4c-84c9-adcd2a5633d0 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1318 microversion: 2.1 time: 0.375712 Aug 24 02:05:58.602695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2433/3425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:58 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:58.602695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-plugged", "status": "completed", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:05:58.608085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.608697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.609449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.625132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] Creating event network-vif-plugged:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:05:58.632328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5489a690-7e00-4d79-a388-6a7deb64fe11 req-132f59fa-687a-4645-9a2e-2d9515f8f7f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039872 Aug 24 02:05:58.633353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2434/3426] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:05:58.641479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:58.642191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:58.664891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.665457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.665939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.666819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:58.667354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:58.668669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:58.989341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:58.999392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2474c097-d21a-4596-bca4-e824cdb42bad tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1317 microversion: 2.1 time: 0.364381 Aug 24 02:05:59.025704 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2435/3427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:58 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:59.036832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:59.038254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:59.045596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:59.046338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:59.047089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:59.047988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:59.048610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:59.049924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:59.166647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:05:59.181627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddf57519-3f7b-4bf0-809d-5db7080ba694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1214 microversion: 2.1 time: 0.150530 Aug 24 02:05:59.192809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2436/3428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:59 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:05:59.200090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:05:59.200512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:05:59.207536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:59.208030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:59.220925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:05:59.221862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:05:59.222355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:05:59.222807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:00.042454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:00.052261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6a1b78a-ce23-4ee9-89ef-4a4fe0682973 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1366 microversion: 2.1 time: 0.868545 Aug 24 02:06:00.052896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2437/3429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:05:59 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1366 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:00.062257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:00.066447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:00.079355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:00.082074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:00.083903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:00.084891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:00.086245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:00.086880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:00.745285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:00.762409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:00.764584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:00.772112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0e3eed3-c589-41bc-9d4c-dd1b2dce6d09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1864 microversion: 2.42 time: 0.713562 Aug 24 02:06:00.773143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2438/3430] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:00 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1864 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:00.778611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:00.785817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:00.797608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:00.807766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:00.808517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:00.809515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:00.810344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:00.811036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:01.350630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:01.379286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10d23379-7696-4664-9828-61be6eba3b26 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.603082 Aug 24 02:06:01.380559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2439/3431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:00 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:01.386215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:01.388303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:01.396335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:01.396899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:01.397344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:01.398072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:01.399770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:01.400500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:01.716331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:01.726766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e43d9cb-be9d-441e-bbf9-8441594d8c8e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1318 microversion: 2.1 time: 0.344890 Aug 24 02:06:01.732564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2440/3432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:01 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:01.740584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:01.742065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:01.750299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:01.751021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:01.751628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:01.752542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:01.753785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:01.754406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:02.384797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:02.399503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-254a7a78-9933-4871-a58b-0eff5be58411 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1466 microversion: 2.1 time: 0.665558 Aug 24 02:06:02.413122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2441/3433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:01 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1466 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:02.421328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "cae35217-a025-43a3-80a2-d1bc17a9ad49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:02.432206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:02.432980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:02.434179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:02.452792 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] Creating event network-changed:cae35217-a025-43a3-80a2-d1bc17a9ad49 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:02.461532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-170a1098-be20-410d-8aff-3da9f401faf9 req-4cf61e13-c411-4a1a-a7cf-4fb2e2bc1669 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046999 Aug 24 02:06:02.462532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2442/3434] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:02.468156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f85b3f02-fc51-4716-a8d6-b37b42c2083e", "tag": "d65585b0-6783-4b18-8835-f352cbf6ff09"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:02.500994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:02.501470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:02.501917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:02.517351 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] Creating event network-changed:d65585b0-6783-4b18-8835-f352cbf6ff09 for instance f85b3f02-fc51-4716-a8d6-b37b42c2083e on n-h1-854121-3 Aug 24 02:06:02.524515 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-24e898a8-8b0f-4d70-8e68-f2eaded414ef req-ab4c8600-51d5-4edc-93a0-685cd58141ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060284 Aug 24 02:06:02.526369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2443/3435] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:02.534788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:02.536140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:02.546421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:02.546925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:02.547695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:02.548418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:02.548985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:02.549642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:03.409062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:03.420179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d1e2c48-92d7-4b63-af5b-7e580bcdab68 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.891726 Aug 24 02:06:03.421100 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2444/3436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:02 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:03.426350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d3e7e0-0dee-447c-8509-afe124ceb3b1", "name": "network-vif-plugged", "status": "completed", "tag": "424562d2-8a8a-4316-b297-9f0d65fd6171"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:03.436367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:03.436367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:03.436771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:03.459231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] Creating event network-vif-plugged:424562d2-8a8a-4316-b297-9f0d65fd6171 for instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 on n-h2-854121-3 Aug 24 02:06:03.464132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98e20f99-50c0-4647-8b1c-8a4d41583302 req-37fd2680-f9f5-48cc-af00-7ffcce6a3311 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041185 Aug 24 02:06:03.465649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2445/3437] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:03.472776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:03.473669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:03.481434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:03.482378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:03.482988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:03.484021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:03.484632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:03.485232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:03.873792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:03.887233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c29791ef-6397-463b-8ca8-6c8efda0acd1 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1366 microversion: 2.1 time: 0.419490 Aug 24 02:06:03.888472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2446/3438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:03 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:03.896084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:03.896923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:03.906531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:03.907312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:03.907949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:03.908951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:03.909808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:03.910781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.274443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:04.284026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:04.285578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:04.286815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e28702c1-3833-46fe-8601-64465ad83e91 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.396472 Aug 24 02:06:04.287486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2447/3439] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:03 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:04.308072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:04.309237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:04.315925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.316416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.316877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.317569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.318023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.318796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.508064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:04.518324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c77de63a-62eb-4862-9d9b-086fd74d2732 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.213983 Aug 24 02:06:04.518915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2448/3440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:04 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:04.524076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2034347492", "metadata": {"image_type": "test"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:04.526784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:04.533114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.533602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.534069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.534769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.535226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.536108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.569437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Getting quotas for project 1c3391637b8e414b895e9def0e60576f. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:06:04.574671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Getting quotas for user 289c59701d81423aa29b8f2120f2d95f and project 1c3391637b8e414b895e9def0e60576f. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:06:04.769003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-862d5043-35c3-4c8f-a3af-71a2c0f37b41 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "POST /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3/action" status: 202 len: 0 microversion: 2.1 time: 0.248451 Aug 24 02:06:04.769736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2449/3441] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:06:04 2022] POST /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:06:04.776872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:04.777820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:04.789531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.790948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.791490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.793915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:04.794387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:04.794851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:04.992156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.001288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a627f6a1-0991-4da8-8c4b-37b29f14298a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1318 microversion: 2.1 time: 0.230073 Aug 24 02:06:05.002235 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2450/3442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:04 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:05.008304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.008972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:05.016159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.016652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.017189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.017976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.018434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.018859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.024409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:05.192349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.200589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8fd8906-dbae-4589-a902-5961d9233c3f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.195799 Aug 24 02:06:05.201286 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2451/3443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:05.206390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "143cc44b-46f2-443b-a1db-394f635ebbca"}, {"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "07470c0b-930b-4fc1-8448-66f023775793"}, {"name": "network-changed", "server_uuid": "20921901-2044-462f-b074-ef15308c7696", "tag": "5ff554fa-71bb-496c-b378-e422ed79c254"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:05.218591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.219165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.219842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.235660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Creating event network-changed:143cc44b-46f2-443b-a1db-394f635ebbca for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:05.236424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Creating event network-changed:07470c0b-930b-4fc1-8448-66f023775793 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:05.237172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] Creating event network-changed:5ff554fa-71bb-496c-b378-e422ed79c254 for instance 20921901-2044-462f-b074-ef15308c7696 on n-h1-854121-3 Aug 24 02:06:05.244039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3cd820a4-54b2-4fe8-969a-bfc5be45891e req-acf03228-9187-4c8c-872e-8000b6a469a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.041100 Aug 24 02:06:05.244652 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2452/3444] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:05.250066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f3eb55-e9b4-4331-9a51-f9a2c23d759c", "tag": "12f2a002-0b08-4591-a977-8c555e3c6843"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:05.259856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.260334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.260791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.272024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] Creating event network-changed:12f2a002-0b08-4591-a977-8c555e3c6843 for instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c on n-h1-854121-3 Aug 24 02:06:05.277694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d4f25031-0f02-4399-8587-f509ca948168 req-ece1409b-6fe9-49fd-b27b-1e101d716219 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030863 Aug 24 02:06:05.278222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2453/3445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:05.283119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d733c07f-559c-4006-b705-def8e3721ba2 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b913ee790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.329354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d733c07f-559c-4006-b705-def8e3721ba2 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.049740 Aug 24 02:06:05.330198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2454/3446] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:05.335003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.335729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:05.343003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.343718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.344357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.345101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.345725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.346335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.475663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.484010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f43c517-cf23-421a-84ac-eebb88a2f8c9 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1556 microversion: 2.1 time: 0.152673 Aug 24 02:06:05.484588 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2455/3447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:05.488987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.489599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:05.495366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.496435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.496911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.497609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.498071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.498503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.682573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.691888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.693520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:05.694752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f949054d-9dab-4558-a0b0-083c305b4eda tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.209220 Aug 24 02:06:05.695421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2456/3448] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:05.699842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85b3f02-fc51-4716-a8d6-b37b42c2083e", "name": "network-vif-plugged", "status": "completed", "tag": "d65585b0-6783-4b18-8835-f352cbf6ff09"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:05.709284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.709841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.710345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.721780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] Creating event network-vif-plugged:d65585b0-6783-4b18-8835-f352cbf6ff09 for instance f85b3f02-fc51-4716-a8d6-b37b42c2083e on n-h1-854121-3 Aug 24 02:06:05.726601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-36539c23-6b5c-4724-a3ef-6ad2daaba97d req-3fb899ae-fa96-48da-9f8e-e79911ac4849 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030025 Aug 24 02:06:05.727183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2457/3449] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:05.732679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.733284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:05.739236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.739722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.740156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.740870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.741337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.741749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.823092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f0a016a-5140-4813-bafe-3a88df52607d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094648 Aug 24 02:06:05.823776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2458/3450] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:05.829152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:05.829756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:05.837557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.838051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.838491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:05.839190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:05.840191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:05.840622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:06.479310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:06.489369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-853d922f-b2ca-4714-a2f4-08b366933289 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.663932 Aug 24 02:06:06.492812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2459/3451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:05 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:06.500407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:06.501312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:06.523384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:06.526615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:06.528249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:06.529724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:06.530487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:06.531434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:06.953884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:06.977431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=15 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:07.093866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:07.102470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3dbc73e-535e-4b1a-a868-d26cf263d0fc tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1318 microversion: 2.1 time: 0.607351 Aug 24 02:06:07.103353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2460/3452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:06 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:07.116798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:07.117779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:07.124854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:07.125501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:07.126049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:07.126855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:07.127439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:07.127969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:07.585572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:07.597261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9fe3855-a954-4a14-9a8d-d23037815262 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.486521 Aug 24 02:06:07.612105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2461/3453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:07 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:07.618502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b504e83-5fa8-49dd-a6fe-ebb571a78c9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b914a6040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:07.671496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b504e83-5fa8-49dd-a6fe-ebb571a78c9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.056907 Aug 24 02:06:07.672620 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2462/3454] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:07 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:07.677686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:07.678492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:07.687763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:07.688401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:07.688983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:07.690042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:07.690614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:07.691105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:08.667725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:08.677934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:08.679548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:08.681224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d784764-ab6e-4599-8422-8deb551beb83 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 1.007297 Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2463/3455] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:07 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:08.695346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:08.696038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:08.696243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:08.983501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:08.998628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a4f1915-6226-40c0-84d8-2190f18ea9e4 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.314941 Aug 24 02:06:08.998767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2464/3456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:08 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:09.010017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:09.010655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:09.018095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.018599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.019045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.019760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.020217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.020643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.236492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:09.260096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b3226e9-10ef-4f16-baed-dbd83ab294d5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1508 microversion: 2.1 time: 0.260068 Aug 24 02:06:09.276008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2465/3457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:08 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:09.282468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:09.283327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:09.289557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.290042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.290657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.291528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.292153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.292804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.443116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:09.452635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-331360fd-5784-4e5a-bf65-190df065a670 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.174600 Aug 24 02:06:09.453270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2466/3458] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:09 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:09.458599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7cda764c-0140-4465-a2b9-de627423398f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b9126ddc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:09.506898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7cda764c-0140-4465-a2b9-de627423398f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.052534 Aug 24 02:06:09.507489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2467/3459] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:09 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:09.512902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3eb55-e9b4-4331-9a51-f9a2c23d759c", "name": "network-vif-plugged", "status": "completed", "tag": "12f2a002-0b08-4591-a977-8c555e3c6843"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:09.524163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.524999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.525998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.537839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] Creating event network-vif-plugged:12f2a002-0b08-4591-a977-8c555e3c6843 for instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c on n-h1-854121-3 Aug 24 02:06:09.550826 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6ae88787-89ae-46fc-8e92-c886a849d5df req-4ce64311-a330-4399-9132-bea232d1c6c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041812 Aug 24 02:06:09.552388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2468/3460] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:09.647196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "f6e64947-7833-44b6-9b87-8bbfcd12fd50"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:09.661021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.661589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.662113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.676807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] Creating event network-changed:f6e64947-7833-44b6-9b87-8bbfcd12fd50 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:09.681600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-10873419-4ee2-46f1-bc88-63aeeb61ecce req-bf14643e-949f-456d-ab66-8350f290e23e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127456 Aug 24 02:06:09.682444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2469/3461] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:09.689205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:09.690007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:09.696870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.697593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.697958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.698700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.699731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.700165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.894199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:09.903872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cc1eb12-4561-4750-b9e2-6b8ca3a8143f tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1508 microversion: 2.1 time: 0.220054 Aug 24 02:06:09.904992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2470/3462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:09 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:09.910598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:09.911579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:09.923912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.924595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.925320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:09.926134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:09.926808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:09.927518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.130347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.140639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.142426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.143641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bda0036-a79a-457b-91b5-028d6e95363c tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.237494 Aug 24 02:06:10.149423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2471/3463] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:09 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:10.157708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:10.161620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:10.168604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.169125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.169567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.170263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.170721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.172420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.244561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a514b094-e01d-423d-9406-de248f4057f1 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "PUT /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1080 microversion: 2.1 time: 0.097332 Aug 24 02:06:10.245381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2472/3464] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:06:10 2022] PUT /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1080 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:10.251407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:10.252017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:10.259302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.259886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.260354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.261085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.261562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.261987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.406281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.410113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:10.417112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d689622-85f9-4fc1-8609-e0816759514c tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.170653 Aug 24 02:06:10.418603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2473/3465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:10 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:10.423468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:10.424567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:10.430834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.431452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.432002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.432857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.433459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.434246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.591076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.598958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5ae46fc-56ac-431f-84fd-f10fc1f73590 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1506 microversion: 2.1 time: 0.179355 Aug 24 02:06:10.599536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2474/3466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:10 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:10.621663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:10.622290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:10.628305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.628830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.629283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.629997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.630448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.630864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.763042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.770749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4decab5-8d5f-425e-9f47-5782991b0ae5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.152952 Aug 24 02:06:10.771333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2475/3467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:10 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:10.775994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98bac807-d155-4aca-8cd8-34876f7b1041 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b914a6040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:10.823782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98bac807-d155-4aca-8cd8-34876f7b1041 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.051300 Aug 24 02:06:10.824662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2476/3468] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:10 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:10.829365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:10.829961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:10.836200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.836675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.837127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.837822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:10.838270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:10.838692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:10.977580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:10.986196 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee216d94-ada3-470a-9f0c-8eadc2a70662 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1506 microversion: 2.1 time: 0.160604 Aug 24 02:06:11.000740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2477/3469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:10 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:11.008431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:11.010915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:11.018264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.019530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.019989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.020780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.021864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.022504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.115442 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94f74c5c-a872-4a9f-9027-9550b1ae59a5 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "PUT /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1082 microversion: 2.1 time: 0.110651 Aug 24 02:06:11.129404 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2478/3470] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:06:11 2022] PUT /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1082 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:11.140013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:11.141454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:11.148614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:11.152220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.152837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.153317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.154375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.154927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.155408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.439611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:11.454394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c264b47e-2126-4dde-b0db-39ca69d58e65 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1508 microversion: 2.1 time: 0.322270 Aug 24 02:06:11.455815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2479/3471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:11 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:11.461717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:11.462625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:11.472074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.472979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.473715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.474675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.475511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.477738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.926494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:11.938800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:11.945401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:11.951235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ec18129-64d2-42ea-850b-f930ce18f8da tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.493536 Aug 24 02:06:11.968852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2480/3472] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:11 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:11.970040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:11.970787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:11.977825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.978464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.979029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:11.979822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:11.980998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:11.981532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.405369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:12.414066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef98d0a6-2170-4c46-82ff-5afd7b432ea2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1395 microversion: 2.1 time: 0.454256 Aug 24 02:06:12.417532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2481/3473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:11 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1395 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:12.430358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:12.431206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:12.453474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.454283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.454906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.455790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.456415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.457040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.692300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:12.721836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b617bc3c-6bc3-4589-9670-1631c4506a1e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1508 microversion: 2.1 time: 0.293492 Aug 24 02:06:12.723277 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2482/3474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:12 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:12.733226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-plugged", "status": "completed", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:12.751994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.752790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.753474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.770551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] Creating event network-vif-plugged:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:06:12.776193 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e2175834-9b29-4c85-a1fa-9cdb7218bc2c req-edde9232-c223-4482-ab83-187aec7e055c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051618 Aug 24 02:06:12.777294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2483/3475] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:12.784417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d3e7e0-0dee-447c-8509-afe124ceb3b1", "tag": "424562d2-8a8a-4316-b297-9f0d65fd6171"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:12.794763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.795392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.795934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.808003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] Creating event network-changed:424562d2-8a8a-4316-b297-9f0d65fd6171 for instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 on n-h2-854121-3 Aug 24 02:06:12.825535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b59f6559-39ed-42ec-bafc-cb179b7e9d7f req-97955f7e-9746-4993-b054-60ec5d2e9704 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046609 Aug 24 02:06:12.828995 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2484/3476] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:12.839860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:12.841306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:12.848936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.849709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.850396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:12.851437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:12.852122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:12.852921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:13.361755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:13.371245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e86cf277-5942-447b-8e50-2a662726bac5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.540865 Aug 24 02:06:13.375484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2485/3477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:12 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:13.389344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2494491-8907-4f82-b668-c7c2cc69efab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b9125a4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:13.455082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2494491-8907-4f82-b668-c7c2cc69efab tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.076163 Aug 24 02:06:13.455696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2486/3478] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:13 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:13.475397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:13.480973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:13.491447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:13.494024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:13.497365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:13.498624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:13.499403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:13.500077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:13.532316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:06:13.686992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97764198-fd3b-4656-a3dd-c236a488b278 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 204 len: 0 microversion: 2.1 time: 0.216820 Aug 24 02:06:13.702300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2487/3479] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:13 2022] DELETE /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:06:13.713104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:13.725290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:13.740834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:13.742225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:13.745498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:13.746887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:13.747675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:13.748454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:14.434598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:14.456310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:14.457827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:14.459791 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05c22245-7b74-4825-badd-d76edafab262 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.754517 Aug 24 02:06:14.460368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2488/3480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:13 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:14.468919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:14.469531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:14.489733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:14.490233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:14.490824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:14.491545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:14.492002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:14.492428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:14.899483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:14.914126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b620828-835e-47cc-865a-74cafe369019 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1575 microversion: 2.1 time: 0.452665 Aug 24 02:06:14.915238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2489/3481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:14 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1575 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:14.923706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:14.925298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:14.934670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:14.935185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:14.935627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:14.936338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:14.936810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:14.937235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:14.986336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:06:15.042269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:15.066829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Instance is already in deleting state, ignoring this request Aug 24 02:06:15.067974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33e61460-fb25-449a-998d-3edacc0a246e tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 204 len: 0 microversion: 2.1 time: 0.151769 Aug 24 02:06:15.069313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2490/3482] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:14 2022] DELETE /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:06:15.081084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:15.086035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:15.097028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.099737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.100417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.101373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.102674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.104234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.456912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:15.468820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-018c2d2a-f91e-4eab-a1ed-fc1685e32caa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.397513 Aug 24 02:06:15.485720 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2491/3483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:15 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:15.490826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f9934f7-7a36-406e-9647-eec977033c1b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91280dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:15.556844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f9934f7-7a36-406e-9647-eec977033c1b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.069637 Aug 24 02:06:15.566799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2492/3484] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:15 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:15.574350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "e5033fef-a564-47de-afca-e9f98457ee5f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:15.589627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.590883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.591479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.612455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] Creating event network-changed:e5033fef-a564-47de-afca-e9f98457ee5f for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:15.624527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8e647461-72c8-474a-843b-877deab953a3 req-4184c56c-58c7-4181-b1bc-d835254906c3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055702 Aug 24 02:06:15.626920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2493/3485] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:15.632385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:15.633244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:15.640448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.641233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.641840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.642731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.643355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.644003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.865157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96b6ff47-9a03-46e6-95f5-97f79675ff18 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236693 Aug 24 02:06:15.865823 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2494/3486] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:06:15 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:15.870685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:15.871298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:15.882123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.882625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.888227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:15.889065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:15.889551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:15.889998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:17.216848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcba851bcb3469d9863b8e2c05c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf5f642ad44132a9e7320cbaedae81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:17.226694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bd6651d-57ac-44e4-a00d-7269c2b75d2a tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 200 len: 1514 microversion: 2.1 time: 1.359714 Aug 24 02:06:17.233409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2495/3487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:15 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 1514 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:17.330195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20921901-2044-462f-b074-ef15308c7696", "name": "network-vif-plugged", "status": "completed", "tag": "5ff554fa-71bb-496c-b378-e422ed79c254"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:17.346553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:17.356684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:17.357581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:17.378677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] Creating event network-vif-plugged:5ff554fa-71bb-496c-b378-e422ed79c254 for instance 20921901-2044-462f-b074-ef15308c7696 on n-h1-854121-3 Aug 24 02:06:17.384422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4b8d0125-6fe2-4330-b710-4162a1b99042 req-3dea9c93-24be-4852-b4ef-2804b6eed6ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149457 Aug 24 02:06:17.385685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2496/3488] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:17.393012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:17.394298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:17.401420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:17.404101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:17.404550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:17.405296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:17.405752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:17.406179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.146093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:18.163619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:18.165534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:18.166910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05c1aa6e-e7b9-44f9-87ca-4950a0c90de6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.779124 Aug 24 02:06:18.169019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2497/3489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:17 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:18.184404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:18.185332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:18.191885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.193450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.194026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.195372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.195941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.196488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.620038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:18.632773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2f94fa4-e7e0-4805-b786-d19ab9c7db14 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1318 microversion: 2.1 time: 0.461180 Aug 24 02:06:18.636768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2498/3490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:18 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:18.642822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f16179e-ad55-4603-881c-f1d66b1d764a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91116e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:18.714855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f16179e-ad55-4603-881c-f1d66b1d764a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.076324 Aug 24 02:06:18.715849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2499/3491] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:18 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:18.817604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f85b3f02-fc51-4716-a8d6-b37b42c2083e", "name": "network-vif-deleted", "tag": "d65585b0-6783-4b18-8835-f352cbf6ff09"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:18.829200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.830072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.830747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.843084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] Creating event network-vif-deleted:d65585b0-6783-4b18-8835-f352cbf6ff09 for instance f85b3f02-fc51-4716-a8d6-b37b42c2083e on n-h1-854121-3 Aug 24 02:06:18.849076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a287a420-6b84-431c-9763-f37b96c8d4d8 req-253485fc-32dc-4fe2-a9bb-0f39f0e6c241 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131364 Aug 24 02:06:18.850222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2500/3492] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:18.861155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "2bf1c21f-a29e-41ab-a631-6dff684ae532"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:18.874246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.875152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.875822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.890357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] Creating event network-changed:2bf1c21f-a29e-41ab-a631-6dff684ae532 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:18.899059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-55d0390d-2158-491d-b376-974c5fe1329b req-8a87316d-da2f-47ef-a6d5-05e6c838813d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047122 Aug 24 02:06:18.899838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2501/3493] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:18.905752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:18.906455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: f85b3f02-fc51-4716-a8d6-b37b42c2083e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:18.924029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.925258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.926517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.928092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.928849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.929549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.950779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] HTTP exception thrown: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Request method failure captured: Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e HTTP/1.1 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbl-EfvipA3kgXXuO7Jux9_etaFGa89-cU5Ze-DWlgUPNbOAGbzh3RqqfR4UGiwn-uz7v5hfh5s8p_cwgHrUuhmsQn-gvemq2MJeJ0Of3mkNeyWUhjrbEQbdTL-y8o9pJT20BIwbHpceorlypJ2DDE5dAEuatFpvcnYeNw3lvXKkMk Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3fcba851bcb3469d9863b8e2c05c9def Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f85b3f02-fc51-4716-a8d6-b37b42c2083e'} Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:18.953340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. Aug 24 02:06:18.959526 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:18.962401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Returning 404 to user: Instance f85b3f02-fc51-4716-a8d6-b37b42c2083e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:18.962401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5cc55e2-76f0-44c9-a5f5-600c0fdedac3 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e" status: 404 len: 111 microversion: 2.1 time: 0.060683 Aug 24 02:06:18.964197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2502/3494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:18 2022] GET /compute/v2.1/servers/f85b3f02-fc51-4716-a8d6-b37b42c2083e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:18.972434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:18.972960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:18.992480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.993008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.993453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:18.994305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:18.994772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:18.995202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.030896 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] HTTP exception thrown: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Request method failure captured: Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 HTTP/1.1 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbl-EfvipA3kgXXuO7Jux9_etaFGa89-cU5Ze-DWlgUPNbOAGbzh3RqqfR4UGiwn-uz7v5hfh5s8p_cwgHrUuhmsQn-gvemq2MJeJ0Of3mkNeyWUhjrbEQbdTL-y8o9pJT20BIwbHpceorlypJ2DDE5dAEuatFpvcnYeNw3lvXKkMk Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3fcba851bcb3469d9863b8e2c05c9def Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '08bdce99-6184-44e9-8f33-9e77c90260b3'} Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:19.032465 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.037986 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.041309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Returning 404 to user: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:19.057563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2523c6b7-b766-4ec2-bd72-2a7a6b1daf50 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 404 len: 111 microversion: 2.1 time: 0.087808 Aug 24 02:06:19.060993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2503/3495] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:18 2022] DELETE /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:19.073945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:19.078236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 08bdce99-6184-44e9-8f33-9e77c90260b3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:19.091191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.093928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.096001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.097034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.099233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.100381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.129948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] HTTP exception thrown: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Request method failure captured: Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 HTTP/1.1 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbl-EfvipA3kgXXuO7Jux9_etaFGa89-cU5Ze-DWlgUPNbOAGbzh3RqqfR4UGiwn-uz7v5hfh5s8p_cwgHrUuhmsQn-gvemq2MJeJ0Of3mkNeyWUhjrbEQbdTL-y8o9pJT20BIwbHpceorlypJ2DDE5dAEuatFpvcnYeNw3lvXKkMk Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3fcba851bcb3469d9863b8e2c05c9def Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '08bdce99-6184-44e9-8f33-9e77c90260b3'} Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.132306 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. Aug 24 02:06:19.137011 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.139992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Returning 404 to user: Instance 08bdce99-6184-44e9-8f33-9e77c90260b3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:19.142205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f2d6192-1412-44db-9b9c-51f774d3cb69 tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3" status: 404 len: 111 microversion: 2.1 time: 0.075826 Aug 24 02:06:19.144983 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2504/3496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:19 2022] GET /compute/v2.1/servers/08bdce99-6184-44e9-8f33-9e77c90260b3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:19.155473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:19.156366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:19.164634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.165463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.166155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.167141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.168384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.169715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.187109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] HTTP exception thrown: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Request method failure captured: Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 HTTP/1.1 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbl-EfvipA3kgXXuO7Jux9_etaFGa89-cU5Ze-DWlgUPNbOAGbzh3RqqfR4UGiwn-uz7v5hfh5s8p_cwgHrUuhmsQn-gvemq2MJeJ0Of3mkNeyWUhjrbEQbdTL-y8o9pJT20BIwbHpceorlypJ2DDE5dAEuatFpvcnYeNw3lvXKkMk Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3fcba851bcb3469d9863b8e2c05c9def Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3fb885c1-58d5-4cde-8fe5-90ebaf803680'} Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:19.191342 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.198338 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.202369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Returning 404 to user: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:19.204231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c49fe9b7-9c52-436a-913e-db52ae3d857b tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 404 len: 111 microversion: 2.1 time: 0.055422 Aug 24 02:06:19.205410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2505/3497] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:19 2022] DELETE /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:06:19.211674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:19.212700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:19.220298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.221945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.222629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.224383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.225166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.226075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.585914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:19.605580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:19.609280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:19.610734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bb00d11-aada-43c5-af75-24a6d828f8be tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.404025 Aug 24 02:06:19.615895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2506/3498] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:19 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:19.628702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:19.630329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] [instance: 3fb885c1-58d5-4cde-8fe5-90ebaf803680] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:19.640542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.641058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.641494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.642208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.642708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.643068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.671138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] HTTP exception thrown: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Request method failure captured: Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 HTTP/1.1 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbl-EfvipA3kgXXuO7Jux9_etaFGa89-cU5Ze-DWlgUPNbOAGbzh3RqqfR4UGiwn-uz7v5hfh5s8p_cwgHrUuhmsQn-gvemq2MJeJ0Of3mkNeyWUhjrbEQbdTL-y8o9pJT20BIwbHpceorlypJ2DDE5dAEuatFpvcnYeNw3lvXKkMk Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7bdf5f642ad44132a9e7320cbaedae81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7bdf5f642ad44132a9e7320cbaedae81 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-232459535 Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3fcba851bcb3469d9863b8e2c05c9def Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-232459535-project Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3fb885c1-58d5-4cde-8fe5-90ebaf803680'} Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:19.679390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:19.686554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] Returning 404 to user: Instance 3fb885c1-58d5-4cde-8fe5-90ebaf803680 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:19.692688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c135f617-653c-4e84-9fe8-35545929db1c tempest-ServerDiskConfigTestJSON-232459535 tempest-ServerDiskConfigTestJSON-232459535-project] 10.222.0.49 "GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680" status: 404 len: 111 microversion: 2.1 time: 0.075001 Aug 24 02:06:19.697807 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2507/3499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:19 2022] GET /compute/v2.1/servers/3fb885c1-58d5-4cde-8fe5-90ebaf803680 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:19.710207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:19.711195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:19.725317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.729038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.733700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:19.735189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:19.735783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:19.736334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:20.453509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:20.469506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4684aa98-a85d-40b8-9bbb-9c6f9b68b8d6 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1575 microversion: 2.1 time: 0.769643 Aug 24 02:06:20.470612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2508/3500] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:19 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1575 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:20.481241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:20.483907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:20.500003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:20.506115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:20.509243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:20.510181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:20.517019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:20.517917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:20.955785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:20.987224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3282b86c-ea34-4348-8a98-6a95b4f13a11 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1499 microversion: 2.1 time: 0.516061 Aug 24 02:06:20.994210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2509/3501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:20 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1499 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:21.005226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0638ccaa-4f6e-49be-a4e1-15d5e1250eff tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91160430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:21.075965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0638ccaa-4f6e-49be-a4e1-15d5e1250eff tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.079466 Aug 24 02:06:21.078546 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2510/3502] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:20 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:21.087077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:21.087981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:21.096900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:21.097669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:21.098322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:21.100140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:21.100847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:21.101467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:21.708875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:21.726404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:21.744261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:21.749010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d3d6cf2-33be-487e-816f-52d56022f3b4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.668714 Aug 24 02:06:21.757208 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2511/3503] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:21 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:21.762322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "992a88a2-6fc6-40a0-b337-eabd50ecd258"}, {"name": "network-changed", "server_uuid": "d9f3eb55-e9b4-4331-9a51-f9a2c23d759c", "tag": "12f2a002-0b08-4591-a977-8c555e3c6843"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:21.789034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:21.789855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:21.790525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:21.822317 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Creating event network-changed:992a88a2-6fc6-40a0-b337-eabd50ecd258 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:06:21.823074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] Creating event network-changed:12f2a002-0b08-4591-a977-8c555e3c6843 for instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c on n-h1-854121-3 Aug 24 02:06:21.830902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ba472a85-5f3d-4a76-89ca-1f94b95f8484 req-4c6e7c0c-674d-432c-bb30-d8632f65892f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072102 Aug 24 02:06:21.832166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2512/3504] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:21.838755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:21.840788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:21.847790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:21.848624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:21.849327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:21.850199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:21.850664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:21.851101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:22.207023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:22.232916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7952306-3bc5-44e4-b06d-35f7f026e731 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1499 microversion: 2.1 time: 0.398341 Aug 24 02:06:22.240700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2513/3505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:21 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1499 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:22.250011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90b90d16-c154-4682-8f14-edd364b38290 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91280b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:22.344510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90b90d16-c154-4682-8f14-edd364b38290 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.092907 Aug 24 02:06:22.350751 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2514/3506] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:22 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:22.363461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:22.364337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:22.379256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:22.379750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:22.380182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:22.383383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:22.390182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:22.391799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:22.452773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:06:22.692990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4536600-2e7a-4d30-baf2-b8fa4a23ca0a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 204 len: 0 microversion: 2.1 time: 0.340611 Aug 24 02:06:22.697077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2515/3507] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:22 2022] DELETE /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:06:22.710044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:22.711302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:22.725237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:22.726030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:22.726643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:22.727536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:22.727988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:22.728410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:22.732930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:23.000696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:23.009535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5663a8e7-cc54-475a-9960-7b7f463a1086 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1505 microversion: 2.1 time: 0.311201 Aug 24 02:06:23.023670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2516/3508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:22 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:23.028836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:23.029435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:23.035837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:23.036527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:23.037402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:23.038365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:23.039087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:23.039801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:23.475153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:23.502889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:23.505717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:23.507845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b5c92a3-68b1-434b-bf77-4a248db424fe tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.483080 Aug 24 02:06:23.524696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2517/3509] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:23 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:23.529875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c50cd312-ef18-4bcd-a11d-e29adc897f22 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b914a69d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:23.597734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c50cd312-ef18-4bcd-a11d-e29adc897f22 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.071633 Aug 24 02:06:23.605682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2518/3510] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:23 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:24.030728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:24.031356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:24.042795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:24.043294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:24.043740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:24.044452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:24.049569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:24.051172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:24.522286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:24.531862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6cb9d72-d55d-4871-a42c-3e8d5d2a77cc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1505 microversion: 2.1 time: 0.505490 Aug 24 02:06:24.532457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2519/3511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:24 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:24.559344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:24.562913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:24.572968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:24.574209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:24.574811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:24.575690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:24.576136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:24.577860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:25.217463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:25.232525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:25.232525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:25.232905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1a5cc4f-02ae-4678-9e49-e7fd1e30ff13 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.684295 Aug 24 02:06:25.245998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2520/3512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:24 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:25.254936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0879c72e-dfc7-478e-a078-0ab1432a0e3a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b911164c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:25.315640 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0879c72e-dfc7-478e-a078-0ab1432a0e3a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.068199 Aug 24 02:06:25.317850 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2521/3513] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:25 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:25.557017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:25.559037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:25.570025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:25.578777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:25.579631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:25.580613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:25.581824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:25.582883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:25.770021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:25.803309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ed95da1-fc2e-4835-a287-dd60b16575b0 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 200 len: 1463 microversion: 2.1 time: 0.253412 Aug 24 02:06:25.809595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2522/3514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:25 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 1463 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:25.924058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20921901-2044-462f-b074-ef15308c7696", "name": "network-vif-deleted", "tag": "5ff554fa-71bb-496c-b378-e422ed79c254"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:25.939991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:25.961878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:25.962688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:26.012062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] Creating event network-vif-deleted:5ff554fa-71bb-496c-b378-e422ed79c254 for instance 20921901-2044-462f-b074-ef15308c7696 on n-h1-854121-3 Aug 24 02:06:26.037824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-44368cba-2847-4f1a-b900-3637416b18f7 req-f15bd3a0-af71-477b-94a1-21520f50bc4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115890 Aug 24 02:06:26.038722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2523/3515] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:26.261367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:26.262106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:26.274943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:26.275491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:26.278187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:26.278918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:26.279377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:26.281220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:26.839150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:26.853016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:26.854578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:26.858922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72acf66e-18c5-4974-ad15-4812499e14ed tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.602362 Aug 24 02:06:26.863975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2524/3516] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:26 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:06:26.869862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba6fe67b-0c9d-47af-8c47-f738693c3aba tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910f3670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:26.983688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba6fe67b-0c9d-47af-8c47-f738693c3aba tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1422 microversion: 2.1 time: 0.118342 Aug 24 02:06:27.004856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2525/3517] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:26 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:27.023592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:27.025349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:27.038954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:27.039794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:27.040464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:27.041908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:27.042920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:27.043535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:27.061001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 HTTP/1.1 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '20921901-2044-462f-b074-ef15308c7696'} Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:27.062685 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:27.067547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f5d4b2a-9ddf-4bcf-a2f8-5c9836ea3633 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 404 len: 111 microversion: 2.1 time: 0.054248 Aug 24 02:06:27.070669 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2526/3518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:27 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:27.082251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39c61d53-9349-4a74-b8b0-cf5191c83596 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: .version_select at 0x7f6b910f3f70>, body: {"keypair": {"name": "tempest-key-448540313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNu6hU85FiDAf7cVCD7xm5Ug/jhVQVTYGYxu2B1bjAum0clZDIuEtQu8Opvrk3tr4yauC4pZRbpwr5RK1nUEdb38P4DVFgBjy+65IoX9hmLrqA3E2482sqATpzTgPQknw=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:27.108655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-39c61d53-9349-4a74-b8b0-cf5191c83596 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:06:27.115342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-39c61d53-9349-4a74-b8b0-cf5191c83596 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:06:27.148429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:27.185833 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39c61d53-9349-4a74-b8b0-cf5191c83596 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.106969 Aug 24 02:06:27.186633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2527/3519] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:06:27 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:27.198032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f65586f-7715-4579-a6ca-d8b99c29dc65 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '.version_select at 0x7f6b911164c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:27.205534 n-d-854121-3 devstack@n-api.service[128567]: WARNING oslo_db.sqlalchemy.utils [None req-6f65586f-7715-4579-a6ca-d8b99c29dc65 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 02:06:27.212622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f65586f-7715-4579-a6ca-d8b99c29dc65 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019463 Aug 24 02:06:27.213263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2528/3520] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:06:27 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:27.329957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2059096217", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-key-448540313", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:27.400422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:06:28.604108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:06:28.605844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:06:28.606357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:06:28.608116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:06:28.609361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:06:28.623285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:28.624870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:28.625348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:28.626821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:28.627499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:28.628779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:28.651958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:06:28.658072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:06:28.672181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:06:28.674786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:06:28.732194 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4716d0a7-3b86-492a-9700-3ee2d21fbd0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406862 Aug 24 02:06:28.732956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2529/3521] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:06:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:06:28.738012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:28.739150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:28.745422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:28.746805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:28.747481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:28.748560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:28.749053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:28.749488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:29.034445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:29.045416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:29.046932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:29.048279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ceedaa65-7bb8-42bd-bc41-71108e5d099e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.314127 Aug 24 02:06:29.048889 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2530/3522] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:28 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:29.056946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6172d6f6-90cb-49bc-99a5-638daceafaf1 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910f33a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.111093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6172d6f6-90cb-49bc-99a5-638daceafaf1 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1431 microversion: 2.1 time: 0.060530 Aug 24 02:06:29.113227 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2531/3523] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1431 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:29.118799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c12e64-af05-454d-a72d-3e3d36cb8fd9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.119781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92c12e64-af05-454d-a72d-3e3d36cb8fd9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:29.185543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92c12e64-af05-454d-a72d-3e3d36cb8fd9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:29.194555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92c12e64-af05-454d-a72d-3e3d36cb8fd9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1228 microversion: 2.1 time: 0.079544 Aug 24 02:06:29.195554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2532/3524] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1228 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:29.200981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18b3d58b-a92e-4d59-a9c8-e3fcb384fd6d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91156160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.266708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18b3d58b-a92e-4d59-a9c8-e3fcb384fd6d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 200 len: 1431 microversion: 2.1 time: 0.069510 Aug 24 02:06:29.267307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2533/3525] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 1431 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:29.284737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.285571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:29.292791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:29.293465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:29.294078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:29.294960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:29.295416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:29.295846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:29.558787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:29.569165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adb6dd1f-3d03-466a-8200-82bf0b8d1f58 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1466 microversion: 2.1 time: 0.288169 Aug 24 02:06:29.570037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2534/3526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:29.590146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a1fcf78-8ee2-4c71-a948-006092d63d4f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b911561f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.643574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a1fcf78-8ee2-4c71-a948-006092d63d4f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5" status: 200 len: 784 microversion: 2.1 time: 0.057163 Aug 24 02:06:29.645960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2535/3527] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/images/71c852a4-8aa1-4649-8920-fa03a58666b5 => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:06:29.660082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd0165cd-fbd2-4a15-a3b9-dfd8cdd53a1b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:29.671251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd0165cd-fbd2-4a15-a3b9-dfd8cdd53a1b tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015557 Aug 24 02:06:29.672763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2536/3528] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:06:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:29.683370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-415846b1-f203-4c83-b10d-299383f973a3 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91176ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:30.476255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-415846b1-f203-4c83-b10d-299383f973a3 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "DELETE /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 204 len: 0 microversion: 2.1 time: 0.796595 Aug 24 02:06:30.476936 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2537/3529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:29 2022] DELETE /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:06:30.485555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:30.486458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:30.492912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:30.493707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:30.494388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:30.495374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:30.496041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:30.497151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:31.062371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:31.074567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:31.088543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:31.089839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35a43b18-08db-4d65-929e-6572235f817d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.608103 Aug 24 02:06:31.090416 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2538/3530] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:30 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:31.095190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:31.096056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:31.102305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:31.102920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:31.103427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:31.104933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:31.105595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:31.106231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:31.271924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:31.280164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17c0b5f3-095a-445f-9b7d-6ad6d1875933 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1286 microversion: 2.1 time: 0.188490 Aug 24 02:06:31.280754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2539/3531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:31 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:31.285418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f75a9ca-7501-42a4-b3f4-46f53418f271 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910cb790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:31.309691 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4f75a9ca-7501-42a4-b3f4-46f53418f271 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] HTTP exception thrown: Image not found. Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f75a9ca-7501-42a4-b3f4-46f53418f271 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Request method failure captured: Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 HTTP/1.1 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdrjDxaDUXyN5eDeYxk6Tc98DUcULxjDeMkcMeVEXJ7uezcRgYEHMi-R7uEx_PVQBMiN5Pr4Rbm3qkbagkrR0Q8Ojma6ov7ol88IYPGVI4kDYJyF_a1hdnpcijvvp8GALiVuunMYK8fsD5YXgSa3EYIaM-bPfqkWZjjcJLGZyQNiHo Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3391637b8e414b895e9def0e60576f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 289c59701d81423aa29b8f2120f2d95f Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f9584558-231f-4118-8b2d-07eb0f364f55'} Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f9584558-231f-4118-8b2d-07eb0f364f55 Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:06:31.311740 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f9584558-231f-4118-8b2d-07eb0f364f55 could not be found. Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f75a9ca-7501-42a4-b3f4-46f53418f271 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f75a9ca-7501-42a4-b3f4-46f53418f271 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 404 len: 62 microversion: 2.1 time: 0.031207 Aug 24 02:06:31.318647 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2540/3532] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:31 2022] GET /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:06:31.323619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-115605742"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:31.326023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:31.333632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:31.334349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:31.334796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:31.335505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:31.335970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:31.336397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:31.539342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92e006f6-244c-4954-889e-e18c2afe365f tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "POST /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3/action" status: 202 len: 0 microversion: 2.1 time: 0.219427 Aug 24 02:06:31.540747 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2541/3533] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:06:31 2022] POST /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 02:06:31.557323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-809b0975-2bda-4ef1-885b-b2785bc5baa4 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b914bf4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:31.617979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-809b0975-2bda-4ef1-885b-b2785bc5baa4 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.066073 Aug 24 02:06:31.618571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2542/3534] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:31 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:32.051259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-unplugged", "status": "completed", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:32.065234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:32.066756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:32.068064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:32.083760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] Creating event network-vif-unplugged:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:06:32.089753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3076e986-77d3-4e68-9de4-038f4286bf83 req-4b7bfc01-ea6a-4892-b509-461e90b77c40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043832 Aug 24 02:06:32.091162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2543/3535] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:06:32.119200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:32.121115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:32.128248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:32.129088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:32.129925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:32.131143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:32.131868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:32.133570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:32.981636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:32.999257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:33.000782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:33.002467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e5cedc5-88bc-44a7-80bb-bfb590a5561f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.891511 Aug 24 02:06:33.017458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2544/3536] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:32 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:33.023648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:33.024537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:33.031051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:33.031887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:33.033082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:33.034241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:33.034931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:33.035573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:33.650209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:33.679303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1f8fae8-a840-4efa-86ce-245a38faa8ed tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.660589 Aug 24 02:06:33.689859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2545/3537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:33 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:33.694901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4edd9814-f33d-4545-b58c-a157c9da4c7a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b913388b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:33.761555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4edd9814-f33d-4545-b58c-a157c9da4c7a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.069253 Aug 24 02:06:33.762572 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2546/3538] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:33 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:34.031146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:34.032154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:34.039350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:34.040412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:34.041250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:34.042339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:34.043045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:34.043706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:34.668410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:34.681016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:34.682632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:34.690832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54146b00-6bc0-42a4-817b-37583d2af1e3 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.660434 Aug 24 02:06:34.705790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2547/3539] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:34 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:06:34.714621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:34.715346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:34.722675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:34.723261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:34.723774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:34.724554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:34.725101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:34.725598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:34.753546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:35.247441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:35.267328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7aee1fee-73fe-4a38-880c-daacba98b622 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.557884 Aug 24 02:06:35.268130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2548/3540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:34 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:35.281165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6978a0e7-c3cd-4950-9337-d29646a126dc tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b911f1d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:35.356455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6978a0e7-c3cd-4950-9337-d29646a126dc tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.082454 Aug 24 02:06:35.358902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2549/3541] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:35 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:35.597459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bee85f-a32b-4c24-950d-5565e17de841", "tag": "852ade58-dc1d-4617-b9ad-d56add493b58"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:35.628393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:35.629291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:35.629919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:35.644664 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] Creating event network-changed:852ade58-dc1d-4617-b9ad-d56add493b58 for instance a1bee85f-a32b-4c24-950d-5565e17de841 on n-h2-854121-3 Aug 24 02:06:35.653538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-826b50a9-9e16-4e4d-a5d7-085fa1349c8c req-59e6f9e7-821a-4aa6-8161-6bce2ac1a10f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059932 Aug 24 02:06:35.654977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2550/3542] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:06:35.721430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:35.722145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:35.743814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:35.744595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:35.745309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:35.746224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:35.746830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:35.748430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:36.287433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:36.302228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:36.307625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:36.311456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9def7336-de10-4e40-af1d-df4e52a657bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.593979 Aug 24 02:06:36.312283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2551/3543] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:35 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:06:36.322269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:36.322893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:36.338555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:36.339632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:36.347685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:36.350716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:36.352619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:36.353325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:36.821979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:36.839260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ca554de-169d-43e1-9131-e0a71af5dd7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.522156 Aug 24 02:06:36.840649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2552/3544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:36 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:36.846166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c8c828d-03c3-4fe5-a30a-7b81e33140bd tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b9125a820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:36.935669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c8c828d-03c3-4fe5-a30a-7b81e33140bd tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.093746 Aug 24 02:06:36.936629 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2553/3545] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:36 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:37.100317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-729453470", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e8513b21-8146-4217-b47a-25a003b3a715"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:37.158832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] validate_networks() for [('e8513b21-8146-4217-b47a-25a003b3a715', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:06:37.574855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:06:37.575289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:06:37.575773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:06:37.576190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:06:37.576608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:06:37.589705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:37.590194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:37.590635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:37.591712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:37.592173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:37.592603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:37.614804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Getting quotas for project c0a21329efc94d5d91b34d00fd5f2a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:06:37.621475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Getting quotas for user 3013b4616ccf47b3b3edafd4f8c462cb and project c0a21329efc94d5d91b34d00fd5f2a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:06:37.640521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Going to run 3 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:06:37.643088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:06:37.677940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=b956c91f-aa1c-421d-b304-a7ac8c7c9eea,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:06:37.720798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=431458cb-650e-45b0-b196-cecf52fa03d1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:06:37.835117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bfa52a2-16a8-419b-a451-a5ebc12f9fce tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864946 Aug 24 02:06:37.836323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2554/3546] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:06:37.845284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:37.846024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:37.855334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:37.856291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:37.856956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:37.858058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:37.859122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:37.860569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:38.507117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:38.525404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:38.527492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:38.528626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d857a79-dada-4cdb-a59f-18a1eb38bdcc tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.691343 Aug 24 02:06:38.548070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2555/3547] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:37 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:38.554536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:38.560033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:38.561755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:06:38.587374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:38.588172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:38.589392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:38.590452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:38.590905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:38.591591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:38.625191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:06:38.655456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-beabca3f-4140-447d-8bd4-78d4dc9177bc tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.105676 Aug 24 02:06:38.656374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2556/3548] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:06:38 2022] GET /compute/v2.1/servers => generated 1015 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:38.668791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:38.669413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:38.677108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:38.677968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:38.678391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:38.679118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:38.679916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:38.680556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.011131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:39.031550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07e517e6-1331-485c-ab10-7b1db262afa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.366805 Aug 24 02:06:39.034544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2557/3549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:38 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:39.047224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-plugged", "status": "completed", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:39.070365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:39.071185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:39.071634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.119635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] Creating event network-vif-plugged:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:06:39.131384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e120a8f0-e867-4e33-8b70-94bed90a4cde req-9f4e501f-9094-44c7-89cd-2a07f04794d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093778 Aug 24 02:06:39.132828 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2558/3550] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:39.142084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7086c37f-a7f1-48be-8206-8f2037c6b5b6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910cb1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:39.216525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7086c37f-a7f1-48be-8206-8f2037c6b5b6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.081406 Aug 24 02:06:39.217781 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2559/3551] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:39 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:39.228937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:39.230613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:39.238819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:39.239714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:39.240461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.241467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:39.242155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:39.243417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.360076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:39.374075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba3450c5-39f8-4189-abee-4f67d7c10b83 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1218 microversion: 2.1 time: 0.154777 Aug 24 02:06:39.374777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2560/3552] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:39 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:39.555656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:39.556283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:39.563006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:39.563710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:39.564326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.565453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:39.566176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:39.566798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:39.928547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:39.944336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:39.945901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:39.947078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d95873a-f3f4-47ae-8251-537f36240da8 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.395356 Aug 24 02:06:39.947654 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2561/3553] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:39 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:40.055467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:40.056413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:40.069953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.070714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.071310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:40.072180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.073365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.073994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:40.674611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:40.692289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b110ad4-0c9a-44a6-918d-6466832b0a59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.640504 Aug 24 02:06:40.692914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2562/3554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:40 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:40.717556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf81265f-3bc6-4e80-8cbc-1544b4202370 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910f30d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:40.784088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf81265f-3bc6-4e80-8cbc-1544b4202370 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.090076 Aug 24 02:06:40.784666 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2563/3555] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:40 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:40.799599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:40.802274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:40.817270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.817795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.818237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:40.819726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.820248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.821818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:40.936997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:40.946469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-713c2cb0-ea57-4697-bbe1-d5139fcefe8e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1280 microversion: 2.1 time: 0.159234 Aug 24 02:06:40.949184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2564/3556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:40 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:40.975403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:40.976149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:40.990999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.991223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.991813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:40.992627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:40.993235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:40.994174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:41.438752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:41.460163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:41.461874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:41.464773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d71e274-050c-4f9e-adca-f2734b2f23d6 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.493351 Aug 24 02:06:41.481645 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2565/3557] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:40 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:06:41.720870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:41.721571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:41.728350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:41.740907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:41.746372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:41.749681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:41.751400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:41.754411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:42.760903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:42.769550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7381806-8e01-4df0-bf58-53aa64fa11b2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 1.053095 Aug 24 02:06:42.778242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2566/3558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:41 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:42.785368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b81202d-5e27-4333-ad83-b298135494eb tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910b4af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:42.891127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b81202d-5e27-4333-ad83-b298135494eb tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.111590 Aug 24 02:06:42.892140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2567/3559] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:42 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:42.902917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:42.921602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:42.926306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:42.947515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:42.949019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:42.949714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:42.950724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:42.951524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:42.952373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:43.249834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:43.262320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77f5d156-e212-457f-a6c6-d32f6984528f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.368859 Aug 24 02:06:43.263501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2568/3560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:42 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:43.268404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:43.269058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:43.285968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:43.286867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:43.287873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:43.290359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:43.291111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:43.292378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:43.638586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:43.657206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:43.663940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:43.665455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c96627f8-78d2-4d5f-a290-8a1f74fdad6f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.400664 Aug 24 02:06:43.666198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2569/3561] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:43 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:43.798334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:43.800468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:43.818328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:43.819514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:43.820346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:43.821325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:43.822310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:43.824201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.206072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:44.219798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f600ba42-c208-4dd5-960a-59eaf48d7c7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.425319 Aug 24 02:06:44.222933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2570/3562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:43 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:44.240391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-133086e9-a8bd-482e-9ad8-e0e1a5cf292d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91085dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:44.335621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-133086e9-a8bd-482e-9ad8-e0e1a5cf292d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.108086 Aug 24 02:06:44.336206 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2571/3563] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:44 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:44.347314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de891cd6-a82d-4ff6-9f02-f3716e18a831", "tag": "0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:44.385825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.386922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.390516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.437612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] Creating event network-changed:0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a for instance de891cd6-a82d-4ff6-9f02-f3716e18a831 on n-h1-854121-3 Aug 24 02:06:44.453903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e13fbbc7-500c-4131-b3a0-bc0f9670e312 req-a944d6a4-34a8-4222-a3e2-b2d3afd98b8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114260 Aug 24 02:06:44.456946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2572/3564] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:44.483816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:44.492082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:44.513886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.529547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.532590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.534111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.534600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.535236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.542322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:44.876385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:44.891947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45eb351f-51af-44d1-9ed1-28e264eb9096 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.431538 Aug 24 02:06:44.898183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2573/3565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:44 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:44.905168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bee85f-a32b-4c24-950d-5565e17de841", "name": "network-vif-plugged", "status": "completed", "tag": "852ade58-dc1d-4617-b9ad-d56add493b58"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:44.923241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.924339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.925741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.950696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] Creating event network-vif-plugged:852ade58-dc1d-4617-b9ad-d56add493b58 for instance a1bee85f-a32b-4c24-950d-5565e17de841 on n-h2-854121-3 Aug 24 02:06:44.958507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9d5de33d-86f4-4284-bee6-e4e48732f3be req-44b94bfb-c4ae-4a4a-b565-3cfbd8674c22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058327 Aug 24 02:06:44.959119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2574/3566] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:44.965983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:44.966875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:44.981065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.982282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.985521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:44.986994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:44.986994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:44.987719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:45.333069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:45.364048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:45.373230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:45.376780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-169c2a44-9b0e-4a4a-84cd-c3cd1747779d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.415440 Aug 24 02:06:45.380199 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2575/3567] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:44 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:45.393258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:45.398791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:45.406826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:45.407566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:45.408307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:45.409313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:45.409944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:45.410528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:45.600648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:45.610178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a34c2c8b-f903-4ba4-b351-01b2217d07eb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1328 microversion: 2.1 time: 0.223925 Aug 24 02:06:45.628709 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2576/3568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:45 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:45.633842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26e66f70-d9f9-45e9-8b69-b5f80e9a06fd tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910f3940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:45.708170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26e66f70-d9f9-45e9-8b69-b5f80e9a06fd tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.077514 Aug 24 02:06:45.710119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2577/3569] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:45 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:45.917113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:45.918563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:45.926715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:45.927574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:45.928260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:45.929522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:45.930352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:45.931120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:46.132565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:46.142228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd645c8b-064b-4c5b-b1b4-afd26faf73a7 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.230354 Aug 24 02:06:46.143491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2578/3570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:45 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:46.409123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:46.411088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:46.450983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:46.452021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:46.455832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:46.459286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:46.460034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:46.460531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:46.815407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:46.826111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:46.834978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:46.836552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0dc17b9a-c75a-4464-9c22-d3d8bec67b59 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.436022 Aug 24 02:06:46.837566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2579/3571] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:46 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:46.845216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b956c91f-aa1c-421d-b304-a7ac8c7c9eea", "tag": "c82d0f97-cd7e-49b0-a905-e55cc7c156aa"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:46.884353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:46.885561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:46.886768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:46.908946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] Creating event network-changed:c82d0f97-cd7e-49b0-a905-e55cc7c156aa for instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea on n-h2-854121-3 Aug 24 02:06:46.915877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c7734095-dadf-4366-a449-4dcac7890dc0 req-596b5a35-c009-4464-a3e2-e5ee28ea9f12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076874 Aug 24 02:06:46.918004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2580/3572] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:46.925146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:46.926323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:46.935746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:46.937245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:46.938099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:46.939713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:46.940631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:46.947206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:47.176125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:47.184605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34e2d97b-a7ee-4c93-9af8-81ba38edb693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1509 microversion: 2.1 time: 0.264580 Aug 24 02:06:47.201131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2581/3573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:46 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:47.207119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:47.207630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:47.224305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:47.224885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:47.225382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:47.226313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:47.233090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:47.233090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:47.283604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92531072-c031-421e-892f-3a984717d31b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/ips" status: 200 len: 150 microversion: 2.1 time: 0.080372 Aug 24 02:06:47.292900 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2582/3574] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:06:47 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:47.297925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd34f297-b96c-4ac3-8e81-da0209e06264 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910cfca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:47.361273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd34f297-b96c-4ac3-8e81-da0209e06264 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.067126 Aug 24 02:06:47.362741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2583/3575] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:47 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:47.369971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:47.370584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:47.390861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:47.391364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:47.391801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:47.392512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:47.393270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:47.393707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:47.634623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=18 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:48.116325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:48.126163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dad66ede-0723-4eac-9710-e582c0c0446c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.762876 Aug 24 02:06:48.130338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2584/3576] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:47 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:48.137038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:48.137892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:48.144922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.145709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.149656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.150888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.151546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.152151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.318740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:48.328017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d44e5b12-7fb3-446e-b2b1-ecf05a72bc6e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1509 microversion: 2.1 time: 0.196019 Aug 24 02:06:48.328737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2585/3577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:48 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:48.333640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "284dd8e2-45a9-4021-b442-64bd71bfe894"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:48.336440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:48.343757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.344366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.344947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.345869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.347056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.347294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.451659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/os-volume_attachments HTTP/1.1 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 74 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: {"volumeAttachment": {"volumeId": "284dd8e2-45a9-4021-b442-64bd71bfe894"}} Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8', 'body': {'volumeAttachment': {'volumeId': '284dd8e2-45a9-4021-b442-64bd71bfe894'}}} Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:06:48.457430 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b Aug 24 02:06:48.461895 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:48.466420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 400 to user: Invalid volume: volume 284dd8e2-45a9-4021-b442-64bd71bfe894 is already attached to instances: 13a92bf2-2056-40da-9531-f7c02a166c3b {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:48.467860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-baa2ee0a-b095-4914-86a9-ef20cad70cb9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138091 Aug 24 02:06:48.472088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2586/3578] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:06:48 2022] POST /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:06:48.477480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:48.478252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:48.509738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.513794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.514373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.515280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.516114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.516586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.600324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:48.805140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:48.815794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:48.820614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:48.824361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f622575-356c-41de-bf60-791a672b2b27 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.351031 Aug 24 02:06:48.825007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2587/3579] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:48 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:48.866156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:48.866950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:48.876006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.876967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.877601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.879266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:48.880045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:48.880894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:48.914781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:06:49.040918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff1c04fb-1af6-4598-b3f3-ae82d2d1ddeb tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 204 len: 0 microversion: 2.1 time: 0.200797 Aug 24 02:06:49.043240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2588/3580] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:48 2022] DELETE /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:06:49.050421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-275e9563-d089-46e3-ae94-47d0fac1b168 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910b40d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:49.111251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-275e9563-d089-46e3-ae94-47d0fac1b168 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.065589 Aug 24 02:06:49.111846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2589/3581] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:49 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:49.116396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:49.117027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:49.124696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.125232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.125676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.126379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.126838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.127276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.170175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:06:49.306413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fe7f2b1-aed5-47b3-adcd-2ed329eed121 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 204 len: 0 microversion: 2.1 time: 0.193275 Aug 24 02:06:49.311017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2590/3582] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:06:49 2022] DELETE /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:06:49.320553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431458cb-650e-45b0-b196-cecf52fa03d1", "tag": "afc2f79b-dc36-476b-8787-787cfea2e58b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:49.334767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.335196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.335865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.350544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:49.353539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] Creating event network-changed:afc2f79b-dc36-476b-8787-787cfea2e58b for instance 431458cb-650e-45b0-b196-cecf52fa03d1 on n-h2-854121-3 Aug 24 02:06:49.362067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-57ef5d14-20c0-4779-9203-37fac2f2c96f req-562968f8-1787-4040-ac37-ec4af175aee1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046715 Aug 24 02:06:49.363542 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2591/3583] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:49.370796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:49.371631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:49.381599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.382334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.382949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.385238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.385805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.386318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.607894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:49.618284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73bd68b6-def8-4598-9e82-3c0efb5ae9fc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1515 microversion: 2.1 time: 0.252803 Aug 24 02:06:49.619071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2592/3584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:49 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:49.627668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:49.631103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:49.637859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.638596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.639616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.640395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.640919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.641453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.957502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:49.967853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76a5b8d9-bfae-469d-be32-437a59fafe0b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.347313 Aug 24 02:06:49.969372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2593/3585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:49 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:49.980941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:49.981572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:49.988675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.989202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.989642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:49.991039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:49.991502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:49.991928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:50.224951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:50.234977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98b40ff5-c1b0-4fb8-ab3e-b4ce6b9cd82c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1682 microversion: 2.1 time: 0.263906 Aug 24 02:06:50.250252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2594/3586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:49 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:50.262715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:50.263690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:50.270793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:50.271566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:50.272358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:50.273357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:50.273986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:50.274680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:50.518898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:50.533304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:50.535117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:50.536799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66b28212-a920-4612-8c26-44809d0a1e65 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.285223 Aug 24 02:06:50.537980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2595/3587] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:50 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:50.543002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d28437e1-059a-4a4a-bb7d-d02842363553 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910cb790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:50.607063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d28437e1-059a-4a4a-bb7d-d02842363553 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.067322 Aug 24 02:06:50.607762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2596/3588] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:50 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:50.644976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:50.646095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:50.659366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:50.660803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:50.661411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:50.668854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:50.670245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:50.671183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:50.854261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:50.863652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7dd06a3-3022-43e5-877b-5319f6b3f2d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1515 microversion: 2.1 time: 0.224493 Aug 24 02:06:50.877905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2597/3589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:50 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1515 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:50.991078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:50.991722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:51.007794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:51.009419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:51.009942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:51.010892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:51.011465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:51.012131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:51.417250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:51.427982 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-837f913d-6a0c-41bc-8556-2bd4cbc58085 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.442433 Aug 24 02:06:51.442511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2598/3590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:50 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:06:51.447352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:51.447996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:51.459899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:51.460513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:51.471560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:51.475201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:51.475630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:51.476243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:52.053035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:52.063154 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77c0bb9a-a76d-4b8e-8f66-9f42a39d98f4 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1682 microversion: 2.1 time: 0.619506 Aug 24 02:06:52.066578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2599/3591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:51 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1682 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:52.093465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:52.094153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:52.112276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:52.117059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:52.117715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:52.118663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:52.119114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:52.120585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:52.729590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:52.742869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:52.744399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:52.749983 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04ca0f32-c181-4347-bb93-933953b10555 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.680073 Aug 24 02:06:52.763452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2600/3592] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:52 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:52.770012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4343bcf-42c7-41b3-a172-386ccb4f06d4 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91085430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:52.901572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4343bcf-42c7-41b3-a172-386ccb4f06d4 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.143246 Aug 24 02:06:52.902151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2601/3593] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:52 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:52.917314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de891cd6-a82d-4ff6-9f02-f3716e18a831", "name": "network-vif-plugged", "status": "completed", "tag": "0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:52.951340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:52.952669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:52.953164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:52.969010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] Creating event network-vif-plugged:0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a for instance de891cd6-a82d-4ff6-9f02-f3716e18a831 on n-h1-854121-3 Aug 24 02:06:52.982579 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6ca960b5-6a6b-4e6f-9ce8-073583be4998 req-682bcb93-62c5-4082-9918-b6be4aff97b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078900 Aug 24 02:06:52.983550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2602/3594] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:52.996510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:52.999482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:53.012616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:53.014276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:53.016988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:53.018289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:53.021635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:53.022291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:53.498768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:53.509586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34a94be1-ff57-498c-a814-86e65d868693 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1515 microversion: 2.1 time: 0.524718 Aug 24 02:06:53.514296 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2603/3595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:52 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1515 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:53.529017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:53.531113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:53.545641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:53.546333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:53.547010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:53.549400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:53.552099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:53.554200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:54.016150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:54.028491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7cc6e3d4-0086-4fe9-a419-05cfb500ae74 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1322 microversion: 2.1 time: 0.511440 Aug 24 02:06:54.029974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2604/3596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:53 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:54.035305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:54.036014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:54.044574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:54.044574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:54.044574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:54.045245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:54.050411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:54.050879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:54.263217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:54.288250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba18fa37-0824-4702-8362-3f215d39846f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1615 microversion: 2.1 time: 0.257063 Aug 24 02:06:54.309163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2605/3597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:54 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1615 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:54.325897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:54.331459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:54.354355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:54.355045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:54.355671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:54.356418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:54.359421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:54.359925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:54.936785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:54.966510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:54.976309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:54.983563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9252c561-5006-48b7-ad59-8ec2016e95df tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.667915 Aug 24 02:06:55.015831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2606/3598] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:54 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:55.026112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eaf233e-06ba-43c7-b1cd-9bb1e1967246 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b9103dca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:55.155137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8eaf233e-06ba-43c7-b1cd-9bb1e1967246 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.137753 Aug 24 02:06:55.161534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2607/3599] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:55 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:55.198003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bee85f-a32b-4c24-950d-5565e17de841", "name": "network-vif-deleted", "tag": "852ade58-dc1d-4617-b9ad-d56add493b58"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:55.291514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:55.294138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:55.294138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:55.344376 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] Creating event network-vif-deleted:852ade58-dc1d-4617-b9ad-d56add493b58 for instance a1bee85f-a32b-4c24-950d-5565e17de841 on n-h2-854121-3 Aug 24 02:06:55.361652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5b20330f-d8e6-45b1-9c6f-b2a528ce29ad req-38865210-e887-423e-bfb3-76f7c7c2bcb9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195338 Aug 24 02:06:55.366409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2608/3600] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:55.393560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:55.394323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:55.417100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:55.418861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:55.419326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:55.422856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:55.423407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:55.423902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:55.650486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:55.666195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2aed6791-4332-4b03-adc1-27e10a8b2a69 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 200 len: 1313 microversion: 2.1 time: 0.290588 Aug 24 02:06:55.677225 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2609/3601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:55 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:55.688251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:55.688251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:55.708568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:55.709034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:55.713099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:55.721040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:55.721617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:55.722107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.086148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:56.100337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-022c17b5-c821-4501-9377-ba5eca0c905e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 200 len: 1515 microversion: 2.1 time: 0.429862 Aug 24 02:06:56.100970 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2610/3602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:55 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:56.134138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:56.134951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:56.153204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.153890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.156682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.157644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.158270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.159781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.226209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.242216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.253386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.254126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'fault' on Instance uuid e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:06:56.322733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:56.332806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-727e0681-9b94-4a2d-acc4-f8e1371179c2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 200 len: 1332 microversion: 2.1 time: 0.215988 Aug 24 02:06:56.333966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2611/3603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:56 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 1332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:56.338835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:56.339433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:56.370145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.370835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.371467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.372179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.372823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.374229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.413316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:56.800484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:56.811791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:56.814789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:56.816434 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc4945a8-6fc4-492f-bc15-78c26e3059f2 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.481321 Aug 24 02:06:56.827420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2612/3604] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:56 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:56.841973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:56.843137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:56.850539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.851295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.851982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:56.853039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:56.853693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:56.854341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.038616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:57.050810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c78d8f0-5324-481d-be06-c00a43654c7a tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.221384 Aug 24 02:06:57.052461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2613/3605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:56 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:57.059350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d7c6133-562b-4b16-a813-e128f01a8a38 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91160280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:57.125524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d7c6133-562b-4b16-a813-e128f01a8a38 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1426 microversion: 2.1 time: 0.071362 Aug 24 02:06:57.151543 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2614/3606] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:57 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:57.159418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:57.160490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:57.173038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.175773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.177314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.179080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.180556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.183494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.214658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 HTTP/1.1 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a1bee85f-a32b-4c24-950d-5565e17de841'} Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.216432 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.221865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:57.223697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b86f6b0-6764-4b7e-b03c-f77a38f4be3a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 404 len: 111 microversion: 2.1 time: 0.068085 Aug 24 02:06:57.228210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2615/3607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:57 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:57.236790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b956c91f-aa1c-421d-b304-a7ac8c7c9eea", "name": "network-vif-plugged", "status": "completed", "tag": "c82d0f97-cd7e-49b0-a905-e55cc7c156aa"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:57.262862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.263429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.263940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.276359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] Creating event network-vif-plugged:c82d0f97-cd7e-49b0-a905-e55cc7c156aa for instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea on n-h2-854121-3 Aug 24 02:06:57.282095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0592110a-b8f2-47a2-b6dd-1f959f5f670a req-dd554d79-52e6-4a69-a314-a45b71e755c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049343 Aug 24 02:06:57.282780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2616/3608] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:57.293261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07d60d83-5f27-496c-b3b8-b7c914cfeb59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '.version_select at 0x7f6b910b5b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:57.316621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07d60d83-5f27-496c-b3b8-b7c914cfeb59 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-key-448540313" status: 202 len: 0 microversion: 2.1 time: 0.028289 Aug 24 02:06:57.317959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2617/3609] 10.222.0.49 () {58 vars in 1206 bytes} [Wed Aug 24 02:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-448540313 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:06:57.447703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:57.451149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:57.460289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:06:57.473343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.473981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.474536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.475390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.475992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.477311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.542107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 HTTP/1.1 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8'} Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:06:57.546900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:06:57.552631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:06:57.555894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b1b279c-e068-4046-96fb-1249d27557ee tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 404 len: 111 microversion: 2.1 time: 0.197737 Aug 24 02:06:57.555894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2618/3610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:57 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:06:57.565499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8", "name": "network-vif-deleted", "tag": "34b09f1d-cb15-4a16-ac65-60e36a03d55b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:57.595939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:57.596427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:57.601386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:57.630909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] Creating event network-vif-deleted:34b09f1d-cb15-4a16-ac65-60e36a03d55b for instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 on n-h1-854121-3 Aug 24 02:06:57.642916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5f129acc-2400-45ca-a219-2747440fce61 req-94f1b7fa-aaca-459e-aaff-7a630255d9a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085230 Aug 24 02:06:57.649028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2619/3611] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:06:57.659029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbf5e53e-caf4-4bd6-b5b0-7beeb3ad879c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '.version_select at 0x7f6b91116a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:57.688651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbf5e53e-caf4-4bd6-b5b0-7beeb3ad879c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436537364" status: 202 len: 0 microversion: 2.1 time: 0.038183 Aug 24 02:06:57.690019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2620/3612] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1436537364 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:06:57.696496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-738753160", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:06:57.777355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:06:58.476392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:06:58.477065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:06:58.477624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:06:58.478142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:06:58.479250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:06:58.493949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:58.494908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:58.495537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:58.496829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:58.518507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:58.520024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:58.548438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:06:58.556486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:06:58.577501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:06:58.581080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:06:58.692893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51cb92d5-473b-4adb-bef1-351d6e4809c2 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997185 Aug 24 02:06:58.696140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2621/3613] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:06:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:06:58.718434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:58.719894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:58.728344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:58.729577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:58.730302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:58.731294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:58.755278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:58.756586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:59.701588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:59.715067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:59.716875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:59.718240 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6b53cc1-13d4-481a-91ff-e1de424a47bf tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 1.021187 Aug 24 02:06:59.719288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2622/3614] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:06:58 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:06:59.723987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:06:59.724826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:06:59.731497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:59.732302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:59.732951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:59.733801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:06:59.734534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:06:59.735116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:06:59.956815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:06:59.965580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f287424-ca2d-4442-bdc7-2936ecc7798c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.244951 Aug 24 02:06:59.966390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2623/3615] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:06:59 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:06:59.982111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b36fbf24-4039-4284-88dc-636171c63b2d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910f31f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.038816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b36fbf24-4039-4284-88dc-636171c63b2d tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1435 microversion: 2.1 time: 0.071126 Aug 24 02:07:00.050607 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2624/3616] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:06:59 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1435 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:00.060751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.061504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:00.078677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.079443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.080061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.081122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.082032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.082732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.163880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:00.172980 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8cc3ddf8-7c67-4f9c-83bf-95111f38bd26 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1260 microversion: 2.1 time: 0.121179 Aug 24 02:07:00.173991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2625/3617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:00 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1260 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:00.180847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.181625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:00.189781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.190537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.191140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.192011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.201014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.201753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.298459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'services' on Instance uuid 13a92bf2-2056-40da-9531-f7c02a166c3b {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:07:00.444437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-222956a8-e940-4cac-b714-b0e16e1b4276 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments/284dd8e2-45a9-4021-b442-64bd71bfe894" status: 202 len: 0 microversion: 2.1 time: 0.269026 Aug 24 02:07:00.448445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2626/3618] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:07:00 2022] DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments/284dd8e2-45a9-4021-b442-64bd71bfe894 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:07:00.454728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2e09eaa-0966-43b1-a961-f053a0fbc105 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910b5550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.522234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2e09eaa-0966-43b1-a961-f053a0fbc105 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 200 len: 1435 microversion: 2.1 time: 0.071767 Aug 24 02:07:00.523457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2627/3619] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:07:00 2022] GET /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 1435 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:00.530126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.534219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:00.571999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.572967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.586205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.595869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.596521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.597096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.689648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43115942-2428-4b49-bab5-774a8091d9d7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162419 Aug 24 02:07:00.696490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2628/3620] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:00 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:00.711673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:00.712357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:00.723933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.724854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.725018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.725699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:00.726199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:00.727017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:00.987297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:00.997941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25714ce3-b27d-4781-ad71-71b32a7b9719 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1466 microversion: 2.1 time: 0.297178 Aug 24 02:07:01.001542 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2629/3621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:00 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1466 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:01.006850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:01.007726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:01.020412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:01.021484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:01.022303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:01.023025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:01.023484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:01.023922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:01.437214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:01.452340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:01.458803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:01.460391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3d9db5a-9417-4a9e-a06b-d056f557c841 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.457672 Aug 24 02:07:01.481960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2630/3622] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:01 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:01.489786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:01.492359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:01.501994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:01.502946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:01.504675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:01.505941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:01.506666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:01.507960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:01.743693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:01.757136 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ad60118-9af4-43b2-a7f6-e86c8ac8c2d9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.272371 Aug 24 02:07:01.758362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2631/3623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:01 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:01.763340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c1b2ac1-33dc-4b10-a78f-017da87550e2 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b910579d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:02.806080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c1b2ac1-33dc-4b10-a78f-017da87550e2 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "DELETE /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400" status: 204 len: 0 microversion: 2.1 time: 1.046195 Aug 24 02:07:02.807739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2632/3624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:01 2022] DELETE /compute/v2.1/images/0bb8e1a7-8edf-492a-a5fb-280206d5a400 => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:02.815175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "e5033fef-a564-47de-afca-e9f98457ee5f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:02.839284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:02.843690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:02.844350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:02.872428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] Creating event network-vif-plugged:e5033fef-a564-47de-afca-e9f98457ee5f for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:02.880374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-183f045a-d794-4b44-ad29-7ab9f6931690 req-13bb9efb-c682-40d1-aad6-369df75178a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070262 Aug 24 02:07:02.881841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2633/3625] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:02.890934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:02.891999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:02.899743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:02.900505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:02.901226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:02.902109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:02.902757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:02.903402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.378191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:03.390726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74ca62e6-4f19-41cc-8861-48423ff688e4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.506065 Aug 24 02:07:03.391322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2634/3626] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:02 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:03.399333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:03.403203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:03.410823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.411793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.412542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.413584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.414330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.414987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.479228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b4976c1-a37e-468c-951c-89e6b04ca27e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085462 Aug 24 02:07:03.486770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2635/3627] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:03 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:03.495428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:03.500758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:03.514503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.517048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.517771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.519857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.520520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.522117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.936127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:03.949925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:03.956741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:03.960183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc9978af-5d5f-4a37-b0fc-6d3b74ea6e09 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.470935 Aug 24 02:07:03.961379 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2636/3628] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:03 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:03.973466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:03.974349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:03.986625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.989302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.990662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:03.993193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:03.993915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:03.995949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.205452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:04.216870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7303c98-9f7e-4aa5-a4b3-be7a1615bffe tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.253563 Aug 24 02:07:04.220017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2637/3629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:03 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:04.227114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e19b6a18-5380-4411-883d-c13d1234a1d6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '.version_select at 0x7f6b91057e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:04.257081 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e19b6a18-5380-4411-883d-c13d1234a1d6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] HTTP exception thrown: Image not found. Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e19b6a18-5380-4411-883d-c13d1234a1d6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Request method failure captured: Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 HTTP/1.1 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdrjDxaDUXyN5eDeYxk6Tc98DUcULxjDeMkcMeVEXJ7uezcRgYEHMi-R7uEx_PVQBMiN5Pr4Rbm3qkbagkrR0Q8Ojma6ov7ol88IYPGVI4kDYJyF_a1hdnpcijvvp8GALiVuunMYK8fsD5YXgSa3EYIaM-bPfqkWZjjcJLGZyQNiHo Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3391637b8e414b895e9def0e60576f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 289c59701d81423aa29b8f2120f2d95f Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f9584558-231f-4118-8b2d-07eb0f364f55'} Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f9584558-231f-4118-8b2d-07eb0f364f55 to delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f9584558-231f-4118-8b2d-07eb0f364f55 could not be found. Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.259458 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e19b6a18-5380-4411-883d-c13d1234a1d6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e19b6a18-5380-4411-883d-c13d1234a1d6 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "DELETE /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55" status: 404 len: 62 microversion: 2.1 time: 0.040080 Aug 24 02:07:04.265873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2638/3630] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:04 2022] DELETE /compute/v2.1/images/f9584558-231f-4118-8b2d-07eb0f364f55 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:07:04.269284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a0a35f-b094-48f2-83fe-1427ff9814de", "tag": "1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:04.281991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.282488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.282916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.295326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] Creating event network-changed:1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3 for instance 33a0a35f-b094-48f2-83fe-1427ff9814de on n-h2-854121-3 Aug 24 02:07:04.301277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d2ac1117-3ef0-4793-9712-caf1e37ab1b2 req-e0e7a8ed-d44d-4643-a61d-73199589f2b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037426 Aug 24 02:07:04.303308 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2639/3631] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:04.309717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:04.310314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:04.318039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.318927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.319290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.321020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.321490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.321926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.327298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:04.351324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:04.458510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25837130-b87f-4e07-b98e-f1fccfb3b8cf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 204 len: 0 microversion: 2.1 time: 0.153627 Aug 24 02:07:04.459499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2640/3632] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:04 2022] DELETE /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:04.466865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:04.467569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:04.474006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.474661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.475094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.475782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.476538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.476826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.676368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:04.685948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ce83cde-121e-4ecd-a6e0-1212cf541b37 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.225070 Aug 24 02:07:04.686546 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2641/3633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:04 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:04.691823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:04.692665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:04.704852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.706215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.706894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.708192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.708934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.709711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.912214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:04.925654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db56bfbc-69e2-42eb-8e3a-825039da1c19 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1472 microversion: 2.1 time: 0.236703 Aug 24 02:07:04.927440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2642/3634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:04 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:04.933932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:04.937216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:04.953777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.954265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.954944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:04.955726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:04.957418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:04.958038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.004165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1685f3f-b55f-4838-9a3f-385b8d2253ce tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075084 Aug 24 02:07:05.005056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2643/3635] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:04 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:05.011036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:05.011316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:05.018641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.029796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.030849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.031627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.032577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.033058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.312158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:05.326084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:05.327796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:05.329023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ff5c982-06d7-4bab-8bcc-0f3f9e328b76 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.322844 Aug 24 02:07:05.329602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2644/3636] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:05 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:05.334901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "f6e64947-7833-44b6-9b87-8bbfcd12fd50"}, {"server_uuid": "431458cb-650e-45b0-b196-cecf52fa03d1", "name": "network-vif-plugged", "status": "completed", "tag": "afc2f79b-dc36-476b-8787-787cfea2e58b"}, {"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-unplugged", "status": "completed", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:05.354725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.355221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.355687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.381118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Creating event network-vif-plugged:f6e64947-7833-44b6-9b87-8bbfcd12fd50 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:05.381876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Creating event network-vif-plugged:afc2f79b-dc36-476b-8787-787cfea2e58b for instance 431458cb-650e-45b0-b196-cecf52fa03d1 on n-h2-854121-3 Aug 24 02:07:05.382916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] Creating event network-vif-unplugged:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:07:05.415450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bbf43c80-9db7-4c1d-8154-e9013e444e18 req-2aec5284-af57-4261-9053-d41976ea9d35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.084616 Aug 24 02:07:05.417022 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2645/3637] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:05.423678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:05.432267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:05.446720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.447848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.448299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.449072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.449596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.450032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.634370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:05.642843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a924a707-b711-454d-af9d-2c9ec31075d0 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.224474 Aug 24 02:07:05.643428 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2646/3638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:05 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:05.706194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:05.706809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:05.713832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.714322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.714755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.715455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.716093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.716683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.930371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:05.938776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba1f23b4-8f2c-4eca-9a14-ed6376c9cf9d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.236939 Aug 24 02:07:05.939998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2647/3639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:05 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:07:05.979653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:05.984259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:05.996597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.997377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.997597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:05.998323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:05.998783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:05.999212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.276277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:06.285080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2748a69e-8423-46a3-9a3f-d3911da7ed57 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1472 microversion: 2.1 time: 0.310424 Aug 24 02:07:06.285912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2648/3640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:05 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:06.304826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:06.308200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:06.325653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.326478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.326933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.327895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.328405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.328801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.382968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d385ff77-2228-4f90-8400-fc49e2b1eb8e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082421 Aug 24 02:07:06.383704 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2649/3641] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:06 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:06.392391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:06.393045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:06.410908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.412942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.414559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.417403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.417646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.418089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.672317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:06.681972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:06.684310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:06.685726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-817483a3-4848-4b0e-8f47-97a52dc4e90e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.301309 Aug 24 02:07:06.686505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2650/3642] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:06 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:06.691207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:06.691775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:06.697993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.698703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.699300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.700154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:06.700787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:06.701366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:06.994455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:07.007244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d695b1c-3b6d-4e5d-a952-430e0a709d86 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.319420 Aug 24 02:07:07.008766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2651/3643] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:06 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:07.014849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:07.015545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:07.021811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.022724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.023247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.024822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.026535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.027025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.273652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:07.283254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3451de5e-db52-462e-8820-80ea4e034780 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.272604 Aug 24 02:07:07.284524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2652/3644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:07 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:07.313051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:07.314208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:07.320306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.321078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.321713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.323234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.323982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.324416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.582182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:07.591467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df0aac36-c49c-402a-b1b8-288ba0432cbf tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1472 microversion: 2.1 time: 0.282152 Aug 24 02:07:07.606500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2653/3645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:07 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:07.612346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:07.614652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:07.637316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.637823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.638395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.639105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.640077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.640077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.672975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e76c182-399c-46df-94f3-c06ce4a105de tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065306 Aug 24 02:07:07.679755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2654/3646] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:07 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:07.685969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "143cc44b-46f2-443b-a1db-394f635ebbca"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:07.697384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.698367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.698964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.723071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] Creating event network-vif-plugged:143cc44b-46f2-443b-a1db-394f635ebbca for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:07.732161 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f6971407-3d53-49da-9681-3d1c1ffaa8da req-cbd1fb77-5332-45bf-afd3-981be1e196f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050318 Aug 24 02:07:07.733984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2655/3647] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:07.741640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:07.742381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:07.752592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.753122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.753558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.754305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:07.754761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:07.755216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:07.775408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:08.000790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.011584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.013800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.015224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2430a2dd-7440-46d3-84e9-165bf62ed863 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.279755 Aug 24 02:07:08.024792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2656/3648] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:07 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:08.024792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:08.024792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:08.033161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.033927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.034606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.035551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.036779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.037429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.066749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:08.159097 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4206f8a3-baea-435d-b61f-bdd4d99dc993 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 204 len: 0 microversion: 2.1 time: 0.141232 Aug 24 02:07:08.159679 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2657/3649] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:08 2022] DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:08.170563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:08.171199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:08.174328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:08.178970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.179721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.180163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.181115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.181779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.182373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.362466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.370644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ded5bfc-1bbf-4f70-bece-842b73f7c340 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.208819 Aug 24 02:07:08.371166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2658/3650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:08 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:08.376567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:08.377239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:08.383913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.384408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.385521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.386228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.386688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.387110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.536214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:08.569570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:08.622630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.635761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8113cf61-eb74-4e5a-9312-190f4e11d3e2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1681 microversion: 2.1 time: 0.262082 Aug 24 02:07:08.636649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2659/3651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:08 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:08.652618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:08.653340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:08.660359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.661057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.661506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.662461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.662657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.663087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.933497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:08.953942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98be18ab-c05c-44ac-a009-e263bc66b672 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.305793 Aug 24 02:07:08.955197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2660/3652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:08 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:08.962678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:08.963464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:08.971067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.971683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.972389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:08.973809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:08.974463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:08.976014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.193508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:09.204264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b00ad30f-51a8-4f38-bfbd-417026b0da9a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1472 microversion: 2.1 time: 0.245167 Aug 24 02:07:09.207491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2661/3653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:08 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:09.213491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:09.214884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:09.224763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.225369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.226032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.227272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.227806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.228866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.508634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:09.523896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:09.526575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:09.543260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-530f0402-5dab-4b64-be74-8af17753c901 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.334079 Aug 24 02:07:09.562212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2662/3654] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:09 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:09.568843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:09.569501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:09.576887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.577700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.578384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.579212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.579732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.580341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.846869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:09.855972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5464b6a2-4a06-4147-a85d-fcf025c29559 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1322 microversion: 2.1 time: 0.291887 Aug 24 02:07:09.857667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2663/3655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:09 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:09.862799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:09.863621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:09.882080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.893627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.893962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:09.894709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:09.895175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:09.895606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:10.107022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:10.118660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9de57c78-1b09-4f1f-a345-be73c243990d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1681 microversion: 2.1 time: 0.259375 Aug 24 02:07:10.120348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2664/3656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:09 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:10.161372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "cae35217-a025-43a3-80a2-d1bc17a9ad49"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "07470c0b-930b-4fc1-8448-66f023775793"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "2bf1c21f-a29e-41ab-a631-6dff684ae532"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:10.197989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:10.198638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:10.198915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:10.215426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Creating event network-vif-plugged:cae35217-a025-43a3-80a2-d1bc17a9ad49 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:10.216081 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Creating event network-vif-plugged:07470c0b-930b-4fc1-8448-66f023775793 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:10.216704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] Creating event network-vif-plugged:2bf1c21f-a29e-41ab-a631-6dff684ae532 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:10.223568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2158bce9-450f-4853-9164-17a1b19e6c24 req-ff2d1842-b302-4055-921b-e99a340d24aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.101742 Aug 24 02:07:10.224484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2665/3657] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:10.236027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:10.237250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:10.252103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:10.253023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:10.254366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:10.255983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:10.256621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:10.257240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:10.878791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:10.888526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29574a4c-1e1a-4335-abfd-fb21f5d856a6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.656740 Aug 24 02:07:10.889159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2666/3658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:10 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:10.903193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:10.912047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:10.927295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:10.927295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:10.932498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:10.933330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:10.933811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:10.934243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:11.054344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '289c59701d81423aa29b8f2120f2d95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3391637b8e414b895e9def0e60576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:11.074264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e211c2c8-befc-48e3-b37f-6661b106b11a tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 200 len: 1430 microversion: 2.1 time: 0.174944 Aug 24 02:07:11.088738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2667/3659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:10 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 1430 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:11.095944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:11.097101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:11.105424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:11.107052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:11.107848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:11.109698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:11.110425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:11.111101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:11.472206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:11.485914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:11.487440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:11.488639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5352ecfb-9198-43f2-a4bf-7b3baf1d1652 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.398316 Aug 24 02:07:11.508687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2668/3660] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:11 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:11.522746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:11.523770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:11.531634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:11.532336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:11.533115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:11.534074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:11.534712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:11.535931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:11.740707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:11.756157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf80cb4a-3d31-4e1d-9e5e-6c62aafdc65f tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1515 microversion: 2.1 time: 0.241499 Aug 24 02:07:11.757221 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2669/3661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:11 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:11.763055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5d3a85-8ff7-4bee-962d-a3bae922eca3", "name": "network-vif-deleted", "tag": "37caef68-c8a9-4a61-9be7-111aafeeeb4c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:11.774260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:11.775642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:11.776456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.120572 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] Creating event network-vif-deleted:37caef68-c8a9-4a61-9be7-111aafeeeb4c for instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 on n-h2-854121-3 Aug 24 02:07:12.126185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d3bfff82-c9de-4034-85fd-82dee70b2eb1 req-b1de0965-8dd9-4a28-9bc9-8d39d5dcb5a8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.366367 Aug 24 02:07:12.127114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2670/3662] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:12.132241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:12.133198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:12.143614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.144298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.144938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.145821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.146439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.147027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.237916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:12.256493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5cf83f7-fc49-4a7f-9e9b-0881082d3854 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 200 len: 1614 microversion: 2.1 time: 0.125635 Aug 24 02:07:12.258593 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2671/3663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:12 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 1614 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:12.277772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:12.278926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:12.309458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.309966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.310408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.315242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.315878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.318886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.567037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:12.572581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:12.583669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e4629c8-3e18-4e0d-a333-1daf61ffc0b3 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 200 len: 1516 microversion: 2.1 time: 0.322336 Aug 24 02:07:12.585377 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2672/3664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:12 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:12.618648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:12.620209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:12.627885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.629660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.630608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.631587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.632270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.632994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.940282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:12.951720 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0136fce1-2e74-4be5-a629-41e7b6f1b6e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.352435 Aug 24 02:07:12.953104 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2673/3665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:12 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:12.958530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:12.959459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] [instance: 5f5d3a85-8ff7-4bee-962d-a3bae922eca3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:12.971965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.973025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.973469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.974207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:12.974662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:12.975090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:12.990189 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] HTTP exception thrown: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Request method failure captured: Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 HTTP/1.1 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdrjDxaDUXyN5eDeYxk6Tc98DUcULxjDeMkcMeVEXJ7uezcRgYEHMi-R7uEx_PVQBMiN5Pr4Rbm3qkbagkrR0Q8Ojma6ov7ol88IYPGVI4kDYJyF_a1hdnpcijvvp8GALiVuunMYK8fsD5YXgSa3EYIaM-bPfqkWZjjcJLGZyQNiHo Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1c3391637b8e414b895e9def0e60576f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1c3391637b8e414b895e9def0e60576f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 1c3391637b8e414b895e9def0e60576f Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-711923526 Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 289c59701d81423aa29b8f2120f2d95f Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerTestJSON-711923526-project Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5f5d3a85-8ff7-4bee-962d-a3bae922eca3'} Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:12.992542 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. Aug 24 02:07:12.997804 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:12.999810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] Returning 404 to user: Instance 5f5d3a85-8ff7-4bee-962d-a3bae922eca3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:13.001142 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87d18a21-070b-49b0-86b7-ae8da72f5861 tempest-ImagesOneServerTestJSON-711923526 tempest-ImagesOneServerTestJSON-711923526-project] 10.222.0.49 "GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3" status: 404 len: 111 microversion: 2.1 time: 0.046433 Aug 24 02:07:13.004944 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2674/3666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:12 2022] GET /compute/v2.1/servers/5f5d3a85-8ff7-4bee-962d-a3bae922eca3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:13.010925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-plugged", "status": "completed", "tag": "992a88a2-6fc6-40a0-b337-eabd50ecd258"}, {"server_uuid": "33a0a35f-b094-48f2-83fe-1427ff9814de", "name": "network-vif-plugged", "status": "completed", "tag": "1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:13.030859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.031631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.032242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.050594 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Creating event network-vif-plugged:992a88a2-6fc6-40a0-b337-eabd50ecd258 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:13.051103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] Creating event network-vif-plugged:1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3 for instance 33a0a35f-b094-48f2-83fe-1427ff9814de on n-h2-854121-3 Aug 24 02:07:13.060991 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-58140db5-04d7-47ee-a4ec-14d84fb608a3 req-98580b18-5167-4eaf-904c-34e61b497413 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057840 Aug 24 02:07:13.062205 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2675/3667] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:13.069331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a92bf2-2056-40da-9531-f7c02a166c3b", "name": "network-vif-deleted", "tag": "414c45bb-85a6-4450-8e8d-6eb6eb8acddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:13.081535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.082348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.083171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.096441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] Creating event network-vif-deleted:414c45bb-85a6-4450-8e8d-6eb6eb8acddb for instance 13a92bf2-2056-40da-9531-f7c02a166c3b on n-h1-854121-3 Aug 24 02:07:13.103685 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c8983355-3c14-438e-b1ed-54b15ebd8ad2 req-f7a2b359-33c7-4c57-9cd0-90454af187f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039666 Aug 24 02:07:13.104530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2676/3668] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:13.111381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:13.112467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:13.123104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.124134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.124967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.126066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.126786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.127600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.700408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:13.715327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:13.716928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:13.718373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c7ef273-d295-4de3-8078-efc4bb226d93 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.612496 Aug 24 02:07:13.733261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2677/3669] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:13 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:13.746185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:13.746699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:13.761695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.763748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.764620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.765572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:13.766368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:13.766981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:13.805764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:14.002078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-313f2e81-99cd-4cb4-a2e3-162f4d225756 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 204 len: 0 microversion: 2.1 time: 0.267197 Aug 24 02:07:14.004020 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2678/3670] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:13 2022] DELETE /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:14.012217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:14.013342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:14.022079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.023055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.023896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.024964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.026220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.026898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.043743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b HTTP/1.1 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '13a92bf2-2056-40da-9531-f7c02a166c3b'} Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:14.045900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:07:14.050496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:14.053111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:14.054366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e1358d3-6e80-4d39-b954-a32f9925c28d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 404 len: 111 microversion: 2.1 time: 0.048983 Aug 24 02:07:14.055330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2679/3671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:14 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:14.063124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:14.063124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:14.075718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.076210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.076648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.077789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.078833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.079442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.339355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:14.348258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4083625-bc3a-4af4-b71b-2d34d078fcd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.291348 Aug 24 02:07:14.353808 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2680/3672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:14 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:14.366101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:14.366721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:14.375667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.376424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.383388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.385340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.385836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.387497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.627296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:14.638201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aac1e62f-1059-4f43-af2f-692747766bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 200 len: 1522 microversion: 2.1 time: 0.281903 Aug 24 02:07:14.639263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2681/3673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:14 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:14.658455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-720b3371-202e-4aa5-ae13-102a89012716 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '.version_select at 0x7f6b910b51f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:14.683553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-720b3371-202e-4aa5-ae13-102a89012716 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632130994" status: 202 len: 0 microversion: 2.1 time: 0.042581 Aug 24 02:07:14.684648 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2682/3674] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632130994 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:07:14.750311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:14.750924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:14.757975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.758467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.758905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:14.759636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:14.760103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:14.760531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:15.156664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:15.166536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:15.173691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:15.174901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fd690a3-7389-4ec5-91ea-b7976130af7f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1873 microversion: 2.42 time: 0.428533 Aug 24 02:07:15.175641 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2683/3675] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:14 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1873 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:07:15.377053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:15.378153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:15.385696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:15.386855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:15.387552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:15.388472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:15.389197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:15.389862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:15.551368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:15.567915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6687858f-f0bb-4b85-9ac6-492cc78cd395 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1308 microversion: 2.1 time: 0.196789 Aug 24 02:07:15.581855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2684/3676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:15 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1308 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:15.663725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:15.664373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:15.676911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:15.677656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:15.678264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:15.679159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:15.679787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:15.681432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:15.900743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:15.911233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d49c1156-8522-452a-86a6-577ea1ca1002 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 200 len: 1522 microversion: 2.1 time: 0.254693 Aug 24 02:07:15.924793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2685/3677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:15 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:07:16.131559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03545c78-3d7c-46ea-94f7-7f9a284eb212 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: .version_select at 0x7f6b91020f70>, body: {"keypair": {"name": "tempest-keypair-267148490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5LgWeT15b6pZnnyW8hEzxPxvGFdw4JM7EOJA9jAHVFB5mw+Hx0CaRnMTUNXAPbTHf4tXXJlhgbsCvaUczEjRLQVrG/KL0TFZCH/thRVSG4J6S/voimReMWaq5bdWWfIg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:16.153492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-03545c78-3d7c-46ea-94f7-7f9a284eb212 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:16.160711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-03545c78-3d7c-46ea-94f7-7f9a284eb212 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:16.193713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03545c78-3d7c-46ea-94f7-7f9a284eb212 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067262 Aug 24 02:07:16.202375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2686/3678] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:07:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:16.209409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:16.210635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:16.218945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.219653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.245569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.246782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.247282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.247782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.573966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:16.586078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:16.587763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:16.589073 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee9b2a4d-3506-42ae-9171-45a3ab4c586d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2831 microversion: 2.42 time: 0.388459 Aug 24 02:07:16.590150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2687/3679] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:07:16 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2831 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:16.595451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:16.596361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:16.604382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.605329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.606010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.606938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.607610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.608391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.763544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:16.771519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf45dc12-94bc-45f1-b7e4-103575f29ae3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1489 microversion: 2.1 time: 0.180089 Aug 24 02:07:16.772852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2688/3680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:16 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1489 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:16.779054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:16.780251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:16.787404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.788393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.789087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.791275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:16.792760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:16.793439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:16.937487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f7f124e-db4f-457e-9a3a-a7dfd0fab299 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.162946 Aug 24 02:07:16.938191 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2689/3681] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 02:07:16 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6/os-interface => generated 1831 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:07:16.943387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-738753160", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:17.018082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:07:18.111045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:07:18.112108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:07:18.117483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:07:18.118150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:07:18.119320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:07:18.140465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.141048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.141048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.142536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.143465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.143904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.195028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:18.201188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:18.249697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:07:18.258392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:07:18.348075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb37ab4b-304d-4db4-a24f-402a9110251a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406334 Aug 24 02:07:18.349017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2690/3682] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:07:18.378336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:18.379231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:18.392681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.393479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.394153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.395189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.395869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.396462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.468002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:18.475716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.482968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.483706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.485382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lazy-loading 'fault' on Instance uuid b956c91f-aa1c-421d-b304-a7ac8c7c9eea {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:07:18.745643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:18.758929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5beab16b-f83a-4600-8576-d518d03f355c tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 200 len: 1312 microversion: 2.1 time: 0.405387 Aug 24 02:07:18.760302 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2691/3683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:18 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 1312 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:18.774197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b956c91f-aa1c-421d-b304-a7ac8c7c9eea", "name": "network-vif-deleted", "tag": "c82d0f97-cd7e-49b0-a905-e55cc7c156aa"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:18.815576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:18.816103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:18.820667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:18.841654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] Creating event network-vif-deleted:c82d0f97-cd7e-49b0-a905-e55cc7c156aa for instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea on n-h2-854121-3 Aug 24 02:07:18.847527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-836b538c-c448-42b9-a96a-16fd851b6ac9 req-8bf39bd1-68df-4b66-b2ec-0d382425344a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084611 Aug 24 02:07:18.848314 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2692/3684] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:18.855020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d179bb89-a7df-4947-9c21-b75b45cea747 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:18.855832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d179bb89-a7df-4947-9c21-b75b45cea747 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:19.029196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d179bb89-a7df-4947-9c21-b75b45cea747 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:19.039958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d179bb89-a7df-4947-9c21-b75b45cea747 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1208 microversion: 2.1 time: 0.188744 Aug 24 02:07:19.041651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2693/3685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:18 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1208 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:19.780043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:19.780853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:19.788852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:19.789628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:19.790071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:19.791145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:19.791608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:19.792041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:19.806110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] HTTP exception thrown: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea HTTP/1.1 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b956c91f-aa1c-421d-b304-a7ac8c7c9eea'} Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:19.808048 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:19.813201 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.814968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 404 to user: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:19.816010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0689e65-499c-4f53-a9de-35050b1b8be4 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 404 len: 111 microversion: 2.1 time: 0.039893 Aug 24 02:07:19.820849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2694/3686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:19 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:19.826563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:19.832907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:19.834042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:19.841772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:19.842536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:19.843226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:19.844229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:19.845057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:19.845662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:19.969785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d2d0ab3-d2a1-401e-a97b-948b87b1a26b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.147574 Aug 24 02:07:19.970375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2695/3687] 10.222.0.49 () {58 vars in 1230 bytes} [Wed Aug 24 02:07:19 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:19.983059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eef89c7e-332b-4a3c-99a9-659931f63222 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eef89c7e-332b-4a3c-99a9-659931f63222 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 02:07:19.987013 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eef89c7e-332b-4a3c-99a9-659931f63222 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:19.996271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eef89c7e-332b-4a3c-99a9-659931f63222 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009247 Aug 24 02:07:20.009157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2696/3688] 10.222.0.49 () {58 vars in 1182 bytes} [Wed Aug 24 02:07:19 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 02:07:20.018041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.023454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.024448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:20.033130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.034137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.036269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.037662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.038460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.039271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.057040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:20.079299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:20.123426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f418b95d-823e-4111-b010-03a9519047c6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.112137 Aug 24 02:07:20.132314 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2697/3689] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers => generated 681 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:20.154701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.155778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:20.170193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.173166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.174112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.175896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.176637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.177459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.300895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.328844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24cdb50c-8913-4ffe-9432-5e92a58b2cb8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1268 microversion: 2.1 time: 0.192176 Aug 24 02:07:20.333335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2698/3690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1268 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:20.350923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.365717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.367717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.servers [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Removing options 'limit' from query {{(pid=128567) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 24 02:07:20.370009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:20.389145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.391151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.391758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.392923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.396703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.398795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.478670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:20.515586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfb98993-37f9-418c-bc3b-82381cca8193 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.181073 Aug 24 02:07:20.521651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2699/3691] 10.222.0.49 () {58 vars in 1144 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:20.542041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "tag": "cae35217-a025-43a3-80a2-d1bc17a9ad49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:20.560355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.560985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.561539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.575397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] Creating event network-changed:cae35217-a025-43a3-80a2-d1bc17a9ad49 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:07:20.582270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5d423684-d158-4482-a09c-19709d8c037d req-12c12d58-5144-48b5-8996-8dcb55cdb8a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049560 Aug 24 02:07:20.583566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2700/3692] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:20.597670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb5d3d50-a390-42e8-874e-7180c90a76c8 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb5d3d50-a390-42e8-874e-7180c90a76c8 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '-1' Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 02:07:20.602528 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.608709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eb5d3d50-a390-42e8-874e-7180c90a76c8 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:20.611806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eb5d3d50-a390-42e8-874e-7180c90a76c8 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.026886 Aug 24 02:07:20.617566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2701/3693] 10.222.0.49 () {58 vars in 1142 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:20.623109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efc30469-3e15-4a35-a257-af108bd3e392 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efc30469-3e15-4a35-a257-af108bd3e392 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: action_args: {} Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'testing' Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 24 02:07:20.628638 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:20.634237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efc30469-3e15-4a35-a257-af108bd3e392 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:20.636394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efc30469-3e15-4a35-a257-af108bd3e392 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017442 Aug 24 02:07:20.642298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2702/3694] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:20.648316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-379dc160-e9d0-4ab0-9de0-c1b38cbd38f9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.654738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-379dc160-e9d0-4ab0-9de0-c1b38cbd38f9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.655692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-379dc160-e9d0-4ab0-9de0-c1b38cbd38f9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:20.664525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.servers [None req-379dc160-e9d0-4ab0-9de0-c1b38cbd38f9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Flavor 'non_existing_flavor' could not be found {{(pid=128567) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 24 02:07:20.666638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-379dc160-e9d0-4ab0-9de0-c1b38cbd38f9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023172 Aug 24 02:07:20.667454 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2703/3695] 10.222.0.49 () {58 vars in 1178 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:20.681246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.687477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.688574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:20.703334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.704092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.704503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.714211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.716155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.716699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.842880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-354eb042-6c01-47ea-b073-e19f4b288bab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.165593 Aug 24 02:07:20.843887 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2704/3696] 10.222.0.49 () {58 vars in 1174 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:20.857517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:20.866121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:20.867299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:20.876260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.877243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.877896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:20.879077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:20.879824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:20.880405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:21.002404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02721748-86e8-437c-8425-9612176a6822 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.150048 Aug 24 02:07:21.004599 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2705/3697] 10.222.0.49 () {58 vars in 1184 bytes} [Wed Aug 24 02:07:20 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:21.017337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1094181930", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "802f15e4-b690-4ef7-b7bc-f44a2f083514"}], "security_groups": [{"name": "tempest-securitygroup--1903639180"}], "key_name": "tempest-keypair-267148490", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:21.299288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] validate_networks() for [('802f15e4-b690-4ef7-b7bc-f44a2f083514', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:07:21.946849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:07:21.947437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:07:21.947733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:07:21.948148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:07:21.948546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:07:21.964367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:21.965913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:21.967124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:21.968002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:21.969574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:21.972575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:22.005901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:22.012429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:22.027587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:07:22.030453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:07:22.098898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2494b5f-750a-479f-a857-329c8f0fa499 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.092876 Aug 24 02:07:22.100343 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2706/3698] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:07:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:07:22.111978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:22.119764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:22.121086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:22.146765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:22.148358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:22.148980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:22.150576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:22.151026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:22.151553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:22.185414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:22.242176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:22.251106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:22.251594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:22.252041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:22.398067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57f0751d-d560-4261-be15-1c812f74b403 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.296279 Aug 24 02:07:22.398692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2707/3699] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:07:22 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:22.404586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:22.405237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:22.422180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:22.422459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:22.422901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:22.423704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:22.424084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:22.424519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.335137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:23.346727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fee92a1a-f922-44f4-91df-aa52616a7b78 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 0.946961 Aug 24 02:07:23.349311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2708/3700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:22 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:23.364693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.365630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:23.375712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.376435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.377069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.378066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.378679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.379262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.502867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:23.515780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1aa690d3-4018-4b70-9a78-334fe3cc190f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1293 microversion: 2.1 time: 0.164263 Aug 24 02:07:23.517136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2709/3701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:23 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1293 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:23.537855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9902e31-65ad-44a1-9a80-e96a80bc80e5 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.543859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9902e31-65ad-44a1-9a80-e96a80bc80e5 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:23.545844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9902e31-65ad-44a1-9a80-e96a80bc80e5 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.027439 Aug 24 02:07:23.553156 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2710/3702] 10.222.0.49 () {58 vars in 1178 bytes} [Wed Aug 24 02:07:23 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:07:23.560218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.565583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:23.566327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Searching by: {'deleted': False, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:23.572270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.572848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.573350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.574199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.574782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.575268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.618555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:23.667474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b74ea8f-e6e6-4a53-9b16-d39ad57a55b6 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.111886 Aug 24 02:07:23.674592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2711/3703] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:07:23 2022] GET /compute/v2.1/servers => generated 681 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:23.680747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.681312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:23.688399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.689000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.689456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.690787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.691306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.691738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.709178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] HTTP exception thrown: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea HTTP/1.1 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b956c91f-aa1c-421d-b304-a7ac8c7c9eea'} Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:23.710747 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 404 to user: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5847f538-4dd9-494f-bfa5-03c105539c9e tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 404 len: 111 microversion: 2.1 time: 0.036352 Aug 24 02:07:23.715973 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2712/3704] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:23 2022] DELETE /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:23.722177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.722680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:23.729661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.730153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.730595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.731472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.731751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.732173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.769153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:23.921565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81f703c4-08fc-4b54-9d54-fc5bc9e1c1ab tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "DELETE /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 204 len: 0 microversion: 2.1 time: 0.202204 Aug 24 02:07:23.925697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2713/3705] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:23 2022] DELETE /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:23.932325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:23.932964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:23.939711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.940437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.941043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.941764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:23.942263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:23.942697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:23.981080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:24.183100 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40e693b2-8990-4f51-bbc0-68022cda331b tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "DELETE /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 204 len: 0 microversion: 2.1 time: 0.255850 Aug 24 02:07:24.183706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2714/3706] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:23 2022] DELETE /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:24.196145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:24.197417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: b956c91f-aa1c-421d-b304-a7ac8c7c9eea] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:24.217717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.218224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.218664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:24.223502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.224013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.224462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:24.277745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] HTTP exception thrown: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea HTTP/1.1 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b956c91f-aa1c-421d-b304-a7ac8c7c9eea'} Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:24.279727 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:24.284880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 404 to user: Instance b956c91f-aa1c-421d-b304-a7ac8c7c9eea could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:24.292391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43716753-3b5c-4173-a6be-a0800017a387 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea" status: 404 len: 111 microversion: 2.1 time: 0.092137 Aug 24 02:07:24.292391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2715/3707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:24 2022] GET /compute/v2.1/servers/b956c91f-aa1c-421d-b304-a7ac8c7c9eea => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:24.300453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:24.301097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:24.311487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.311988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.312453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:24.313163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.313623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.314053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:24.658729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:24.666224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:24.679979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49a32eb4-28d8-487d-9a24-83587ed32329 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1521 microversion: 2.1 time: 0.381175 Aug 24 02:07:24.680592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2716/3708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:24 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:24.698349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:24.702580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:24.716006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.716635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.717029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:24.717735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:24.718321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:24.718768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:25.061573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:25.076358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7155a5de-b24e-4bb7-9860-ab03208ea558 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 0.390589 Aug 24 02:07:25.089112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2717/3709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:24 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:25.092522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946b0fc3-d438-495e-9557-52af7a5cfd7e", "tag": "386adbda-f6c7-433c-beef-ff52556298d9"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:25.116949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:25.136678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:25.137424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:25.168226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] Creating event network-changed:386adbda-f6c7-433c-beef-ff52556298d9 for instance 946b0fc3-d438-495e-9557-52af7a5cfd7e on n-h2-854121-3 Aug 24 02:07:25.174905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-170cfad0-6187-40e4-873d-ec87f06b0eb8 req-35bcaaf1-ae7c-441c-9060-0d7387e3d34c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095373 Aug 24 02:07:25.183247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2718/3710] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:25.189865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:25.193642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:25.206938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:25.210506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:25.211122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:25.214245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:25.215640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:25.218019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:25.392636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:25.415056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d62602b-9d6b-4a72-a4ab-9d834edb9ae2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1299 microversion: 2.1 time: 0.230279 Aug 24 02:07:25.416380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2719/3711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:25 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:25.703718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:25.705962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:25.713817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:25.717058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:25.727236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:25.728701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:25.729309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:25.729852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:26.709099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:26.719469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50cfe7f4-8b72-461c-ab14-173221d8fd87 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1521 microversion: 2.1 time: 1.019795 Aug 24 02:07:26.720057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2720/3712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:25 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1521 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:07:26.725650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:26.726522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:26.745457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:26.745961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:26.746653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:26.747500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:26.748169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:26.748910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:27.847286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:27.864057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4814092-ce00-476f-8923-97bf596bd84e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 1.142632 Aug 24 02:07:27.864700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2721/3713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:26 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:27.882654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:27.882654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:27.897940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:27.898716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:27.899341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:27.901254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:27.901867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:27.902434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:28.535262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:28.544468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f348bf11-6986-4005-a7fd-04136f94a8c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 0.678097 Aug 24 02:07:28.554918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2722/3714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:27 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:28.561684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "464cf49a-d8be-461e-a825-00e344187980"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:28.575656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:28.582840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:28.583565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:28.584171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:28.592432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:28.592957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:28.593408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:30.183749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac098015-68cc-404e-9ea6-fa21a28d0eb4 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "POST /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.627362 Aug 24 02:07:30.185473 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2723/3715] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:07:28 2022] POST /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 194 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:30.191857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:30.218628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:30.245204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:30.247679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:30.249652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:30.250591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:30.252208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:30.253847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:30.309811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:30.310312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:30.310757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:30.311213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lazy-loading 'fault' on Instance uuid 431458cb-650e-45b0-b196-cecf52fa03d1 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:07:30.378740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3013b4616ccf47b3b3edafd4f8c462cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a21329efc94d5d91b34d00fd5f2a9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:30.387916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a208312-669c-4434-9623-74e6ae410929 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 200 len: 1312 microversion: 2.1 time: 0.199428 Aug 24 02:07:30.387916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2724/3716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:30 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:30.393906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431458cb-650e-45b0-b196-cecf52fa03d1", "name": "network-vif-deleted", "tag": "afc2f79b-dc36-476b-8787-787cfea2e58b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:30.406584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:30.407071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:30.407513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:30.421074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] Creating event network-vif-deleted:afc2f79b-dc36-476b-8787-787cfea2e58b for instance 431458cb-650e-45b0-b196-cecf52fa03d1 on n-h2-854121-3 Aug 24 02:07:30.426185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4d4d1ff5-0d61-4d1d-bac0-688aea8b4cb0 req-05167368-460f-4ba1-a931-316f0bb976fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038282 Aug 24 02:07:30.426798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2725/3717] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:30.596569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-901659814", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "ed0db8ed-7f52-46ea-98ac-2c32d57a7bae"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:30.668519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] validate_networks() for [('ed0db8ed-7f52-46ea-98ac-2c32d57a7bae', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:07:31.436038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:07:31.436668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:07:31.437193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:07:31.437865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:07:31.438664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:07:31.466408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.467596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.468395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:31.470068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.470987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.471764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:31.497003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:31.504438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:31.522624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for user b36da10548a54bc984b0191739d85dfd and project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:31.549411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:07:31.552313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:07:31.614835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1235309d-887b-44c6-9684-26e6cb63a796 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.186449 Aug 24 02:07:31.615874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2726/3718] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:07:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:07:31.622439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:31.624669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:31.634789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.635505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.636136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:31.637263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.637894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.638490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:31.897084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:31.914000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef2ffa97-7bd8-446e-a49e-31bc2cbdd5b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 0.296812 Aug 24 02:07:31.914990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2727/3719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:31 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:31.927414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:31.928080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:31.934358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.934779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.935223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:31.936563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:31.937065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:31.937707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.262649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:32.272214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bec12d1-7281-41b5-9107-0f4782c2e488 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 0.354036 Aug 24 02:07:32.273528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2728/3720] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:31 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:32.283745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:32.284361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: 431458cb-650e-45b0-b196-cecf52fa03d1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:32.292524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.293263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.293884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.295713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.296343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.297089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.325375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] HTTP exception thrown: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 HTTP/1.1 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '431458cb-650e-45b0-b196-cecf52fa03d1'} Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:32.327573 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. Aug 24 02:07:32.332936 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.334598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 404 to user: Instance 431458cb-650e-45b0-b196-cecf52fa03d1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:32.336036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-795d2357-da02-4dc0-8319-755b474464cd tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1" status: 404 len: 111 microversion: 2.1 time: 0.061354 Aug 24 02:07:32.337865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2729/3721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:32 2022] GET /compute/v2.1/servers/431458cb-650e-45b0-b196-cecf52fa03d1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:32.347634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbef73f4-2ebd-49ca-9f39-e74387fe42cd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:32.348567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbef73f4-2ebd-49ca-9f39-e74387fe42cd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:32.443076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbef73f4-2ebd-49ca-9f39-e74387fe42cd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:32.458181 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbef73f4-2ebd-49ca-9f39-e74387fe42cd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1224 microversion: 2.1 time: 0.118245 Aug 24 02:07:32.458785 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2730/3722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:32 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:32.475694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:32.476284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] [instance: de891cd6-a82d-4ff6-9f02-f3716e18a831] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:32.507235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.509902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.510353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.511073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.511531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.514142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.541014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] HTTP exception thrown: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Request method failure captured: Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 HTTP/1.1 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYesOK6bFgui10PYfQFRqi1OTq6xPPGHB76AaGnaSs-8z6NJjWKP5JT1CsjeytAVrkatv6-PC3IQFjX6ufkheNXHKwrm9jeFmlzWWfzMKHl2b2dDtFrlGkRPEtwibg35NaOIiPf0uBnkkW0xH-GKzavP8b-tCPjvDF0l7lkXZu9B1ZU Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c0a21329efc94d5d91b34d00fd5f2a9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c0a21329efc94d5d91b34d00fd5f2a9e Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-17547418 Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3013b4616ccf47b3b3edafd4f8c462cb Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ListServersNegativeTestJSON-17547418-project Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'de891cd6-a82d-4ff6-9f02-f3716e18a831'} Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:32.542562 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] Returning 404 to user: Instance de891cd6-a82d-4ff6-9f02-f3716e18a831 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b14cc6dd-9657-4f43-8ab8-19c0ecbb5dd9 tempest-ListServersNegativeTestJSON-17547418 tempest-ListServersNegativeTestJSON-17547418-project] 10.222.0.49 "GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831" status: 404 len: 111 microversion: 2.1 time: 0.080781 Aug 24 02:07:32.548441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2731/3723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:32 2022] GET /compute/v2.1/servers/de891cd6-a82d-4ff6-9f02-f3716e18a831 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:32.595205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de891cd6-a82d-4ff6-9f02-f3716e18a831", "name": "network-vif-deleted", "tag": "0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a"}, {"name": "network-changed", "server_uuid": "c8d8e63f-0e90-41a9-8afa-b4252cce8606", "tag": "5788815c-e49d-430c-800d-9a9bb2faf1e6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:32.629779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.636745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.637689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.664691 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Creating event network-vif-deleted:0f515d4b-a08a-4ca7-b9c0-aa9cf11f527a for instance de891cd6-a82d-4ff6-9f02-f3716e18a831 on n-h1-854121-3 Aug 24 02:07:32.665535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] Creating event network-changed:5788815c-e49d-430c-800d-9a9bb2faf1e6 for instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 on n-h1-854121-3 Aug 24 02:07:32.675462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-36a1b6e7-eb68-46be-86b3-54f2683f466a req-ddee545b-9886-4d48-85be-f13fd4a86b5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.097894 Aug 24 02:07:32.676926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2732/3724] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:32.937617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:32.938667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:32.953978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.954773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.955294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:32.956078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:32.957586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:32.959703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:33.451179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:33.466584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46c3d3e2-c522-47c7-b989-b4675cbc1d0e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 0.533422 Aug 24 02:07:33.480049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2733/3725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:32 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:33.480049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:33.480049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:33.499660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:33.500986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:33.503917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:33.505749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:33.506532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:33.510039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.730061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:34.739850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-813b8168-b003-4fb7-807b-7bc322889273 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 1.271035 Aug 24 02:07:34.754327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2734/3726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:33 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:34.757724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:34.758443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:34.766396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:34.766900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:34.767614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.769635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:34.770294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:34.770997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.902603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:34.910975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-527801ee-578d-46a8-8399-deb8bf50aa11 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1282 microversion: 2.1 time: 0.157136 Aug 24 02:07:34.911875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2735/3727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:34 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:34.917829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946b0fc3-d438-495e-9557-52af7a5cfd7e", "name": "network-vif-plugged", "status": "completed", "tag": "386adbda-f6c7-433c-beef-ff52556298d9"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:34.928370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:34.929010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:34.929709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.942223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] Creating event network-vif-plugged:386adbda-f6c7-433c-beef-ff52556298d9 for instance 946b0fc3-d438-495e-9557-52af7a5cfd7e on n-h2-854121-3 Aug 24 02:07:34.950046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-81c822c1-ee1c-408b-8951-1ab9e1cbb8b8 req-b2313797-a25b-471f-9484-7df9e331a0d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034698 Aug 24 02:07:34.951103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2736/3728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:34.957761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:34.959250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:34.968416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:34.969301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:34.969929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.970954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:34.971615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:34.972044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:34.993226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:35.399258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:35.418733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77c32f11-c9b7-447c-87d3-a1f61dae2a94 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1308 microversion: 2.1 time: 0.464224 Aug 24 02:07:35.436927 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2737/3729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:34 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:35.762499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:35.763193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:35.775522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:35.776020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:35.776460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:35.777312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:35.778166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:35.778340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:36.176633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:36.195870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c25072a-6e76-46d3-8058-5fe06d8f4ef9 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 0.438505 Aug 24 02:07:36.207526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2738/3730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:35 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:07:36.217891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:36.269034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:36.271674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Searching by: {'deleted': False, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:36.293610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:36.294111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:36.294563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:36.298933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:36.300770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:36.301286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:36.379105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:36.455936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f873bb9f-3cd3-4e56-99a0-049ea0165e59 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.245142 Aug 24 02:07:36.456757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2739/3731] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:07:36 2022] GET /compute/v2.1/servers => generated 334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:36.482087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:36.484955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:36.505420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:36.509826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:36.510739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:36.514007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:36.514881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:36.533162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:37.078131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:37.086195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b02bdd80-19cb-4c25-9f18-d213dbd181e1 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.628039 Aug 24 02:07:37.098024 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2740/3732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:36 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:37.109006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:37.110424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:37.124361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:37.125235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:37.125851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:37.126794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:37.127422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:37.128020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.258400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:38.273554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-803f3462-9470-4da9-b877-b934ddac1931 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1488 microversion: 2.1 time: 1.173674 Aug 24 02:07:38.276814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2741/3733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:37 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1488 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:38.287720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:38.302720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:38.305909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Searching by: {'deleted': False, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:07:38.318980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.319811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.320629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.322472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.328504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.329380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.384238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:07:38.457158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:38.474675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.475280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.475765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.807256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88f1cbd5-ea24-463d-aec8-a40539d07621 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.529082 Aug 24 02:07:38.808436 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2742/3734] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:07:38 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:38.827935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d8e63f-0e90-41a9-8afa-b4252cce8606", "name": "network-vif-plugged", "status": "completed", "tag": "5788815c-e49d-430c-800d-9a9bb2faf1e6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:38.842138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.843385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.843830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.869983 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] Creating event network-vif-plugged:5788815c-e49d-430c-800d-9a9bb2faf1e6 for instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 on n-h1-854121-3 Aug 24 02:07:38.877294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5673f6cc-638f-4cc0-a64f-fd2e8bd91219 req-b9a7c2a3-33a8-4465-802d-ef987fd47a0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066972 Aug 24 02:07:38.880378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2743/3735] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:38.896313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:38.896313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:38.906430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.909435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.909898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:38.910787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:38.911385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:38.911984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:39.673718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:39.683765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7395a50-95c2-4b9a-9ff7-47a250ce425e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 0.801697 Aug 24 02:07:39.684562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2744/3736] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:38 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:39.689539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:39.696589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:39.709976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:39.710481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:39.710923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:39.711641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:39.712645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:39.726190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:40.376239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:40.387030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb84f6a5-2a4d-4939-b404-0b4ace2fe5c0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.701230 Aug 24 02:07:40.402499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2745/3737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:39 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:40.402499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:40.402499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:40.421677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:40.422394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:40.422835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:40.423710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:40.424014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:40.424445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:40.983335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:40.999295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc2b8060-f790-4413-a9b3-dadc2074c0ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1489 microversion: 2.1 time: 0.604094 Aug 24 02:07:41.002045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2746/3738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:40 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1489 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:41.007573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcc6e482-b3dd-44d8-b0af-bf98fb2d236b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:41.046784 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcc6e482-b3dd-44d8-b0af-bf98fb2d236b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043133 Aug 24 02:07:41.047399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2747/3739] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:07:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:41.059106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb113c2-ee3c-4bf5-9e11-11ec0074560c", "tag": "fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:41.084161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.084974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.085608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.115749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] Creating event network-changed:fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0 for instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c on n-h2-854121-3 Aug 24 02:07:41.121645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-950f8cab-4e4a-4073-a4f6-ac1540f62a94 req-c6c4ffa9-ce21-4e68-aea8-80af6a4f8287 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072923 Aug 24 02:07:41.122504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2748/3740] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:41.136038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:41.141751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:41.161941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.162942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.163633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.165850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.167042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.168182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.456737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:41.494788 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a1fb5be-83be-4be8-895e-b1dc02cd400a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1367 microversion: 2.1 time: 0.370827 Aug 24 02:07:41.506137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2749/3741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:41 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:41.520412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:41.521073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:41.529436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.529971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.530470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.531178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.531681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.532103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.828701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:41.844009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-196f8e01-6771-4a75-8fc1-eb092049f1e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1488 microversion: 2.1 time: 0.345509 Aug 24 02:07:41.857445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2750/3742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:41 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1488 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:41.857445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:41.857445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:41.893361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.894257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.895576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.896901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:41.897665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:41.898431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:41.947973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:42.092705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c48fccc-8377-4717-8b4f-c02f420f740b tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 204 len: 0 microversion: 2.1 time: 0.246004 Aug 24 02:07:42.096464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2751/3743] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:41 2022] DELETE /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:42.100420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:42.101368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:42.110566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.111290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.111728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:42.112445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.112962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.113430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:42.427481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:42.440836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4bc8908-6cb9-4750-887e-9de550a9ecc2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.345359 Aug 24 02:07:42.441448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2752/3744] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:42 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:42.448403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:42.449194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:42.460830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.462852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.463658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:42.464878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.465551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.466987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:42.516273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:42.521169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:42.668768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77f4b603-b5d9-480c-bd27-4db9c9025dfc tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 204 len: 0 microversion: 2.1 time: 0.225208 Aug 24 02:07:42.670154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2753/3745] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:42 2022] DELETE /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:42.678890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:42.680223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:42.687261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.687763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.688206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:42.688945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:42.689466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:42.689896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:43.035058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:43.044048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad068e7e-7815-4c71-9e04-bee4d89d7f4d tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1700 microversion: 2.1 time: 0.372367 Aug 24 02:07:43.045263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2754/3746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:42 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1700 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:43.050674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:43.051599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:43.058414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:43.059373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:43.060173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:43.061241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:43.062175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:43.063261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:43.636103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:43.645167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0676ce3e-3923-462a-b1c8-8bcb7cd54f8b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1557 microversion: 2.1 time: 0.598404 Aug 24 02:07:43.645809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2755/3747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:43 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1557 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:43.650739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:43.651555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:43.660279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:43.660861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:43.661482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:43.662452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:43.663094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:43.664053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.152434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:44.163079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e29df021-3ddc-4d17-8855-d77a1e416ec8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1494 microversion: 2.1 time: 0.516054 Aug 24 02:07:44.166429 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2756/3748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:43 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1494 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:44.173169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:44.174737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:44.184208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.184920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.185440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.186258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.187173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.187795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.625738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:44.639616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a21e5b6-f3d5-43c4-815f-c5f29578c12e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.471471 Aug 24 02:07:44.648947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2757/3749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:44 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:44.655570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:44.655898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:44.662267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.663029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.663779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.664392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.665633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.666275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.871564 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-267bee55-1b7b-4a25-a08d-92d9875f79be tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218556 Aug 24 02:07:44.873157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2758/3750] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:07:44 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:44.879548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:44.880821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:44.894100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.895119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.896052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:44.898728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:44.900072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:44.900941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:45.480271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:45.495633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-995e278a-25c0-49d4-8caf-fe91329dd7b2 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1700 microversion: 2.1 time: 0.620851 Aug 24 02:07:45.501354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2759/3751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:44 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1700 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:45.507577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:45.508489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:45.516011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:45.516822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:45.518298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:45.519748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:45.520944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:45.521631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:46.679169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:46.688535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8ffc25e-4daf-4427-98db-5bdcc8608949 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 200 len: 1494 microversion: 2.1 time: 1.185525 Aug 24 02:07:46.689567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2760/3752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:45 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 1494 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:46.694506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:46.695428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:46.713130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:46.716191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:46.717391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:46.718410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:46.719099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:46.719760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:47.776956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:47.791702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa8647a5-c68c-4b08-bd55-86528bc6b20f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 1.100828 Aug 24 02:07:47.795791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2761/3753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:46 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:48.115192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "da9514dd-9ae3-4dd7-b7d4-125ad748cacc"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:48.123887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:48.142808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.149153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.151405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.160642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.162401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.162930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.340816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:48.347135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] HTTP exception thrown: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Request method failure captured: Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments/464cf49a-d8be-461e-a825-00e344187980 HTTP/1.1 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 74 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdoxOk4IH_DPYmLoqaBmzDtqHLk5-bXWk1oYWr5Zqc_1lLr-3FWN9rK_7afrc0rNjqvk-zP1JQzkEaYFXSQU_IkRffRipEP-3tUOxe75ywsDw3ECJdevBKwUmTUNZ50k2Cz_lc_R42Ns9AtgX9ZLYoIhB5A9DLjdBy_XvyybuHcg_g Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 2526d9ab3134450bac8df86a261409d7 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2526d9ab3134450bac8df86a261409d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 2526d9ab3134450bac8df86a261409d7 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesAdminNegativeTest-1395868174-project-admin Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d1f93c4b05944918216c2dcd5d4deb8 Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesAdminNegativeTest-1395868174-project-admin Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: {"volumeAttachment": {"volumeId": "da9514dd-9ae3-4dd7-b7d4-125ad748cacc"}} Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '26d3e7e0-0dee-447c-8509-afe124ceb3b1', 'id': '464cf49a-d8be-461e-a825-00e344187980', 'body': {'volumeAttachment': {'volumeId': 'da9514dd-9ae3-4dd7-b7d4-125ad748cacc'}}} Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. (HTTP 404) (Request-ID: req-e587b637-80b2-4b57-b908-ba058cb740a0) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:07:48.374375 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Returning 400 to user: Volume da9514dd-9ae3-4dd7-b7d4-125ad748cacc could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:48.378984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0baceed7-6ded-43d1-b0f4-d449d67fa4c0 tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments/464cf49a-d8be-461e-a825-00e344187980" status: 400 len: 107 microversion: 2.1 time: 0.579157 Aug 24 02:07:48.391460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2762/3754] 10.222.0.49 () {60 vars in 1433 bytes} [Wed Aug 24 02:07:47 2022] PUT /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments/464cf49a-d8be-461e-a825-00e344187980 => generated 107 bytes in 583 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:48.391460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:48.391460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:48.402101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:48.407356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.407865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.408338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.409206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.409664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.410090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.457779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=30 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:48.676732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fe513e27f44c3eb907d3d8890f4cdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51e4b940d5d4759b4cda90d112baa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:48.695456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3ad059a-45a9-4851-a766-48bdf4243831 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 200 len: 1633 microversion: 2.1 time: 0.314361 Aug 24 02:07:48.709296 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2763/3755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:48 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 1633 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:48.715509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946b0fc3-d438-495e-9557-52af7a5cfd7e", "name": "network-vif-deleted", "tag": "386adbda-f6c7-433c-beef-ff52556298d9"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:48.725319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.726067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.726663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.740710 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] Creating event network-vif-deleted:386adbda-f6c7-433c-beef-ff52556298d9 for instance 946b0fc3-d438-495e-9557-52af7a5cfd7e on n-h2-854121-3 Aug 24 02:07:48.747533 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2bd6201c-c68a-4a2e-ab22-11d123b0a227 req-583cab05-9701-4165-abfa-abd0e8cc3ca4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035598 Aug 24 02:07:48.748772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2764/3756] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:48.757732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb113c2-ee3c-4bf5-9e11-11ec0074560c", "name": "network-vif-plugged", "status": "completed", "tag": "fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:48.770264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.771041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.771642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.787922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] Creating event network-vif-plugged:fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0 for instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c on n-h2-854121-3 Aug 24 02:07:48.795219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5e867e23-70fe-4fe0-b52e-5b9c11e231da req-abaa25f1-2fe9-4963-ab50-3bb0c7f99d4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045084 Aug 24 02:07:48.796644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2765/3757] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:48.808337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:48.809698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:48.819117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.819784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.820395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.821373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.822332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.823100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.842202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e HTTP/1.1 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '946b0fc3-d438-495e-9557-52af7a5cfd7e'} Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.844188 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:07:48.850127 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:48.851563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:48.853294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4055de36-a5ad-4046-a6c0-7e9437809242 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 404 len: 111 microversion: 2.1 time: 0.053378 Aug 24 02:07:48.857536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2766/3758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:48 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:48.860460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f3eb55-e9b4-4331-9a51-f9a2c23d759c", "name": "network-vif-deleted", "tag": "12f2a002-0b08-4591-a977-8c555e3c6843"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:48.873225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.873973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.874674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.891974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] Creating event network-vif-deleted:12f2a002-0b08-4591-a977-8c555e3c6843 for instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c on n-h1-854121-3 Aug 24 02:07:48.899105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-317e7b89-9ec4-499a-9070-54e78ca75470 req-24be339b-c951-4f83-9b72-f54e4e66fed4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043025 Aug 24 02:07:48.905323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2767/3759] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:48.921852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:48.922668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:48.937515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.940165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.942332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:48.943277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:48.944056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:48.946978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:49.128069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lazy-loading 'services' on Instance uuid 26d3e7e0-0dee-447c-8509-afe124ceb3b1 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:07:49.327156 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd83aa6a-bf11-46d0-9998-3ef26225219c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments/464cf49a-d8be-461e-a825-00e344187980" status: 202 len: 0 microversion: 2.1 time: 0.419870 Aug 24 02:07:49.328042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2768/3760] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:07:48 2022] DELETE /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments/464cf49a-d8be-461e-a825-00e344187980 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:07:49.339251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:49.340468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:49.355695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:49.356650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:49.357413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:49.358600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:49.359389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:49.360122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:49.735392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:49.747722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d41bdf86-1fee-4897-a519-3b33d553bac7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.417801 Aug 24 02:07:49.748246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2769/3761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:49 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:49.756790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:49.757815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:49.764281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:49.765093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:49.765543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:49.766256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:49.766712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:49.767650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:49.832540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:07:49.894391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:49.993467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3436fd8a-f023-4556-8316-9f5816b91ba9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 204 len: 0 microversion: 2.1 time: 0.240427 Aug 24 02:07:49.999392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2770/3762] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:07:49 2022] DELETE /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:07:50.006851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:50.010428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:50.018263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.018849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.019342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.020122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.020588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.021066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.058593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1f490a5-6897-43cc-81ee-c2568e461daf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057523 Aug 24 02:07:50.064106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2771/3763] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:49 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:50.070229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:50.071005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] [instance: d9f3eb55-e9b4-4331-9a51-f9a2c23d759c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:50.078400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.079363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.079825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.080661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.081160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.081596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.100695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] HTTP exception thrown: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Request method failure captured: Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c HTTP/1.1 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdzxQGFfpMYHK7DuBEYwq5_kzs4Dkj9NdA2C20tZQYshBih2w6QssSO6cJrPoGyF7ANv_MaHc3OQWXIGPqvfCgF0mk13kUWqhs8gsg_RzRhQkw-EExjr_4fSOD_n8FfUrPJo2Tgsp8ZfvZMjBjpphAl64qWp81Yq0Zn539JaDmhf9s Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e51e4b940d5d4759b4cda90d112baa02 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-1982721469 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e51e4b940d5d4759b4cda90d112baa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e51e4b940d5d4759b4cda90d112baa02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e51e4b940d5d4759b4cda90d112baa02"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e51e4b940d5d4759b4cda90d112baa02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-1982721469 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e51e4b940d5d4759b4cda90d112baa02 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-1982721469 Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-1982721469-project Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 26fe513e27f44c3eb907d3d8890f4cdd Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-1982721469-project Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd9f3eb55-e9b4-4331-9a51-f9a2c23d759c'} Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:50.103181 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Returning 404 to user: Instance d9f3eb55-e9b4-4331-9a51-f9a2c23d759c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b611a77-4245-4752-b3b1-3f0e69bd9cfa tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c" status: 404 len: 111 microversion: 2.1 time: 0.039095 Aug 24 02:07:50.107795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2772/3764] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:50 2022] GET /compute/v2.1/servers/d9f3eb55-e9b4-4331-9a51-f9a2c23d759c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:50.112995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:50.113623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:50.121941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.122612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.123065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.123841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:50.124304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:50.124959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:50.451016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:50.483084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07053a32-f652-4f27-8270-106c9f4113e1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1495 microversion: 2.1 time: 0.376279 Aug 24 02:07:50.483688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2773/3765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:50 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1495 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:50.501646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1536ddf6-0418-4735-a5ad-1a5fa097e0d5 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] Calling method '.version_select at 0x7f6b91257790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:50.560837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1536ddf6-0418-4735-a5ad-1a5fa097e0d5 tempest-ServersTestJSON-1982721469 tempest-ServersTestJSON-1982721469-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952247024" status: 202 len: 0 microversion: 2.1 time: 0.075418 Aug 24 02:07:50.561770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2774/3766] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:07:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1952247024 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:07:50.828080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Action: 'create', calling method: .version_select at 0x7f6b913ee9d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:50.868993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Getting quotas for project 2baa785a211f4474918badf6a61c729d. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:50.887318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Getting quotas for user 5ead3ce2e8b542f9a77c4c498391f635 and project 2baa785a211f4474918badf6a61c729d. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:51.037316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Getting quotas for project 2baa785a211f4474918badf6a61c729d. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:51.049367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Getting quotas for user 5ead3ce2e8b542f9a77c4c498391f635 and project 2baa785a211f4474918badf6a61c729d. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:51.070129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07dfb547-004e-4133-8574-683dec114f11 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.366247 Aug 24 02:07:51.077048 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2775/3767] 10.222.0.49 () {62 vars in 1214 bytes} [Wed Aug 24 02:07:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:07:51.083653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:51.085272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:51.102882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:51.103716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:51.103856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:51.104524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:51.105015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:51.105451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:51.812488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:51.832041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25bd3145-91ac-42f3-a5bf-7927a946689c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1324 microversion: 2.1 time: 0.753529 Aug 24 02:07:51.836231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2776/3768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:51 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1324 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:51.842310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d8e63f-0e90-41a9-8afa-b4252cce8606", "tag": "5788815c-e49d-430c-800d-9a9bb2faf1e6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:51.880981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:51.889438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:51.893305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:51.926105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] Creating event network-changed:5788815c-e49d-430c-800d-9a9bb2faf1e6 for instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 on n-h1-854121-3 Aug 24 02:07:51.939027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3b99cb23-7bb5-4ea7-a132-da7b14cd3fda req-d106a1a6-2a82-42fd-b498-5d14ebc996b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100480 Aug 24 02:07:51.940576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2777/3769] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:51.951553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:51.954401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:51.962866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:51.963364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:51.965159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:51.965946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:51.966426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:51.966929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:52.012752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-300673fd-1931-4407-a778-4a2c78738e55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070036 Aug 24 02:07:52.017278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2778/3770] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:51 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:52.018658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dde78f52-0172-4e50-8772-38fb8a9965e1 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.042972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dde78f52-0172-4e50-8772-38fb8a9965e1 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.028191 Aug 24 02:07:52.043855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2779/3771] 10.222.0.49 () {60 vars in 1193 bytes} [Wed Aug 24 02:07:52 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:07:52.052966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.053601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:52.060411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:52.060918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:52.061357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:52.062122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:52.062583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:52.063063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:52.561622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:52.580040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-684f803b-4933-4076-8178-2ae03c2ad841 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1495 microversion: 2.1 time: 0.530802 Aug 24 02:07:52.581480 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2780/3772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:52 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1495 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:52.590918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5e0086b-7413-434b-a1cf-ea07b76376e5 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.630599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5e0086b-7413-434b-a1cf-ea07b76376e5 tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938" status: 200 len: 235 microversion: 2.64 time: 0.047802 Aug 24 02:07:52.642688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2781/3773] 10.222.0.49 () {60 vars in 1304 bytes} [Wed Aug 24 02:07:52 2022] GET /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938 => generated 235 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:07:52.657645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-38ac5659-0db0-4770-a093-34074a18c50c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.717499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-38ac5659-0db0-4770-a093-34074a18c50c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938" status: 204 len: 0 microversion: 2.64 time: 0.073276 Aug 24 02:07:52.719503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2782/3774] 10.222.0.49 () {60 vars in 1307 bytes} [Wed Aug 24 02:07:52 2022] DELETE /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:07:52.732952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c42c126b-628e-48ee-8540-dac57741869c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.747493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c42c126b-628e-48ee-8540-dac57741869c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] HTTP exception thrown: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c42c126b-628e-48ee-8540-dac57741869c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Request method failure captured: Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938 HTTP/1.1 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYf2-72yWQC_6G_ZgxamfmQqFVes8iwlMZZ9SiVt1uqolDOfLSqqLml1I3XVI6VNUHEWq5gKsfqb81lgZVuBAjLtXGsRKaWwy_2R2V3kx5D45fxNwHTsqAyQ4r3cFmuMPWhMtpt4nZCOEWq-YUPvQ1LYVpCGskCVNzU8sD8ROPd2A_E Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.64 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 2baa785a211f4474918badf6a61c729d Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroup264TestJSON-1598347008 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2baa785a211f4474918badf6a61c729d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2baa785a211f4474918badf6a61c729d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2baa785a211f4474918badf6a61c729d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2baa785a211f4474918badf6a61c729d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroup264TestJSON-1598347008 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 2baa785a211f4474918badf6a61c729d Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1598347008 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroup264TestJSON-1598347008-project Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 5ead3ce2e8b542f9a77c4c498391f635 Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroup264TestJSON-1598347008-project Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '53590365-c7f9-4b95-b4fe-332c7f709938'} Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:52.765252 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. Aug 24 02:07:52.771448 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:52.773569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c42c126b-628e-48ee-8540-dac57741869c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] Returning 404 to user: Instance group 53590365-c7f9-4b95-b4fe-332c7f709938 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:52.774847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c42c126b-628e-48ee-8540-dac57741869c tempest-ServerGroup264TestJSON-1598347008 tempest-ServerGroup264TestJSON-1598347008-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938" status: 404 len: 117 microversion: 2.64 time: 0.050021 Aug 24 02:07:52.776345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2783/3775] 10.222.0.49 () {60 vars in 1307 bytes} [Wed Aug 24 02:07:52 2022] DELETE /compute/v2.1/os-server-groups/53590365-c7f9-4b95-b4fe-332c7f709938 => generated 117 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:52.860801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:52.861867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:52.875674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:52.878593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:52.879836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:52.882174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:52.884242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:52.886304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:53.447504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:53.461456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-312b6508-5cc5-4054-8c36-7fe5720e0780 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.603960 Aug 24 02:07:53.463465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2784/3776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:52 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:53.481222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:53.484389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:53.495883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:53.496565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:53.497577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:53.498734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:53.499460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:53.500213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:53.542558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db41b315-4518-4e16-b023-03f07019836c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077553 Aug 24 02:07:53.543833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2785/3777] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:53 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:53.549045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:53.554086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:53.577672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:53.578527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:53.580954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:53.581886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:53.585218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:53.585934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:54.108201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:54.117574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee553875-f9d2-423b-9afd-ce78aa484a53 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.572384 Aug 24 02:07:54.124834 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2786/3778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:53 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:54.129833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:54.130490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:54.158330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:54.158822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:54.159266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:54.159978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:54.160437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:54.160893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:55.837775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:55.854878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa6032e2-fa98-4005-9410-88b4ff603148 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 200 len: 1495 microversion: 2.1 time: 1.728799 Aug 24 02:07:55.874076 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2787/3779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:54 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 1495 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:55.883895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36e57b11-d0ce-4274-a6ad-41489892f3c9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792264362", "metadata": {"": ""}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36e57b11-d0ce-4274-a6ad-41489892f3c9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action HTTP/1.1 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 106 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792264362", "metadata": {"": ""}}} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-792264362', 'metadata': {'': ''}}}} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'': ''} Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:55.906039 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:55.911447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:55.913592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36e57b11-d0ce-4274-a6ad-41489892f3c9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:55.914965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36e57b11-d0ce-4274-a6ad-41489892f3c9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action" status: 400 len: 170 microversion: 2.1 time: 0.039463 Aug 24 02:07:55.919252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2788/3780] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Aug 24 02:07:55 2022] POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action => generated 170 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:55.924994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:55.936323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:55.944559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:55.945131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:55.946286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:55.947233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:55.948428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:55.950491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:55.993948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-198aec97-5391-4f44-98e7-f41761d2a49e tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073045 Aug 24 02:07:55.995513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2789/3781] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:55 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:56.001452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a0a35f-b094-48f2-83fe-1427ff9814de", "name": "network-vif-deleted", "tag": "1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:56.027565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:56.028498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:56.029804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:56.046677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] Creating event network-vif-deleted:1f2275e9-eca6-4873-8ef0-ddfe26e1b3b3 for instance 33a0a35f-b094-48f2-83fe-1427ff9814de on n-h2-854121-3 Aug 24 02:07:56.052556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4357ca96-624b-4065-86c8-0ac421f1f067 req-6555191a-40a6-460b-aa0d-26aa6b2e8225 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055095 Aug 24 02:07:56.054055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2790/3782] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:56.083177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:56.084729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:56.093071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:56.093725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:56.094272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:56.095848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:56.097313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:56.097879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:56.427284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:56.439779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-877a1238-5544-4634-ab10-a4b0d13359e5 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.384218 Aug 24 02:07:56.440578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2791/3783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:56 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:56.470542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:56.471284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:56.485123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:56.485874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:56.486552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:56.487478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:56.488742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:56.489391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.068389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:57.079364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8836f6f-8c60-42f2-95d9-684ecfd62d5f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.613548 Aug 24 02:07:57.080255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2792/3784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:56 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:07:57.085916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:57.087718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:57.102887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.103477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.104179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.105164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.105891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.106539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.129431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de HTTP/1.1 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '33a0a35f-b094-48f2-83fe-1427ff9814de'} Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.132518 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:07:57.140299 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.145088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:57.147234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0cdbdc5-4f5d-4ab5-bea7-524f2b93e304 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 404 len: 111 microversion: 2.1 time: 0.064599 Aug 24 02:07:57.152116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2793/3785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:57 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:07:57.157244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:57.159495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:57.168444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.169271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.169664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.170350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.170657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.171094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.238399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f55e04b-cdda-431b-9e2e-4a15718e46e8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085113 Aug 24 02:07:57.241356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2794/3786] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:57 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:07:57.250490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9972bd7f-1bdd-473e-9f63-cd3a51b59f61 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1314598577", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9972bd7f-1bdd-473e-9f63-cd3a51b59f61 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action HTTP/1.1 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 619 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1314598577", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1314598577', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:07:57.260583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 24 02:07:57.264213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:07:57.270726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9972bd7f-1bdd-473e-9f63-cd3a51b59f61 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:07:57.271853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9972bd7f-1bdd-473e-9f63-cd3a51b59f61 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action" status: 400 len: 938 microversion: 2.1 time: 0.029312 Aug 24 02:07:57.272618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2795/3787] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Aug 24 02:07:57 2022] POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action => generated 938 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:07:57.283830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:57.284772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:57.288977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:57.311472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.312428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.313720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.316508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:57.317019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:57.317448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:57.615934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:57.631214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2fd9f5d-e05f-450d-8da1-b486b64f127b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.351508 Aug 24 02:07:57.633989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2796/3788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:57 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:57.640952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-242848944", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:07:57.748240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:07:58.933835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:07:58.934595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:07:58.934715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:07:58.935021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:07:58.935432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:07:58.950401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:58.952030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:58.960436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:58.961513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:58.962194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:58.962784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:58.979834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:07:59.012994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:07:59.022110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:07:59.080640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:07:59.086025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:07:59.236077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17cd0f58-09d6-4eff-95d1-3f699567cabd tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.600028 Aug 24 02:07:59.237159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2797/3789] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:07:59.256577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:59.257283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:59.285069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:59.285580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:59.286374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:59.286718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:59.287159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:59.287616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:59.883339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:07:59.902490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6704f46-76b9-4eef-9dca-76557f1970e8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.663061 Aug 24 02:07:59.903993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2798/3790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:07:59 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:07:59.913609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:07:59.919735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:07:59.955796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:59.957703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:59.959569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:07:59.960689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:07:59.961973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:07:59.963829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:00.036291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8a3a2a4-4125-4381-bff8-aa53246c8140 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.124809 Aug 24 02:08:00.036971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2799/3791] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:07:59 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:08:00.046366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63213050-626e-48b3-8e2d-0b0984c71c16 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:00.047051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63213050-626e-48b3-8e2d-0b0984c71c16 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:00.171006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63213050-626e-48b3-8e2d-0b0984c71c16 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:00.179082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63213050-626e-48b3-8e2d-0b0984c71c16 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1208 microversion: 2.1 time: 0.140625 Aug 24 02:08:00.187196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2800/3792] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:00 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1208 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:00.199714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bd83f09-5bb2-4262-8c49-82540ec94d0f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bd83f09-5bb2-4262-8c49-82540ec94d0f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action HTTP/1.1 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 285 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.206095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:00.210722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bd83f09-5bb2-4262-8c49-82540ec94d0f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:00.213392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bd83f09-5bb2-4262-8c49-82540ec94d0f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action" status: 400 len: 619 microversion: 2.1 time: 0.024138 Aug 24 02:08:00.220147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2801/3793] 10.222.0.49 () {60 vars in 1279 bytes} [Wed Aug 24 02:08:00 2022] POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action => generated 619 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:08:00.238478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:00.239462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:00.249885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:00.250702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:00.251347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:00.252247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:00.252951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:00.253747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:00.704518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:00.714501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5dc79ec-908c-4c6f-9fbb-83e28ed8232d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.492513 Aug 24 02:08:00.717553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2802/3794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:00 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:00.723593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1884083986", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8f072b43-3f03-409f-bede-6c37d6d22e69"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:00.815038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] validate_networks() for [('8f072b43-3f03-409f-bede-6c37d6d22e69', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:08:01.685864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:01.688413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:01.689765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:01.690412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:01.691046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:01.710929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:01.713093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:01.713852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:01.715441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:01.716551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:01.717509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:01.745598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for project adccd0d3681b4e288623abbaebb5fc68. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:01.751927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Getting quotas for user 977f49b5afbb4b3b88afcef4a6e58ce4 and project adccd0d3681b4e288623abbaebb5fc68. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:01.773126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:01.777006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:01.844705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24c88502-4dc4-402e-bb9b-7d9484fb0c9d tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125189 Aug 24 02:08:01.846063 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2803/3795] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:08:01.862973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:01.865024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:01.875606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:01.876319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:01.876923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:01.877873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:01.878652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:01.879518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:02.325003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:02.335590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3d13e20-e593-4460-8d2b-8aa9b02dcbda tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.487143 Aug 24 02:08:02.336202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2804/3796] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:01 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:02.349552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:02.350375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:02.370412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:02.370924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:02.371380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:02.372087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:02.372548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:02.373207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:02.922604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:02.946547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3686f918-00a2-4097-b5b8-1660b8563aaa tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1266 microversion: 2.1 time: 0.606166 Aug 24 02:08:02.947288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2805/3797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:02 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1266 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:02.980960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:02.981938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:02.990490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:02.991265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:02.992015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:02.992929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:02.993543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:02.994415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.100353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:03.113091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b68b77b5-95d5-413d-854f-6fff278efa55 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1270 microversion: 2.1 time: 0.140879 Aug 24 02:08:03.114487 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2806/3798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:02 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:03.122589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1525363573"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:03.127049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:03.136705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.138048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.139244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.142473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.143694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.145481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.495021 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc8f722c-b3cf-419b-847b-5863a704700b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action" status: 202 len: 0 microversion: 2.1 time: 0.373547 Aug 24 02:08:03.497713 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2807/3799] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:08:03 2022] POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:08:03.514727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1194831352"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:03.526075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:03.545445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.548866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.550473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.554688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.555914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.558434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.646460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Cannot 'createImage' instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c while it is in task_state image_snapshot_pending Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action HTTP/1.1 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 85 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1194831352"}} Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'createImage' instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c while it is in task_state image_snapshot_pending Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1194831352'}}} Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:08:03.653383 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c while it is in task_state image_snapshot_pending Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c while it is in task_state image_snapshot_pending Aug 24 02:08:03.659708 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:03.665416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 409 to user: Cannot 'createImage' instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c while it is in task_state image_snapshot_pending {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:03.667414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dba379e5-bdf9-4700-985a-c7adc57fb248 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action" status: 409 len: 167 microversion: 2.1 time: 0.163029 Aug 24 02:08:03.670511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2808/3800] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:08:03 2022] POST /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c/action => generated 167 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:08:03.686445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a35e2d6b-72a3-4b4d-adb4-f8c196085dbb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b9146f310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:03.917077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a35e2d6b-72a3-4b4d-adb4-f8c196085dbb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/images/a08dee5f-f775-4ffc-9a69-bb9a1d94939b" status: 204 len: 0 microversion: 2.1 time: 0.238806 Aug 24 02:08:03.919294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2809/3801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:03 2022] DELETE /compute/v2.1/images/a08dee5f-f775-4ffc-9a69-bb9a1d94939b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:03.932129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:03.932129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:03.943966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.946298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.947448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:03.948835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:03.950194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:03.951599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:04.587138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:04.621160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca7e4bcc-c7cd-4626-aa79-e5ba42c996e7 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1534 microversion: 2.1 time: 0.694577 Aug 24 02:08:04.624425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2810/3802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:03 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1534 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:04.635372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:04.637734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:04.653791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:04.655246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:04.655885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:04.658506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:04.662149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:04.662785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:05.171120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:05.187773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-998c10b2-b628-4581-b2fa-e890fbbde396 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.561016 Aug 24 02:08:05.201731 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2811/3803] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:04 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:05.238822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:05.241664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:05.269330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:05.272066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:05.272938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:05.274703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:05.278395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:05.281213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:05.499342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:05.526009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec6b30a0-c393-420a-9f69-e2c3b11db63b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1276 microversion: 2.1 time: 0.319076 Aug 24 02:08:05.539611 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2812/3804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:05 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1276 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:05.539611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:05.539611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:05.543021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:05.543613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:05.544127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:05.544947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:05.545479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:05.545987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:06.132272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:06.156164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:06.157846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:06.159181 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a864693-53ff-4d67-81e1-b64940f1a597 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2949 microversion: 2.42 time: 0.631154 Aug 24 02:08:06.159753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2813/3805] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:05 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2949 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:06.168409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:06.173512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:06.186734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:06.187603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:06.190174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:06.191282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:06.191981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:06.193360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:06.587084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:06.616963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a500711c-177b-47ba-8047-8ed99e95304a tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1540 microversion: 2.1 time: 0.454221 Aug 24 02:08:06.617992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2814/3806] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:06 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1540 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:06.636445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa5bd45-358d-4bbb-9d2f-264686839ec4", "tag": "4ed24a43-7d5f-4135-913f-9c9d3c1e5798"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:06.678164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:06.695298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:06.698663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:06.750948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] Creating event network-changed:4ed24a43-7d5f-4135-913f-9c9d3c1e5798 for instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 on n-h2-854121-3 Aug 24 02:08:06.780479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-98cd1068-d96a-45bc-b236-6c766fd3b432 req-236a8122-cbc1-454e-bd4a-66821103ecbd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160564 Aug 24 02:08:06.782496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2815/3807] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:06.809265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:06.810007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:06.833415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:06.838207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:06.847325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:06.873399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:06.874502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:06.875332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:07.139892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed1d9bbd-766b-4cc0-89d8-4fdd56b77273 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.349615 Aug 24 02:08:07.140906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2816/3808] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 02:08:06 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6/os-interface => generated 1831 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:07.145773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:07.146626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:07.172364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:07.173319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:07.173961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:07.175355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:07.175997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:07.176622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:07.559913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:07.564610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:07.574299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2fcc53d-dd9b-4da2-a8e3-ffa18af11b57 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.432040 Aug 24 02:08:07.586946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2817/3809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:07 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:07.597265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:07.598712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:07.609199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:07.610702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:07.611666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:07.612942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:07.613856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:07.614637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:07.928548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:07.957505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db8adcab-4621-4983-951b-bc9d05668ce6 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.364083 Aug 24 02:08:07.982918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2818/3810] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:07 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:07.991732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:07.996032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:08.016884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:08.020695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:08.021238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:08.021989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:08.022454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:08.022935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:08.338111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:08.347358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b72a2e48-e171-4733-bae2-5474b268e841 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1540 microversion: 2.1 time: 0.362622 Aug 24 02:08:08.349987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2819/3811] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:07 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1540 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:08.372593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8d4839-86ec-4c5c-b8a3-204b330d2719", "tag": "0698e43f-021e-4a68-9487-0a0fbe0f0c27"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:08.384232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:08.384795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:08.385185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:08.399342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] Creating event network-changed:0698e43f-021e-4a68-9487-0a0fbe0f0c27 for instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 on n-h2-854121-3 Aug 24 02:08:08.405849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a2968336-0f14-4108-8a5c-017dce26860c req-5965f71e-538d-4d58-8fc2-f6b47cfbecc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037031 Aug 24 02:08:08.407148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2820/3812] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:08.601115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:08.603148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:08.615503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:08.616208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:08.616820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:08.620746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:08.621202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:08.621804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:09.315223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:09.323799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a12d95dd-5c13-40bd-8a86-7c141d1ba7f3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.727997 Aug 24 02:08:09.327152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2821/3813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:08 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:09.332537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:09.337144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:09.355517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:09.357294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:09.358248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:09.362289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:09.363873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:09.365116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:09.764477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:09.794697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61890dc7-f173-47a0-8367-6bb0f078075c tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.465305 Aug 24 02:08:09.796845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2822/3814] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:09 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:09.803001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:09.803983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:09.814509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:09.816089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:09.822369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:09.823470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:09.824753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:09.824890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:10.165846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:10.174459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f73557b3-8a6e-4350-8892-9ed39890d597 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1540 microversion: 2.1 time: 0.375849 Aug 24 02:08:10.180427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2823/3815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:09 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1540 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:10.349120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:10.349120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:10.358049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:10.358650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:10.378813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:10.381800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:10.393628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:10.396002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:10.894219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:10.919910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c2f4c11-ce66-4e32-846f-4f6185eef491 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.576194 Aug 24 02:08:10.929148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2824/3816] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:10 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:10.943649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:10.945525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:10.963694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:10.964191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:10.965423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:10.968338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:10.972229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:10.973131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:11.682095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:11.696528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1665cfd-2303-4919-9efa-3563aafb93b0 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.766032 Aug 24 02:08:11.708745 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2825/3817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:10 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:11.709681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:11.710309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:11.732308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:11.732859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:11.733303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:11.734016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:11.734471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:11.735240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:11.735815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:11.774237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=22 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:12.167889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:12.178473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3888a2f4-3a84-4df4-8b3b-19ee55df8314 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1540 microversion: 2.1 time: 0.473236 Aug 24 02:08:12.191945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2826/3818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:11 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1540 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:12.203521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:12.204073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:12.218063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:12.218564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:12.222035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:12.222800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:12.226172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:12.243258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:12.560790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:12.580234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0ca6b72-b9b6-4c29-991d-1d0385ca0b46 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.384181 Aug 24 02:08:12.597585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2827/3819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:12 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:12.723554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:12.724209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:12.739502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:12.740015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:12.740464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:12.741835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:12.742921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:12.743360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:13.201945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:13.215399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-108ae923-322a-4cb4-8d2d-f26785466fb8 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.497594 Aug 24 02:08:13.218236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2828/3820] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:12 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:13.262891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:13.264410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:13.278232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:13.278986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:13.279616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:13.281049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:13.281692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:13.282353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:13.737522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:13.752236 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f49c650a-9619-4bce-bb1e-392edacfee6c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1522 microversion: 2.1 time: 0.531522 Aug 24 02:08:13.770992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2829/3821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:13 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:13.777512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb113c2-ee3c-4bf5-9e11-11ec0074560c", "name": "network-vif-plugged", "status": "completed", "tag": "fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:13.791924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:13.792686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:13.793402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:13.814414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] Creating event network-vif-plugged:fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0 for instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c on n-h2-854121-3 Aug 24 02:08:13.821016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fc70eabf-5568-4bc4-8f86-efbf165e7ecb req-71477ab2-27da-4708-9b65-e16eee82b1bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048424 Aug 24 02:08:13.822545 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2830/3822] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:13.834591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:13.835593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:13.860689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:13.861259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:13.873364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:13.874185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:13.874670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:13.875110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:15.024569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:15.036697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c403ad9d-49a5-4401-aaf9-fbb881e99e45 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 1.212017 Aug 24 02:08:15.043498 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2831/3823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:13 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:15.049414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:15.049926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:15.061981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:15.062480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:15.062926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:15.063642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:15.064099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:15.064537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:15.129525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:15.267137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:15.308051 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79e83a33-7fff-484b-9a3d-348ba8e95574 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 204 len: 0 microversion: 2.1 time: 0.262677 Aug 24 02:08:15.309097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2832/3824] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:15 2022] DELETE /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:15.567494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-520173184", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "70912007-32cc-48b6-9f24-21d6db98ad9a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:15.681894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] validate_networks() for [('70912007-32cc-48b6-9f24-21d6db98ad9a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:08:16.549736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:16.551007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:16.551726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:16.552209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:16.552699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:16.566442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:16.567679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:16.568650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:16.569636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:16.570338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:16.570972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:16.595426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Getting quotas for project e4ce248132ec42a59d2f42ce0357c750. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:16.602771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Getting quotas for user 262af17a5ce84aa4acd229dfcdf50402 and project e4ce248132ec42a59d2f42ce0357c750. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:16.618444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:16.620947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:16.710042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a9ff6f8-65d7-43a5-b756-dd609a6bff00 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.399100 Aug 24 02:08:16.711425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2833/3825] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:08:16.717378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:16.718255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:16.724504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:16.725108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:16.725565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:16.727027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:16.727646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:16.728232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:16.967194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:16.970938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:16.980458 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86a90c50-5501-4dda-bbc2-1fd02c7096fe tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.267566 Aug 24 02:08:16.984790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2834/3826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:16 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:16.992380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:16.993321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:17.024037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:17.027262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:17.028916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:17.031902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:17.032434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:17.034472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:17.341762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:17.353934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a43e8a69-ec7f-4f52-8d84-8a239e2e9dae tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1528 microversion: 2.1 time: 0.365180 Aug 24 02:08:17.354579 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2835/3827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:16 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1528 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:17.368008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa5bd45-358d-4bbb-9d2f-264686839ec4", "name": "network-vif-plugged", "status": "completed", "tag": "4ed24a43-7d5f-4135-913f-9c9d3c1e5798"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:17.381461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:17.386923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:17.387754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:17.422106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] Creating event network-vif-plugged:4ed24a43-7d5f-4135-913f-9c9d3c1e5798 for instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 on n-h2-854121-3 Aug 24 02:08:17.427822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-084d17d6-cc0a-4734-b4bf-aef6d033626d req-6702dff6-552c-4d96-a1d1-f8ba1d64df9d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071603 Aug 24 02:08:17.429556 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2836/3828] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:17.453290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:17.454024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:17.468261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:17.489382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:17.489852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:17.490607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:17.491099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:17.494861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:17.821582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:17.851297 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eae93f26-f6fd-4ecc-9b62-c703cf36fa55 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.416791 Aug 24 02:08:17.853873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2837/3829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:17 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:17.931144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: .version_select at 0x7f6b914a6040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-77373199", "policies": ["affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:17.972758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:18.000673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:18.099048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:18.105388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:18.121140 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7de4f75-b265-499b-adda-00cd0a0d716c tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.265040 Aug 24 02:08:18.122188 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2838/3830] 10.222.0.49 () {60 vars in 1174 bytes} [Wed Aug 24 02:08:17 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:18.127370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:18.128476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:18.136314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:18.137386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:18.138049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:18.139192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:18.140029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:18.140791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:18.276095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:18.289040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-870fdcdf-672f-4d0b-81fe-7049981472a7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1276 microversion: 2.1 time: 0.165118 Aug 24 02:08:18.304793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2839/3831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:18 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:18.311373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:18.312680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:18.319810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:18.321281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:18.321950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:18.323444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:18.324586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:18.325633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:18.944140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:18.952329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b16edcd8-fe46-4355-b757-be2712083c30 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.645855 Aug 24 02:08:18.953362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2840/3832] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:18 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:18.973281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: .version_select at 0x7f6b914e8dc0>, body: {"server_group": {"name": "tempest-server-group-1811702901", "policies": ["affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:19.020813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:19.032338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:19.123771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:19.132369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:19.172190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0d2f590-e1d5-4308-9c02-e603ec08bfd3 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.217796 Aug 24 02:08:19.173510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2841/3833] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 02:08:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:19.179447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:19.180271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:19.187968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:19.188598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:19.189405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:19.190306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:19.190852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:19.191285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:19.242950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:19.243781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:19.244683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:19.245245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lazy-loading 'fault' on Instance uuid 5fb113c2-ee3c-4bf5-9e11-11ec0074560c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:08:19.334603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:19.349901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f89192d-060b-4d83-8bf0-e6a7bf24d660 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 200 len: 1314 microversion: 2.1 time: 0.173552 Aug 24 02:08:19.366594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2842/3834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:19 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:19.371669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:19.374541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:19.381762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:19.382569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:19.383189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:19.384064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:19.384683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:19.385356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.108008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:20.124665 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08ebc7e6-e617-43ad-b4a5-3c86882ee972 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1308 microversion: 2.1 time: 0.756677 Aug 24 02:08:20.126694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2843/3835] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:19 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1308 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:20.134243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb113c2-ee3c-4bf5-9e11-11ec0074560c", "name": "network-vif-deleted", "tag": "fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:20.160012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.161176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.161816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.179884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] Creating event network-vif-deleted:fe1c841d-34f4-4d0f-b5d9-779b7d83c0e0 for instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c on n-h2-854121-3 Aug 24 02:08:20.186506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-463a6364-31c5-4505-9b8f-67783024fa68 req-80602dd8-fb6f-4b7a-be86-6082b22a5deb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057910 Aug 24 02:08:20.187212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2844/3836] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:20.192623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: .version_select at 0x7f6b914bff70>, body: {"server_group": {"name": "tempest-server-group-1811702901", "policies": ["affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:20.205124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:20.214253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:20.221670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:20.293430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:20.300226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:20.317218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-011d5432-a04f-41c6-bac4-c67eadd6b02e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.128293 Aug 24 02:08:20.318432 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2845/3837] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 02:08:20 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:20.326661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:20.327458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:20.334943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.337129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.337992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.338941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.339673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.340593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.488416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:20.498158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb26f922-1270-4e32-aa34-be5b9ba7bad0 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1282 microversion: 2.1 time: 0.178344 Aug 24 02:08:20.499366 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2846/3838] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:20 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:20.521616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:20.522269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:20.529594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.530153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.530599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.531818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.532294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.532805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.844827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:20.862688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca343960-9522-475e-8c04-5e4fc31068ad tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.361801 Aug 24 02:08:20.868338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2847/3839] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:20 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:20.875976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfcb8014-d27f-4022-812e-02f0663ca143 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:20.933509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfcb8014-d27f-4022-812e-02f0663ca143 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/33a23ae8-a2c8-4967-8ed6-92307c2a4a25" status: 204 len: 0 microversion: 2.1 time: 0.063838 Aug 24 02:08:20.934457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2848/3840] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:20 2022] DELETE /compute/v2.1/os-server-groups/33a23ae8-a2c8-4967-8ed6-92307c2a4a25 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:20.941428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:20.942302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:20.966605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.967624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.968250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.969230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:20.969887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:20.970495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:20.988565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c HTTP/1.1 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c'} Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:20.990303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:08:20.996219 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:20.997947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:20.999516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc149ec7-1341-43e4-83e2-79ee978349a0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 404 len: 111 microversion: 2.1 time: 0.063010 Aug 24 02:08:21.007659 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2849/3841] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:20 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:21.013058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de0e9174-e11c-44e1-bed3-4505fbca338e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:21.027374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de0e9174-e11c-44e1-bed3-4505fbca338e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.018185 Aug 24 02:08:21.028742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2850/3842] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:08:21 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:21.041812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de0c192e-e92a-4a41-828d-c3d4083bbfeb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'create', calling method: .version_select at 0x7f6b9143b700>, body: {"keypair": {"name": "tempest-keypair-1716576232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/kk+aZclxmcuNvMV2pCk/mSqgqq0g/meVnnbI7NJlWay5C7jnJwpNrEeyXX6CoUTpel7mzwNGbtsPidXxILyc7oGjVa7J0NSuOKEY84PUf1uSjP2uCiKTYo998VuU7tQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:21.079236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-de0c192e-e92a-4a41-828d-c3d4083bbfeb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:21.086694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-de0c192e-e92a-4a41-828d-c3d4083bbfeb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for user b36da10548a54bc984b0191739d85dfd and project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:21.129146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de0c192e-e92a-4a41-828d-c3d4083bbfeb tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095609 Aug 24 02:08:21.132381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2851/3843] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:08:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:21.151387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3ac2361-ea4c-44a5-85c3-cc2387d5b8b1 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:21.217810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3ac2361-ea4c-44a5-85c3-cc2387d5b8b1 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae" status: 204 len: 0 microversion: 2.1 time: 0.083923 Aug 24 02:08:21.221505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2852/3844] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:21 2022] DELETE /compute/v2.1/os-server-groups/bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:21.229833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:21.232753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:21.254098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:21.257678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:21.258373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:21.259343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:21.262242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:21.264451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:21.616987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:21.629436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d26495e1-f2bc-40fd-ace0-48c319744517 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1488 microversion: 2.1 time: 0.408603 Aug 24 02:08:21.630040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2853/3845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:21 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1488 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:21.644611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1190f383-709c-4a5f-acaf-0ab9460aff15 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:21.665770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1190f383-709c-4a5f-acaf-0ab9460aff15 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.034645 Aug 24 02:08:21.667055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2854/3846] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:08:21 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:21.671900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:21.685492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:21.692296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:21.692980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:21.693695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:21.694494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:21.695209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:21.695858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:22.153254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:22.161274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c1d2a29-0b06-430c-89a5-498d6efae299 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.492905 Aug 24 02:08:22.168201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2855/3847] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:21 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:22.173290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:22.175853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:22.186684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:22.188916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:22.189947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:22.190990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:22.191753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:22.194531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:22.297743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef541e22-6674-4930-98ad-794bef2e0add tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "PUT /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1083 microversion: 2.1 time: 0.127985 Aug 24 02:08:22.299989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2856/3848] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:08:22 2022] PUT /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1083 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:22.322654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: .version_select at 0x7f6b9153c550>, body: {"server_group": {"name": "tempest-server-group-856099400", "policies": ["affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:22.352432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:22.360219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:22.428502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:22.435911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:22.457274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-335270a3-959d-4462-8034-75cd61cd2474 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.155155 Aug 24 02:08:22.464352 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2857/3849] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 02:08:22 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:22.465626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4839-86ec-4c5c-b8a3-204b330d2719", "name": "network-vif-plugged", "status": "completed", "tag": "0698e43f-021e-4a68-9487-0a0fbe0f0c27"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:22.483476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:22.483798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:22.484427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:22.510143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] Creating event network-vif-plugged:0698e43f-021e-4a68-9487-0a0fbe0f0c27 for instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 on n-h2-854121-3 Aug 24 02:08:22.519873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ae0166f8-027e-458d-9dc6-f0691117ffaf req-e74d1367-b592-4fa7-968c-27895a4c8cc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057743 Aug 24 02:08:22.520501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2858/3850] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:22.529703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:22.530470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:22.539317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:22.539965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:22.540408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:22.541502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:22.541963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:22.542447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.074883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:23.093476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e266ee08-1a66-48a5-a120-09cf7a47f04b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1318 microversion: 2.1 time: 0.571281 Aug 24 02:08:23.097440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2859/3851] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:22 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:23.111766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:23.112387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:23.141921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.142529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.143218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.144158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.144885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.145571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.527595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:23.535892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e75db689-83e1-4608-8aa1-cb680285d1a8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1509 microversion: 2.1 time: 0.437289 Aug 24 02:08:23.551186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2860/3852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:23 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:23.556969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29a65281-66c2-4be7-96a1-ee9edc1c1986 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:23.563769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:23.590192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29a65281-66c2-4be7-96a1-ee9edc1c1986 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/c72af81f-f95b-4886-84f8-7371d3f2e446" status: 204 len: 0 microversion: 2.1 time: 0.036336 Aug 24 02:08:23.603304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2861/3853] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:23 2022] DELETE /compute/v2.1/os-server-groups/c72af81f-f95b-4886-84f8-7371d3f2e446 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:23.612936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:23.613885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:23.622333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.623203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.624003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.624983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.625855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.626241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.871400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:23.881550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26b5b482-1d58-4c0d-af4c-5c7c2cb78aca tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.276695 Aug 24 02:08:23.883499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2862/3854] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:23 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:23.898597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30fe6a0-32b9-43cc-963b-2188841f5f8b", "tag": "75c4a844-8236-4219-bffd-8adf52615f8b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:23.909514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.910079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.910687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.914856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:23.927727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] Creating event network-changed:75c4a844-8236-4219-bffd-8adf52615f8b for instance c30fe6a0-32b9-43cc-963b-2188841f5f8b on n-h1-854121-3 Aug 24 02:08:23.934496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3ad14cd1-f024-4e2e-a89d-34db6d0f3e96 req-4b4e481f-29f9-400c-9f44-12c1b8479854 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048730 Aug 24 02:08:23.935111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2863/3855] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:23.940262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:23.940982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:23.949109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.950354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.950798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:23.951501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:23.952140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:23.953124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:24.157630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:24.168407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fed80a0-cf4d-45fc-ab81-ee4aff78e79a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1509 microversion: 2.1 time: 0.232026 Aug 24 02:08:24.169186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2864/3856] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:23 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:24.174464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86298421-455c-467b-aeb1-d07575544907 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:24.186845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86298421-455c-467b-aeb1-d07575544907 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.016286 Aug 24 02:08:24.188809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2865/3857] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:08:24 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:24.195618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-300179439", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:24.257995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] validate_networks() for [('ed0db8ed-7f52-46ea-98ac-2c32d57a7bae', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:08:24.957818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:24.958432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:24.958899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:24.959385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:24.959836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:24.969364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:24.969870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:24.970290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:24.971017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:24.971476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:24.971914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:24.989311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:24.994606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for user b36da10548a54bc984b0191739d85dfd and project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:25.007924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:25.010397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:25.061947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f5ffe16-3d3a-4892-8be8-5ce80e7066bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.871680 Aug 24 02:08:25.068756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2866/3858] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:08:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:08:25.068756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:25.068756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:25.074468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.074953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.075446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.076192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.076644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.077086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.281138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:25.289899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f288316-d223-4761-b5a0-2f64bf1f3336 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1507 microversion: 2.1 time: 0.226246 Aug 24 02:08:25.290519 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2867/3859] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:25 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:25.315217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:25.315738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:25.322764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.323701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.324366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.325101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.325562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.326197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.358441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:25.482911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b999eb8-7633-4595-a62a-1621794fa390 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 204 len: 0 microversion: 2.1 time: 0.183825 Aug 24 02:08:25.483933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2868/3860] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:25 2022] DELETE /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:25.491469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: .version_select at 0x7f6b91756e50>, body: {"server_group": {"name": "tempest-server-group-748762465", "policies": ["anti-affinity"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:25.513758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:25.522932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:25.578253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:25.584624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_groups'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:25.600061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f288866-b1a8-405a-bc9a-05d09c805960 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.114879 Aug 24 02:08:25.602183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2869/3861] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 02:08:25 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:25.608297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:25.608485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:25.614875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.615573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.616075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.618227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.619044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.619571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.843511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:25.852582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29329b46-e772-47da-90d4-582127c53fc3 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.249257 Aug 24 02:08:25.855712 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2870/3862] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:25 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:25.857772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:25.858378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:25.864245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.864745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.865196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.865886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.866338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.867325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.935952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:25.943910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34310614-f091-4c62-9d5c-5b424deb9c9c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1228 microversion: 2.1 time: 0.089728 Aug 24 02:08:25.944696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2871/3863] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:25 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:25.949032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:25.949596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:25.955793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.956279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.956740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:25.957426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:25.958108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:25.959140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:26.146390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:26.168379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-407f59dc-e490-43e7-9f76-fd56e5917b07 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1515 microversion: 2.1 time: 0.222758 Aug 24 02:08:26.169281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2872/3864] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:25 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:26.174338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-918edc4d-6518-447a-a3a0-51c057803a05 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:26.207966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-918edc4d-6518-447a-a3a0-51c057803a05 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/41aaac86-8916-41dd-9541-6d1cd93961e0" status: 204 len: 0 microversion: 2.1 time: 0.037391 Aug 24 02:08:26.208944 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2873/3865] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:26 2022] DELETE /compute/v2.1/os-server-groups/41aaac86-8916-41dd-9541-6d1cd93961e0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:26.217630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be6de863-4de1-4d79-8d65-0068d745f5d8 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:26.230841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be6de863-4de1-4d79-8d65-0068d745f5d8 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.017341 Aug 24 02:08:26.232255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2874/3866] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:08:26 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:26.286984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1571536128", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "afd0c378-ef75-468c-aed1-f7647587e253"}]}, "os:scheduler_hints": {"group": "14e727f0-a8e0-4e79-af46-0c5a31cd9a4a"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:26.362254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] validate_networks() for [('afd0c378-ef75-468c-aed1-f7647587e253', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:08:27.055647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:27.056265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:27.057201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:27.057860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:27.058543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:27.086577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.087405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.087849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:27.088592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.089080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.089512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:27.110689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:27.117552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:27.131019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:27.133922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:27.149754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:27.191993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:27.197680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:27.234772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for project ed2317391ae94180a6d986d4a349f701. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:27.247556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Getting quotas for user 1f1ad098e06145c782aac7c673d9741f and project ed2317391ae94180a6d986d4a349f701. Resources: {'server_group_members'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:27.277352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69b7a2c1-a82a-4d53-867e-131dc0892083 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994794 Aug 24 02:08:27.278742 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2875/3867] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:08:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:08:27.283959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:27.284871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:27.291816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.292579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.293235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:27.294143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.294786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.295380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:27.855296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:27.863066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5715f3ad-69a6-46ac-881e-46c043ad9e0e tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.583056 Aug 24 02:08:27.863649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2876/3868] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:27 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:27.868567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:27.869441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:27.875784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.876467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.877163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:27.878024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:27.878635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:27.879267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.058145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:28.066222 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48a4e1d5-cda8-423e-8a1f-7654632cd822 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1282 microversion: 2.1 time: 0.201396 Aug 24 02:08:28.066798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2877/3869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:27 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:28.072067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:28.072893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:28.079319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.080009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.080612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.081509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.082142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.082745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.485481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:28.495965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9b4a013-3cb0-445f-b6b5-cbd14ae2f899 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1515 microversion: 2.1 time: 0.427935 Aug 24 02:08:28.496563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2878/3870] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:28 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1515 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:28.501438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:28.502286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:28.515643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.516189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.516640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.517387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.517855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.518295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.960266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:28.970447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4869521e-3b13-4fb1-ad70-1b59c6ba6507 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1265 microversion: 2.1 time: 0.472811 Aug 24 02:08:28.971843 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2879/3871] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:28 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:28.980371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fbda901d-5a65-4d3e-b5d2-95ee4071c14c"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:28.983504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:28.989880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.990371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.990812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:28.991733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:28.992340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:28.992820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.048285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] HTTP exception thrown: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Request method failure captured: Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719/os-volume_attachments/b3ca82c5-9837-46b0-a56d-7a58e5465e69 HTTP/1.1 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 74 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdoxOk4IH_DPYmLoqaBmzDtqHLk5-bXWk1oYWr5Zqc_1lLr-3FWN9rK_7afrc0rNjqvk-zP1JQzkEaYFXSQU_IkRffRipEP-3tUOxe75ywsDw3ECJdevBKwUmTUNZ50k2Cz_lc_R42Ns9AtgX9ZLYoIhB5A9DLjdBy_XvyybuHcg_g Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 2526d9ab3134450bac8df86a261409d7 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2526d9ab3134450bac8df86a261409d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2526d9ab3134450bac8df86a261409d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 2526d9ab3134450bac8df86a261409d7 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1395868174 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesAdminNegativeTest-1395868174-project-admin Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d1f93c4b05944918216c2dcd5d4deb8 Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesAdminNegativeTest-1395868174-project-admin Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: {"volumeAttachment": {"volumeId": "fbda901d-5a65-4d3e-b5d2-95ee4071c14c"}} Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'ad8d4839-86ec-4c5c-b8a3-204b330d2719', 'id': 'b3ca82c5-9837-46b0-a56d-7a58e5465e69', 'body': {'volumeAttachment': {'volumeId': 'fbda901d-5a65-4d3e-b5d2-95ee4071c14c'}}} Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. (HTTP 404) (Request-ID: req-a03e3a00-11bd-4b15-8b2c-83b96b0eb065) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:08:29.051225 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] Returning 404 to user: Volume b3ca82c5-9837-46b0-a56d-7a58e5465e69 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-927f397f-0d4a-40d9-b1d7-cc71b6b659aa tempest-VolumesAdminNegativeTest-1395868174 tempest-VolumesAdminNegativeTest-1395868174-project-admin] 10.222.0.49 "PUT /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719/os-volume_attachments/b3ca82c5-9837-46b0-a56d-7a58e5465e69" status: 404 len: 109 microversion: 2.1 time: 0.082402 Aug 24 02:08:29.059622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2880/3872] 10.222.0.49 () {60 vars in 1433 bytes} [Wed Aug 24 02:08:28 2022] PUT /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719/os-volume_attachments/b3ca82c5-9837-46b0-a56d-7a58e5465e69 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:29.071906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:29.071906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:29.085286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.086701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.087404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.088547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.089211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.089799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.489804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:29.499300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4640e91-d796-41a7-87b7-9a4c240d8958 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.439851 Aug 24 02:08:29.504947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2881/3873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:29 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:29.522633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:29.524087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:29.535691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.536653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.537487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.538442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.539065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.543164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.684761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:29.692751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-514fe00f-0a89-4bb5-94b8-b7244373dcac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1282 microversion: 2.1 time: 0.186518 Aug 24 02:08:29.693348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2882/3874] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:29 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:29.701835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa5bd45-358d-4bbb-9d2f-264686839ec4", "name": "network-vif-deleted", "tag": "4ed24a43-7d5f-4135-913f-9c9d3c1e5798"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:29.731806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.732382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.732919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.759715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] Creating event network-vif-deleted:4ed24a43-7d5f-4135-913f-9c9d3c1e5798 for instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 on n-h2-854121-3 Aug 24 02:08:29.766433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e331ac40-62f4-45a2-96b6-0e7752ced277 req-cea6e9dc-95a3-4b5b-b967-d7e96e19fcab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068019 Aug 24 02:08:29.767140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2883/3875] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:29.772348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:29.777071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:29.789029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.801463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.802020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.803007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.803675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.804923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.866021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:29.867029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:29.867487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:29.868305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lazy-loading 'fault' on Instance uuid 3aa5bd45-358d-4bbb-9d2f-264686839ec4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:08:29.991136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:29.996551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:30.005742 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45abc5a2-e434-4f16-ad26-f4bee511e7b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 200 len: 1319 microversion: 2.1 time: 0.237255 Aug 24 02:08:30.006660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2884/3876] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:29 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:30.014769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:30.015899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:30.029832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:30.030679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:30.032252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:30.033509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:30.033821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:30.036401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:30.716527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:30.737378 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a9705c1-d4aa-4c1d-b7f8-47b8c102ef88 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1313 microversion: 2.1 time: 0.719085 Aug 24 02:08:30.738387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2885/3877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:30 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:30.743334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:30.744200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:30.761243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:30.762203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:30.763079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:30.764008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:30.764672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:30.765350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.211460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:31.220548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94c88789-271d-48e1-924a-f1fb08912ab7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.480492 Aug 24 02:08:31.221189 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2886/3878] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:30 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:31.226211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f78c35-6865-4ca5-94ed-aad13f0436dc", "tag": "e0163374-640e-4f32-a820-75723f8e3463"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:31.241246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.242289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.242736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.262150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] Creating event network-changed:e0163374-640e-4f32-a820-75723f8e3463 for instance 69f78c35-6865-4ca5-94ed-aad13f0436dc on n-h2-854121-3 Aug 24 02:08:31.269524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-79cf539c-cf3c-4220-9d61-4d9da3a09615 req-cfb73689-a4d8-4762-96ab-8d477ef4f1cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046810 Aug 24 02:08:31.276760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2887/3879] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:31.285994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:31.287879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:31.297536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.298685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.300085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.301491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.302918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.304589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.640770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:31.649063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7184e3ce-32ba-4422-96b0-a22b02088a99 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.370369 Aug 24 02:08:31.660752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2888/3880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:31 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:31.660752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30fe6a0-32b9-43cc-963b-2188841f5f8b", "name": "network-vif-plugged", "status": "completed", "tag": "75c4a844-8236-4219-bffd-8adf52615f8b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:31.671515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.672002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.672856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.684995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] Creating event network-vif-plugged:75c4a844-8236-4219-bffd-8adf52615f8b for instance c30fe6a0-32b9-43cc-963b-2188841f5f8b on n-h1-854121-3 Aug 24 02:08:31.690540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b98750d8-76e2-4012-952f-57b1d0f57382 req-e1ecc153-e349-46fa-9da7-17d459c0e1f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038945 Aug 24 02:08:31.691581 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2889/3881] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:31.699790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:31.700422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:31.707244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.707737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.708173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.708933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.709686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.709962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.724117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 HTTP/1.1 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3aa5bd45-358d-4bbb-9d2f-264686839ec4'} Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:31.726482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bdd42ea3-9ea0-4f97-b112-1c68804cf938 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 404 len: 111 microversion: 2.1 time: 0.032425 Aug 24 02:08:31.738466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2890/3882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:31 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:31.760147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:31.769113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:31.784797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.785282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.796302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:31.797104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:31.797818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:31.798452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:32.137755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:32.149414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55257ed6-5b82-4312-a791-81b868a5c0a6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1313 microversion: 2.1 time: 0.393051 Aug 24 02:08:32.150340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2891/3883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:31 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:32.160048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2041682607", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "2549927b-f801-497a-9b40-bd3bc0f5c02a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:32.215823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] validate_networks() for [('2549927b-f801-497a-9b40-bd3bc0f5c02a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:08:32.645045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:32.645897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:32.646383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:32.646794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:32.647203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:32.657700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:32.658480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:32.658923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:32.659650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:32.660913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:32.661433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:32.681513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:32.687088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Getting quotas for user 7d4880d06f464d18aa1dbc51355f4ca9 and project cdcb59fe8c664c16b4b64d8acb508f3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:32.699840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:32.702159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:32.748978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1801660-804f-4b75-9d15-9bedf95243e7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597555 Aug 24 02:08:32.749947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2892/3884] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:08:32.760521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0947cf-0536-46f9-b5c3-adc51d0c9654", "tag": "b91bee88-c99a-4a27-b1e4-81275d213722"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:32.775381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:32.775821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:32.777247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:32.810403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] Creating event network-changed:b91bee88-c99a-4a27-b1e4-81275d213722 for instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 on n-h1-854121-3 Aug 24 02:08:32.816009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b709ce76-950f-4579-b29c-f7e591c734e8 req-46b43325-c7b2-4800-9c73-ae2aa99edb78 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064860 Aug 24 02:08:32.817240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2893/3885] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:32.826139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:32.827129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:32.836307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:32.837253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:32.838043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:32.839078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:32.839776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:32.841339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.098728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:33.119366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7e04784-ec95-4ba6-b700-fb0df9df55b1 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1324 microversion: 2.1 time: 0.288604 Aug 24 02:08:33.120434 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2894/3886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:32 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:33.126318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:33.135466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:33.148546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.149092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.149946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.150233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.150687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.151110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.201334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:33.306745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e33e02f5-7e4a-4dee-a692-a805825b7135 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 204 len: 0 microversion: 2.1 time: 0.183747 Aug 24 02:08:33.308037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2895/3887] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:33 2022] DELETE /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:33.316910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:33.318328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:33.328061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.328965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.329483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.330429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.331077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.331851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.856174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:33.863992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60099987-d38d-4a44-be12-9d74005c88f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.552812 Aug 24 02:08:33.864803 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2896/3888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:33 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:33.871021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:33.871633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:33.883956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.884327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.884791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.885504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:33.885960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:33.886386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:33.970891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:33.980465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3e2ec49-00b5-43a5-a935-79828d369a53 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1213 microversion: 2.1 time: 0.114289 Aug 24 02:08:33.981336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2897/3889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:33 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:33.997474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:33.998069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.005109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.005501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.005942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.006708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.007224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.007645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.158642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:34.167464 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3f22d4a-b690-45c8-93b9-c7693d7327b9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1313 microversion: 2.1 time: 0.185225 Aug 24 02:08:34.168068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2898/3890] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:33 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:34.172845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.173450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.179835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.180321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.180776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.181541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.181992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.182410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.319188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:34.330600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68c76b09-8622-4824-8abd-67212369187b tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1513 microversion: 2.1 time: 0.161401 Aug 24 02:08:34.331187 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2899/3891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:34 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:34.336144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.336767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.342646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.343089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.343521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.344210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.344654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.345096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.555167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:34.563690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b3e8a7e-d7d8-48c1-98d5-d1abcb021ea4 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1520 microversion: 2.1 time: 0.231478 Aug 24 02:08:34.565122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2900/3892] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:34 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:34.585512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.586340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.589640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:34.593317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.593807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.594462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.595167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.595938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.596397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.635927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] HTTP exception thrown: Action 999 not found Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Request method failure captured: Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b/os-instance-actions/999 HTTP/1.1 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgNg_G2kRpTKqbRVpIpfbGyyAkPpCN7VB0onlt0Ev44hzDd4ezOlujkuw_PGtBjNXKsqDlYNzNM5xcpNULRKSOWBIoDZRb0QGE2nzwchsK0PNa5GBYohI3byuj48yMy5xhhYeFv0QW1q3XXRUJfmaqkINgTvmmtyvKi1hskOQAcqpQ Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 262af17a5ce84aa4acd229dfcdf50402 Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: exception: Action 999 not found Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'c30fe6a0-32b9-43cc-963b-2188841f5f8b', 'id': '999'} Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 24 02:08:34.642738 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.647660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Returning 404 to user: Action 999 not found {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:34.647660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-586fe8d2-72b0-4f43-8d32-7ab928ad1c08 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.062708 Aug 24 02:08:34.652139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2901/3893] 10.222.0.49 () {58 vars in 1308 bytes} [Wed Aug 24 02:08:34 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b/os-instance-actions/999 => generated 66 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 02:08:34.665533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '.version_select at 0x7f6b92472790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.666166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: 5944b894-532b-4d20-8f15-c811c1a9849f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.671979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] HTTP exception thrown: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Request method failure captured: Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5944b894-532b-4d20-8f15-c811c1a9849f/os-instance-actions HTTP/1.1 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgNg_G2kRpTKqbRVpIpfbGyyAkPpCN7VB0onlt0Ev44hzDd4ezOlujkuw_PGtBjNXKsqDlYNzNM5xcpNULRKSOWBIoDZRb0QGE2nzwchsK0PNa5GBYohI3byuj48yMy5xhhYeFv0QW1q3XXRUJfmaqkINgTvmmtyvKi1hskOQAcqpQ Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 262af17a5ce84aa4acd229dfcdf50402 Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '5944b894-532b-4d20-8f15-c811c1a9849f'} Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:34.673586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Returning 404 to user: Instance 5944b894-532b-4d20-8f15-c811c1a9849f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:34.680932 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd759e69-1c75-493f-b6fb-cbb47a8bb860 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/5944b894-532b-4d20-8f15-c811c1a9849f/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021743 Aug 24 02:08:34.683000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2902/3894] 10.222.0.49 () {58 vars in 1296 bytes} [Wed Aug 24 02:08:34 2022] GET /compute/v2.1/servers/5944b894-532b-4d20-8f15-c811c1a9849f/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:34.685935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.688188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.694539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.695038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.695588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.696310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.696799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.697237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.727220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:34.752487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:34.822688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90ac99e6-d5be-4e23-873b-b87640064586 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 204 len: 0 microversion: 2.1 time: 0.140206 Aug 24 02:08:34.823478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2903/3895] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:34 2022] DELETE /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:34.832050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:34.832794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:34.838726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.839207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.839636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:34.840347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:34.840823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:34.841240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.083311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:35.093838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9aa27e9d-b1d2-4867-89e8-6652df57ee73 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1526 microversion: 2.1 time: 0.265987 Aug 24 02:08:35.100930 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2904/3896] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:34 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:35.111923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:35.113426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:35.121006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.121518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.122470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.123399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.124118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.124695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.453541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:35.467149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db1713f6-f2b0-433a-b73c-308d86ea6c4b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.364490 Aug 24 02:08:35.468946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2905/3897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:35 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:35.474829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:35.475654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:35.486193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.486952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.487590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.488744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.489946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.490395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.576872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:35.591451 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2db66307-9a5b-4b4b-82d9-2d882f590aad tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1261 microversion: 2.1 time: 0.121150 Aug 24 02:08:35.592054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2906/3898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:35 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1261 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:35.605279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:35.606109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:35.620594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.621122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.621566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.622290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.622795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.623302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.878163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:35.894846 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c70421c-420e-4cc2-9f7f-e8f9527a9213 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1313 microversion: 2.1 time: 0.301042 Aug 24 02:08:35.896161 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2907/3899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:35 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:35.903124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:35.904158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:35.912141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.912783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.913353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:35.914964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:35.915472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:35.915905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.035374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:36.048702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b624c755-77aa-4423-8a50-ab995bf1d3db tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1471 microversion: 2.1 time: 0.149834 Aug 24 02:08:36.078397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2908/3900] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:35 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:36.087506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f78c35-6865-4ca5-94ed-aad13f0436dc", "name": "network-vif-plugged", "status": "completed", "tag": "e0163374-640e-4f32-a820-75723f8e3463"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:36.103733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.104330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.104880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.122818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] Creating event network-vif-plugged:e0163374-640e-4f32-a820-75723f8e3463 for instance 69f78c35-6865-4ca5-94ed-aad13f0436dc on n-h2-854121-3 Aug 24 02:08:36.129679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-af1442e5-3da0-485f-ab85-12dd7ad63485 req-bd63dd2a-6c13-43ba-8faf-5fa3caad4de8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049112 Aug 24 02:08:36.131414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2909/3901] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:36.166329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8d4839-86ec-4c5c-b8a3-204b330d2719", "name": "network-vif-deleted", "tag": "0698e43f-021e-4a68-9487-0a0fbe0f0c27"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:36.213403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.217009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.217760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.244124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] Creating event network-vif-deleted:0698e43f-021e-4a68-9487-0a0fbe0f0c27 for instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 on n-h2-854121-3 Aug 24 02:08:36.257978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-688715f9-7f54-47f0-bae6-5beae3965b9b req-28153164-02f3-4daa-aa09-77e9cec6bd1d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122329 Aug 24 02:08:36.259987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2910/3902] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:36.279518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:36.280766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:36.289266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.290285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.290942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.292150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.293405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.294405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.535562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:36.545004 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72d62cba-34f2-45fa-b1bf-e3b3007cd984 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1526 microversion: 2.1 time: 0.281268 Aug 24 02:08:36.553042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2911/3903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:36 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:36.562817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:36.563526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:36.570990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.571499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.571934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.573361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.573827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.574251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.737645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:36.746441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b9597e0-9d2e-4e98-82eb-246fac373b06 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.191015 Aug 24 02:08:36.747262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2912/3904] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:36 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:36.756440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:36.757670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:36.764141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.764793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.765295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.766299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.766429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.766837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.838210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:36.846290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02e5e52a-930d-4b64-92e2-33608536847f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1267 microversion: 2.1 time: 0.098191 Aug 24 02:08:36.847131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2913/3905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:36 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:36.926802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:36.927428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:36.935829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.936331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.936800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:36.938373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:36.938870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:36.939268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.164061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:37.173872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b1903aa-c594-4729-ae56-28beb21a2d48 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1313 microversion: 2.1 time: 0.257969 Aug 24 02:08:37.174868 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2914/3906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:36 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:37.180357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:37.181130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:37.187729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.188242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.189123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.189855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.190597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.191159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.234291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.234848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.236761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.236761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lazy-loading 'fault' on Instance uuid ad8d4839-86ec-4c5c-b8a3-204b330d2719 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:08:37.297445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:37.306614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e908eda6-d4a6-4628-9cf4-776c2dd8d0bf tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 200 len: 1308 microversion: 2.1 time: 0.130622 Aug 24 02:08:37.307791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2915/3907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:37 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:37.567193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:37.571241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:37.581319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.582077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.582686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.583584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.584223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.584841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.803094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:37.811265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63477071-a790-4041-837e-4cb0b7a79c0d tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1526 microversion: 2.1 time: 0.247982 Aug 24 02:08:37.811848 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2916/3908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:37 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1526 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:37.817492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:37.818433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:37.831164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.831655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.832090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:37.832823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:37.833278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:37.834242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:38.309695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:38.323130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24e6bb4f-59df-49e7-b82f-486ece4af376 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.509635 Aug 24 02:08:38.325353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2917/3909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:37 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:38.336738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:38.338057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:38.360374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:38.361118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:38.361930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:38.365200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:38.365926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:38.368392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:38.789394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:38.789394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3098b4cd-99bf-47fc-b05d-ce86ec24129d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.410817 Aug 24 02:08:38.789394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2918/3910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:38 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:38.789394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:38.789394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:38.795942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:38.796451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:38.796985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:38.798006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:38.804659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:38.805383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.184571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:39.202082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2607278-6aae-49fc-9f34-93d0b198cd55 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1498 microversion: 2.1 time: 0.449145 Aug 24 02:08:39.206458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2919/3911] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:38 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1498 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:39.219535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:39.222873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: ad8d4839-86ec-4c5c-b8a3-204b330d2719] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:39.239937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.240625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.242069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.243294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.246728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.247303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.304969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:39.308647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] HTTP exception thrown: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Request method failure captured: Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 HTTP/1.1 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdXClXJRxxqmrT0QKne_1C9L2TTBH7uGDpw7atXxBmgf6OqFo6gQEzz_ahAOf32vgi95Quzhy5VsF6FBK85hSX_m4hOkmypejpsZVmOfMHKM3SSsHgfOayiWiRo06BAH-iVpvtxN2Lln_qxBERDXPBttSWwnq8VGNMWR-zYfE3-KYg Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: adccd0d3681b4e288623abbaebb5fc68 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: adccd0d3681b4e288623abbaebb5fc68 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesAdminNegativeTest-1405512565-project Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 977f49b5afbb4b3b88afcef4a6e58ce4 Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesAdminNegativeTest-1405512565-project Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ad8d4839-86ec-4c5c-b8a3-204b330d2719'} Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:39.315681 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. Aug 24 02:08:39.319808 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:39.321316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Returning 404 to user: Instance ad8d4839-86ec-4c5c-b8a3-204b330d2719 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:39.325246 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12739001-1fe2-4ab2-971f-e8c127458634 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719" status: 404 len: 111 microversion: 2.1 time: 0.115650 Aug 24 02:08:39.326470 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2920/3912] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:39 2022] GET /compute/v2.1/servers/ad8d4839-86ec-4c5c-b8a3-204b330d2719 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:39.342614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:39.345978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:39.363176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.367668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.368323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.371306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.372389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.373998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.461204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.461723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.462183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.462649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lazy-loading 'fault' on Instance uuid c30fe6a0-32b9-43cc-963b-2188841f5f8b {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:08:39.577107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262af17a5ce84aa4acd229dfcdf50402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ce248132ec42a59d2f42ce0357c750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:39.590245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85e484df-4498-4f34-81df-920077075b91 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 200 len: 1314 microversion: 2.1 time: 0.262269 Aug 24 02:08:39.591298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2921/3913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:39 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:39.595955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff4ac929-886c-4b41-95b7-42554cff9488", "tag": "85f1db79-0925-470c-ab83-9466364c9cc3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:39.609117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.609819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.610727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.625374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] Creating event network-changed:85f1db79-0925-470c-ab83-9466364c9cc3 for instance ff4ac929-886c-4b41-95b7-42554cff9488 on n-h2-854121-3 Aug 24 02:08:39.633611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-26d94f93-0502-4207-9d82-969448ee2098 req-c8864a64-b4eb-42a0-87ea-ff45d37c3951 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040542 Aug 24 02:08:39.634872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2922/3914] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:39.642111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:39.659783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_groups [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Querying cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) for 1 instances {{(pid=128567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 02:08:39.660809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.661603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.662181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.687844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4cf01527-794b-4bd2-b692-659ff8716d0b tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a" status: 200 len: 220 microversion: 2.1 time: 0.051073 Aug 24 02:08:39.688955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2923/3915] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:08:39 2022] GET /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a => generated 220 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:39.694170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30fe6a0-32b9-43cc-963b-2188841f5f8b", "name": "network-vif-deleted", "tag": "75c4a844-8236-4219-bffd-8adf52615f8b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:39.705078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.705776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.716143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.747574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] Creating event network-vif-deleted:75c4a844-8236-4219-bffd-8adf52615f8b for instance c30fe6a0-32b9-43cc-963b-2188841f5f8b on n-h1-854121-3 Aug 24 02:08:39.771862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9def676b-1c80-4017-a462-55008d75dbcd req-d4d7faa0-3596-46b5-98f2-ec83136368c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078862 Aug 24 02:08:39.774933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2924/3916] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:39.782521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:39.784807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:39.792516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.793265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.794169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.795041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.795768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.796341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.953542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:39.962475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13b3dcfe-7eb7-457c-a4c1-6db3eae313cc tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.186098 Aug 24 02:08:39.977347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2925/3917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:39 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:39.982845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:39.983581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:39.990662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.991973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.992570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:39.993473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:39.994086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:39.994773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.047185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:40.222946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abc8fa7a-d7ab-4c01-9f60-8311fbe094c9 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 204 len: 0 microversion: 2.1 time: 0.243870 Aug 24 02:08:40.245253 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2926/3918] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:39 2022] DELETE /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:40.254106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:40.254641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:40.262542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.263070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.263495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.264862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.264862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.265583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.421344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:40.432026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d0a1ead-5905-4076-b482-fb6944edacd5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.184324 Aug 24 02:08:40.445282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2927/3919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:40 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:40.445282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:40.445282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:40.447841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.448337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.448951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.449503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.449962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.450419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.639770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:40.651018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53b60f96-4185-4ef0-87b2-9799ee3e9a7e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1504 microversion: 2.1 time: 0.217304 Aug 24 02:08:40.652407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2928/3920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:40 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:40.657095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:40.657721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] [instance: c30fe6a0-32b9-43cc-963b-2188841f5f8b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:40.672424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.673038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.673629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.674418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:40.674951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:40.675457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:40.691921 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] HTTP exception thrown: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Request method failure captured: Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b HTTP/1.1 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgNg_G2kRpTKqbRVpIpfbGyyAkPpCN7VB0onlt0Ev44hzDd4ezOlujkuw_PGtBjNXKsqDlYNzNM5xcpNULRKSOWBIoDZRb0QGE2nzwchsK0PNa5GBYohI3byuj48yMy5xhhYeFv0QW1q3XXRUJfmaqkINgTvmmtyvKi1hskOQAcqpQ Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e4ce248132ec42a59d2f42ce0357c750"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e4ce248132ec42a59d2f42ce0357c750 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-866305730 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 262af17a5ce84aa4acd229dfcdf50402 Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-866305730-project Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c30fe6a0-32b9-43cc-963b-2188841f5f8b'} Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:40.693754 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] Returning 404 to user: Instance c30fe6a0-32b9-43cc-963b-2188841f5f8b could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c10187f-3d78-4c75-9646-c683935754c7 tempest-InstanceActionsNegativeTestJSON-866305730 tempest-InstanceActionsNegativeTestJSON-866305730-project] 10.222.0.49 "GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b" status: 404 len: 111 microversion: 2.1 time: 0.042386 Aug 24 02:08:40.697999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2929/3921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:40 2022] GET /compute/v2.1/servers/c30fe6a0-32b9-43cc-963b-2188841f5f8b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:40.989606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:40.990234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:41.008889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.009890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.009890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.010536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.010999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.011758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.332198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:41.340496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f0a6325-ff34-4a42-87c2-bc79af7493f3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.354795 Aug 24 02:08:41.352752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2930/3922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:40 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:41.352752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0947cf-0536-46f9-b5c3-adc51d0c9654", "name": "network-vif-plugged", "status": "completed", "tag": "b91bee88-c99a-4a27-b1e4-81275d213722"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:41.362514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.363007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.363598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.376485 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] Creating event network-vif-plugged:b91bee88-c99a-4a27-b1e4-81275d213722 for instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 on n-h1-854121-3 Aug 24 02:08:41.383320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1b4ceaf3-f998-4b83-acac-eaa7cc17a3ad req-5a22f84c-0354-433b-b87f-03a39fa1a9e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041013 Aug 24 02:08:41.384083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2931/3923] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:41.454438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:41.456474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:41.481836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.482564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.483151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.484014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.485250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.485824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.753379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:41.767069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-403a0048-c9f3-4d96-936b-4821ef701df8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.317574 Aug 24 02:08:41.781980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2932/3924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:41 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:41.781980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:41.781980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:41.786112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.786719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.787225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:41.788061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:41.788637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:41.789086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:42.129709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:42.144923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62809c3c-b2bf-4263-9c04-10915fa239d6 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1504 microversion: 2.1 time: 0.373462 Aug 24 02:08:42.145772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2933/3925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:41 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:42.363940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:42.364552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:42.374565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:42.375804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:42.376554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:42.377313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:42.378051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:42.378617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:42.672558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:42.695927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=76 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:42.964084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:42.983608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fcf4fbc-d6b2-4850-a844-f9aff9c6f994 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1324 microversion: 2.1 time: 0.621981 Aug 24 02:08:42.986515 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2934/3926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:42 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:42.999026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:43.006989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:43.024134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.024630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.025293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.025800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.026254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.026683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.326707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:43.336334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b68d910-fd87-4995-8dd5-b243a446fe20 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.347488 Aug 24 02:08:43.353214 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2935/3927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:42 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:43.362524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:43.365081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:43.377986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.380933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.381543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.383984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.384673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.386563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.821597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:43.842041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c48d2ec7-e659-4eaf-82ce-e5be5a2fb434 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1504 microversion: 2.1 time: 0.487242 Aug 24 02:08:43.843001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2936/3928] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:43 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:43.847886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:43.848393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:43.868467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.869020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.869460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.870177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:43.870638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:43.871080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:43.924113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:43.975559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:44.086237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6abdcdcd-9c9f-424b-b695-34295c3ac2bd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "DELETE /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 204 len: 0 microversion: 2.1 time: 0.240666 Aug 24 02:08:44.087118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2937/3929] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:43 2022] DELETE /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:44.097096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:44.098011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:44.111743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.113655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.114365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:44.116245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.118354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.119011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:44.438865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:44.450903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55968587-7b4b-4229-bed1-d62a0a726b3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1522 microversion: 2.1 time: 0.362261 Aug 24 02:08:44.456991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2938/3930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:44 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:44.473805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:44.474658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:44.484785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:44.488181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.493580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.494423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:44.495204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.495796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.496217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:44.896423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:44.922874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eddfe200-46ad-489a-a913-3f1e330fccfd tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1680 microversion: 2.1 time: 0.464563 Aug 24 02:08:44.937139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2939/3931] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:44 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1680 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:44.945358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:44.946265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:44.953801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.954499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.955087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:44.956503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:44.957125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:44.957595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.230123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:45.240818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-168743f4-36fc-47a7-9df8-beb7dc252ce3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.301454 Aug 24 02:08:45.241993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2940/3932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:44 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:45.250733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:45.259299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:45.273343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.274037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.274638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.275516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.276141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.276745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.572771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:45.598124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36320e18-63a7-4944-8309-1dc24f903174 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1522 microversion: 2.1 time: 0.350977 Aug 24 02:08:45.602339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2941/3933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:45 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:45.624553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:45.626819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:45.636646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.649370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.649982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.650906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.651522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.652092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.704008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.704215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.709147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.709651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lazy-loading 'fault' on Instance uuid 69f78c35-6865-4ca5-94ed-aad13f0436dc {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:08:45.807365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f1ad098e06145c782aac7c673d9741f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2317391ae94180a6d986d4a349f701', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:45.822573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a88ff576-bd15-4825-a519-2c2b0fe9f38e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 200 len: 1303 microversion: 2.1 time: 0.218887 Aug 24 02:08:45.838225 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2942/3934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:45 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:45.843869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f78c35-6865-4ca5-94ed-aad13f0436dc", "name": "network-vif-deleted", "tag": "e0163374-640e-4f32-a820-75723f8e3463"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:45.858848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.860380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.862592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.885316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] Creating event network-vif-deleted:e0163374-640e-4f32-a820-75723f8e3463 for instance 69f78c35-6865-4ca5-94ed-aad13f0436dc on n-h2-854121-3 Aug 24 02:08:45.891906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-67080449-5079-4cb1-84fa-32bc8f22b9c4 req-c48056b7-1113-44cb-a952-74e06d7fde5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052232 Aug 24 02:08:45.893306 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2943/3935] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:45.900966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1357694862"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:45.904197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:45.911766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.912493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.913718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:45.914920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:45.916409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:45.917084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:46.239127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0becace5-855f-409a-a1b2-4a6dcb5be372 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654/action" status: 202 len: 0 microversion: 2.1 time: 0.340897 Aug 24 02:08:46.243361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2944/3936] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:08:45 2022] POST /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:08:46.262106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:46.264561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:46.285463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:46.286155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:46.287833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:46.289963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:46.292532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:46.294111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:46.926548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:46.936279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b9b0a72-34b0-4e8c-a538-d7fd91e5a990 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1680 microversion: 2.1 time: 0.690449 Aug 24 02:08:46.964019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2945/3937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:46 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1680 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:46.976881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-152f0ae8-e5a1-4b45-ba46-d27ad2a7f4ad tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b91900c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.170367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-152f0ae8-e5a1-4b45-ba46-d27ad2a7f4ad tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea" status: 204 len: 0 microversion: 2.1 time: 0.204896 Aug 24 02:08:47.171213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2946/3938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:46 2022] DELETE /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:47.176420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.177497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:47.186880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.187514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.188060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.188911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.189499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.190034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.454007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:47.464012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-450e9385-b818-4f6c-8f5e-980f04d24997 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.291470 Aug 24 02:08:47.465084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2947/3939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:47 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:47.473722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.474602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:47.483902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.484499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.485032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.485805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.486591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.487215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.506263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc HTTP/1.1 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '69f78c35-6865-4ca5-94ed-aad13f0436dc'} Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:47.509674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:47.516124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e25a34f-4b70-45e9-8c90-a852cd27f732 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 404 len: 111 microversion: 2.1 time: 0.045116 Aug 24 02:08:47.517586 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2948/3940] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:47 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:47.523885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-421dfb3d-fbbf-40e7-807e-2fefbe5037ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b91853940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.548421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-421dfb3d-fbbf-40e7-807e-2fefbe5037ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Image not found. Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-421dfb3d-fbbf-40e7-807e-2fefbe5037ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea HTTP/1.1 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c012bc5c-f307-4803-9e1d-d5a5899503ea'} Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c012bc5c-f307-4803-9e1d-d5a5899503ea Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 24 02:08:47.552283 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c012bc5c-f307-4803-9e1d-d5a5899503ea could not be found. Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:08:47.556337 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:47.560400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-421dfb3d-fbbf-40e7-807e-2fefbe5037ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:47.561467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-421dfb3d-fbbf-40e7-807e-2fefbe5037ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea" status: 404 len: 62 microversion: 2.1 time: 0.042900 Aug 24 02:08:47.562491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2949/3941] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 02:08:47 2022] GET /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:08:47.567923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.607056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_groups [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Querying cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) for 1 instances {{(pid=128567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 02:08:47.613605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.614129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.614563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.638854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66d364ac-e58f-4c78-b377-ce35c7ce8dcc tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.075121 Aug 24 02:08:47.639674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2950/3942] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:08:47 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:47.646354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:47.647891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:47.660906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.661616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.663853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:47.665113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:47.666037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:47.666816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:48.062531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:48.072338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c92092b-07b7-4bb9-8718-4a7c3eb48fd8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1534 microversion: 2.1 time: 0.431271 Aug 24 02:08:48.087116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2951/3943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:47 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1534 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:48.093736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:48.132665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_groups [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Querying cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) for 1 instances {{(pid=128567) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 24 02:08:48.141671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:48.144261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:48.147069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:48.189596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7568784-3e4b-4021-bfe9-1bdcb303413d tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a" status: 200 len: 182 microversion: 2.1 time: 0.099874 Aug 24 02:08:48.197007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2952/3944] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:08:48 2022] GET /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a => generated 182 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:48.197007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4ac929-886c-4b41-95b7-42554cff9488", "name": "network-vif-plugged", "status": "completed", "tag": "85f1db79-0925-470c-ab83-9466364c9cc3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:48.206041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:48.206532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:48.207519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:48.219832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] Creating event network-vif-plugged:85f1db79-0925-470c-ab83-9466364c9cc3 for instance ff4ac929-886c-4b41-95b7-42554cff9488 on n-h2-854121-3 Aug 24 02:08:48.225409 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4b085223-646f-4f0c-a9be-efebc35965af req-3ca9c3d1-dee1-4d3d-819a-db4a4fc3dc47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Aug 24 02:08:48.226490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2953/3945] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:48.232091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:48.233069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:48.253807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:48.257576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:48.262298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:48.265603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:48.266428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:48.269338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.224364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '977f49b5afbb4b3b88afcef4a6e58ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adccd0d3681b4e288623abbaebb5fc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:49.233206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e06a696-3325-4c14-8751-173f22b33274 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 200 len: 1326 microversion: 2.1 time: 1.004967 Aug 24 02:08:49.238172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2954/3946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:48 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 1326 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:49.253660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d3e7e0-0dee-447c-8509-afe124ceb3b1", "name": "network-vif-deleted", "tag": "424562d2-8a8a-4316-b297-9f0d65fd6171"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:49.268783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.269276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.269713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.293746 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] Creating event network-vif-deleted:424562d2-8a8a-4316-b297-9f0d65fd6171 for instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 on n-h2-854121-3 Aug 24 02:08:49.314332 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fb94781e-b63a-49b1-b914-b029488b154b req-5ac2d01e-8412-4d83-ab90-45d4ab590a1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069572 Aug 24 02:08:49.320360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2955/3947] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:49.326876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:49.334568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:49.347001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.351527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.355499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.357625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.358260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.360193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.391556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc HTTP/1.1 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '69f78c35-6865-4ca5-94ed-aad13f0436dc'} Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:49.393937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:49.397080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:49.400498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:49.401610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29dafb59-0f1e-4ee1-bea1-ca8618b07a6e tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 404 len: 111 microversion: 2.1 time: 0.078992 Aug 24 02:08:49.402670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2956/3948] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:49 2022] DELETE /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:49.408070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:49.408939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:49.435454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.436262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.436950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.439129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.439820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.440436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.687500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:49.702789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20f780d2-f6aa-46a4-8582-565a460af4a7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.298634 Aug 24 02:08:49.703796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2957/3949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:49 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:49.721656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:49.722491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:49.730320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.730777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.731279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.732223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:49.732900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:49.734401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:49.763617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:50.034244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:50.045601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c4f6473-24b4-4a1a-a9bf-2cfaf1ab1b22 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1540 microversion: 2.1 time: 0.340535 Aug 24 02:08:50.046348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2958/3950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:49 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1540 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:50.220460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-340403740", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:50.283370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:08:50.284455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:08:50.284956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:08:50.285365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:08:50.285773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:08:50.295856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.296555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.297027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.297779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.298228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.298643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.317776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Getting quotas for project 3ffe8d72f3a04a3fac01828eb492248c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:08:50.323141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Getting quotas for user f60e03de8ff84468a692f2464eef2310 and project 3ffe8d72f3a04a3fac01828eb492248c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:08:50.336117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:08:50.338820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:08:50.392320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ea3fec2-2508-4c76-9b80-701c955c3fe4 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.334193 Aug 24 02:08:50.393710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2959/3951] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:08:50.398698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.400030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] [instance: 69f78c35-6865-4ca5-94ed-aad13f0436dc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:50.406657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.407154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.407596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.408468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.408959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.409532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.425531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc HTTP/1.1 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '69f78c35-6865-4ca5-94ed-aad13f0436dc'} Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.427037 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance 69f78c35-6865-4ca5-94ed-aad13f0436dc could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f553646f-556e-4875-923c-7c95471472df tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc" status: 404 len: 111 microversion: 2.1 time: 0.033697 Aug 24 02:08:50.431238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2960/3952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:50 2022] GET /compute/v2.1/servers/69f78c35-6865-4ca5-94ed-aad13f0436dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:50.434600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.435215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] [instance: 26d3e7e0-0dee-447c-8509-afe124ceb3b1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:50.441466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.441956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.442403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.443103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.443560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.443977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.459991 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] HTTP exception thrown: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Request method failure captured: Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 HTTP/1.1 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYdXClXJRxxqmrT0QKne_1C9L2TTBH7uGDpw7atXxBmgf6OqFo6gQEzz_ahAOf32vgi95Quzhy5VsF6FBK85hSX_m4hOkmypejpsZVmOfMHKM3SSsHgfOayiWiRo06BAH-iVpvtxN2Lln_qxBERDXPBttSWwnq8VGNMWR-zYfE3-KYg Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: adccd0d3681b4e288623abbaebb5fc68 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_adccd0d3681b4e288623abbaebb5fc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: adccd0d3681b4e288623abbaebb5fc68 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1405512565 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesAdminNegativeTest-1405512565-project Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 977f49b5afbb4b3b88afcef4a6e58ce4 Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesAdminNegativeTest-1405512565-project Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '26d3e7e0-0dee-447c-8509-afe124ceb3b1'} Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.461578 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Returning 404 to user: Instance 26d3e7e0-0dee-447c-8509-afe124ceb3b1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0bd4958-fb74-492a-aa38-93f930efe648 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1" status: 404 len: 111 microversion: 2.1 time: 0.032109 Aug 24 02:08:50.465202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2961/3953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:50 2022] GET /compute/v2.1/servers/26d3e7e0-0dee-447c-8509-afe124ceb3b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:50.468400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.469039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:50.543930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:50.552532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:50.555252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:50.556403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33a43523-e473-454a-8a0d-fabb8c9bc314 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1280 microversion: 2.47 time: 0.091553 Aug 24 02:08:50.556978 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2962/3954] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:50 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:50.567750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f18cb5ba-3d57-4d1d-9469-a14c050e52a2 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.577747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f18cb5ba-3d57-4d1d-9469-a14c050e52a2 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f18cb5ba-3d57-4d1d-9469-a14c050e52a2 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-server-groups/41aaac86-8916-41dd-9541-6d1cd93961e0 HTTP/1.1 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '41aaac86-8916-41dd-9541-6d1cd93961e0'} Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.579605 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f18cb5ba-3d57-4d1d-9469-a14c050e52a2 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance group 41aaac86-8916-41dd-9541-6d1cd93961e0 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.583496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f18cb5ba-3d57-4d1d-9469-a14c050e52a2 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/41aaac86-8916-41dd-9541-6d1cd93961e0" status: 404 len: 117 microversion: 2.1 time: 0.019056 Aug 24 02:08:50.584877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2963/3955] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:50 2022] DELETE /compute/v2.1/os-server-groups/41aaac86-8916-41dd-9541-6d1cd93961e0 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:50.589486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bcdb3e6-018e-46d6-a11f-43ce20be9c25 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] Calling method '.version_select at 0x7f6b917e7430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.610525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bcdb3e6-018e-46d6-a11f-43ce20be9c25 tempest-VolumesAdminNegativeTest-1405512565 tempest-VolumesAdminNegativeTest-1405512565-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622030358" status: 202 len: 0 microversion: 2.1 time: 0.024556 Aug 24 02:08:50.611119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2964/3956] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:08:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622030358 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:08:50.620545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5730aaaa-6172-406f-b32c-25b93d19c23f tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.629160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5730aaaa-6172-406f-b32c-25b93d19c23f tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5730aaaa-6172-406f-b32c-25b93d19c23f tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-server-groups/c72af81f-f95b-4886-84f8-7371d3f2e446 HTTP/1.1 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c72af81f-f95b-4886-84f8-7371d3f2e446'} Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.631564 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5730aaaa-6172-406f-b32c-25b93d19c23f tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance group c72af81f-f95b-4886-84f8-7371d3f2e446 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.634650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5730aaaa-6172-406f-b32c-25b93d19c23f tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/c72af81f-f95b-4886-84f8-7371d3f2e446" status: 404 len: 117 microversion: 2.1 time: 0.019850 Aug 24 02:08:50.635052 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2965/3957] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:50 2022] DELETE /compute/v2.1/os-server-groups/c72af81f-f95b-4886-84f8-7371d3f2e446 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:50.645632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8535ae8-eedd-4e32-84ca-61b0ab0f5a80 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.653513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d8535ae8-eedd-4e32-84ca-61b0ab0f5a80 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8535ae8-eedd-4e32-84ca-61b0ab0f5a80 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-server-groups/bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae HTTP/1.1 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae'} Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.655397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8535ae8-eedd-4e32-84ca-61b0ab0f5a80 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance group bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8535ae8-eedd-4e32-84ca-61b0ab0f5a80 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae" status: 404 len: 117 microversion: 2.1 time: 0.020588 Aug 24 02:08:50.660683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2966/3958] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:50 2022] DELETE /compute/v2.1/os-server-groups/bfbbd8c1-5ba5-4a3b-8c5a-4d21c3b2a8ae => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:08:50.695381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0600b026-b7dd-4cc0-a5db-342de8f32561 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.712630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0600b026-b7dd-4cc0-a5db-342de8f32561 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] HTTP exception thrown: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0600b026-b7dd-4cc0-a5db-342de8f32561 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Request method failure captured: Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-server-groups/33a23ae8-a2c8-4967-8ed6-92307c2a4a25 HTTP/1.1 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgQyg0h6_cOEUVFTZ6SFr32ti2DEYgcOSu6PRSZWsXN37LJw789mDo2JszbJXlpHlHV_bamp-NDW-rGzECwLN7eHiyXzamKWLYkMszkuQUgyMCzikgxDb1Chm2WQ_plDjrw8NYb3zJL_LwVtwNHWGKlF0FYwCNji0TwUh_gA6qDC5Y Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ed2317391ae94180a6d986d4a349f701"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ed2317391ae94180a6d986d4a349f701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ed2317391ae94180a6d986d4a349f701 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerGroupTestJSON-1194210360 Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1f1ad098e06145c782aac7c673d9741f Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerGroupTestJSON-1194210360-project Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '33a23ae8-a2c8-4967-8ed6-92307c2a4a25'} Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.715646 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. Aug 24 02:08:50.718706 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:08:50.722795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0600b026-b7dd-4cc0-a5db-342de8f32561 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Returning 404 to user: Instance group 33a23ae8-a2c8-4967-8ed6-92307c2a4a25 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:08:50.726923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0600b026-b7dd-4cc0-a5db-342de8f32561 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/33a23ae8-a2c8-4967-8ed6-92307c2a4a25" status: 404 len: 117 microversion: 2.1 time: 0.061745 Aug 24 02:08:50.729234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2967/3959] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:50 2022] DELETE /compute/v2.1/os-server-groups/33a23ae8-a2c8-4967-8ed6-92307c2a4a25 => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:08:50.741357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:50.742181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:50.763298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.763899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.764350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:50.766671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:50.767149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:50.767675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:51.044221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:51.058247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bbc7947-29bd-47ae-b76f-0aa880ef69ba tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1309 microversion: 2.1 time: 0.325862 Aug 24 02:08:51.059217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2968/3960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:50 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:51.065763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e67f828a-d182-4b3c-8acc-c0a86c755a06 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:51.100750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e67f828a-d182-4b3c-8acc-c0a86c755a06 tempest-ServerGroupTestJSON-1194210360 tempest-ServerGroupTestJSON-1194210360-project] 10.222.0.49 "DELETE /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a" status: 204 len: 0 microversion: 2.1 time: 0.039741 Aug 24 02:08:51.105445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2969/3961] 10.222.0.49 () {58 vars in 1266 bytes} [Wed Aug 24 02:08:51 2022] DELETE /compute/v2.1/os-server-groups/14e727f0-a8e0-4e79-af46-0c5a31cd9a4a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:51.146196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:51.146196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:51.171700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:51.173494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:51.174701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:51.176777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:51.179332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:51.180229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:51.619617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:51.631027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7998e07-2b7c-4d2e-832b-4d874bbe0799 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1540 microversion: 2.1 time: 0.524570 Aug 24 02:08:51.641940 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2970/3962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:51 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1540 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:51.654019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:51.655339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:51.673222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:51.673730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:51.675726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:51.680612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:51.681958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:51.683104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:51.809562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:51.834093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:51.837354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:51.839165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31e512a4-7344-41a7-b3ee-1d0703ad987f tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1332 microversion: 2.47 time: 0.196046 Aug 24 02:08:51.840880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2971/3963] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:51 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1332 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:52.090182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:52.091311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:52.111124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.111632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.112076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:52.113015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.113455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.113965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:52.608228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:52.619052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-604ab736-18fc-464e-9b8f-1d1a3c53d698 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1490 microversion: 2.1 time: 0.534132 Aug 24 02:08:52.633779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2972/3964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:52 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1490 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:52.646219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1902932866"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:52.652039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:52.669635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.670142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.670588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:52.671314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.675848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.676371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:52.807727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ec8e65c-357c-414a-8592-d24ec2d36319 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "PUT /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1075 microversion: 2.1 time: 0.166716 Aug 24 02:08:52.817212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2973/3965] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:08:52 2022] PUT /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1075 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:08:52.838996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:52.840630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:52.849223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.850056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.850826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:52.851712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:52.852324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:52.853089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:53.304237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:53.312335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e67b20b1-983a-4183-8063-b36c8730b043 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1540 microversion: 2.1 time: 0.484458 Aug 24 02:08:53.318163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2974/3966] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:52 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1540 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:53.329431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:53.330453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:53.343313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:53.344709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:53.346001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:53.348638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:53.349761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:53.350781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:53.833890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:53.861802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b3c9c4b-07df-46e8-a5d3-548d4c81937a tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1501 microversion: 2.1 time: 0.538308 Aug 24 02:08:53.867441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2975/3967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:53 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1501 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:53.903894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:53.910001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:53.922557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:53.927440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:53.927942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:53.931324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:53.932458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:53.933657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:53.935658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:54.134447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:54.151568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:54.154678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:54.161148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c4201ff-f541-40b3-aa0d-c9791af9c943 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1338 microversion: 2.47 time: 0.290495 Aug 24 02:08:54.164953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2976/3968] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:53 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1338 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:54.182296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0947cf-0536-46f9-b5c3-adc51d0c9654", "name": "network-vif-plugged", "status": "completed", "tag": "b91bee88-c99a-4a27-b1e4-81275d213722"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:54.198487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:54.199222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:54.203755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:54.254616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] Creating event network-vif-plugged:b91bee88-c99a-4a27-b1e4-81275d213722 for instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 on n-h1-854121-3 Aug 24 02:08:54.275236 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2277c5f8-b8fa-4851-bf76-b1be302f17f2 req-8bda4119-f83f-44f3-9cf4-f8f2be6caadc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101486 Aug 24 02:08:54.277049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2977/3969] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:54.291782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:54.296272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:54.313616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:54.315998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:54.321155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:54.322005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:54.322495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:54.322934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:54.700588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:54.713014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9edaf289-eb6f-48ad-8323-b2404d142bc5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1501 microversion: 2.1 time: 0.434406 Aug 24 02:08:54.735128 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2978/3970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:54 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1501 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:54.741883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:54.742825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:54.770602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:54.772828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:54.775940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:54.776944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:54.779293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:54.783281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.436635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:55.449079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-644c2111-48ff-4e39-bca2-baaa40533a0d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1522 microversion: 2.1 time: 0.712233 Aug 24 02:08:55.462350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2979/3971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:54 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:55.472341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:55.480549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:55.481307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:55.481880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.520898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:08:55.585336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2af13b08-f9f9-4501-b35d-4df961bd7d0f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "POST /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488/action" status: 202 len: 0 microversion: 2.1 time: 0.121242 Aug 24 02:08:55.591362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2980/3972] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:08:55 2022] POST /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:08:55.599369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:55.600878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:55.611921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:55.612756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:55.613820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.614855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:55.615653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:55.617415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.744407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:55.758651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:55.762618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:55.768480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9303373c-d4ab-4c18-91da-9ac741649690 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1338 microversion: 2.47 time: 0.173384 Aug 24 02:08:55.784337 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2981/3973] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:55 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1338 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:55.797996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:55.801466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:55.815888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:55.816406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:55.816874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.817592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:55.821158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:55.821686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:55.901659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:55.983629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:08:56.104496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9287747-c32f-4b67-aa4f-649c9ad73f3c tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 204 len: 0 microversion: 2.1 time: 0.318240 Aug 24 02:08:56.105119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2982/3974] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:08:55 2022] DELETE /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:08:56.120431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:56.121364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:56.138853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:56.139361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:56.139822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:56.143102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:56.143619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:56.144100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:56.779435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:56.789740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f7b3c44-a0cd-4927-9d65-3c131aa7b451 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.680156 Aug 24 02:08:56.795093 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2983/3975] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:56 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:56.801725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:56.808866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:56.822852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:56.825306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:56.826003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:56.829089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:56.831942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:56.833003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:57.297450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:57.309734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95242de3-c915-4eff-b2b2-abefbfd696da tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1528 microversion: 2.1 time: 0.512904 Aug 24 02:08:57.311230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2984/3976] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:56 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1528 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:57.316389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:57.319405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:57.330363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:57.331224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:57.331892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:57.332990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:57.333665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:57.334356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:57.471264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:57.480864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:57.484522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:57.486117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65b7fa8b-e714-4dc9-a121-82fc52fbfb41 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1359 microversion: 2.47 time: 0.173656 Aug 24 02:08:57.486906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2985/3977] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:08:57 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:08:57.510354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-489408184"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:57.513601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:57.526367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:57.527097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:57.527688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:57.529554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:57.530328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:57.530955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:57.960628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d742154-13c3-4328-a239-2e3568e91edc tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "POST /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc/action" status: 202 len: 52 microversion: 2.47 time: 0.453126 Aug 24 02:08:57.962394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2986/3978] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:08:57 2022] POST /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc/action => generated 52 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 24 02:08:57.970896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0947cf-0536-46f9-b5c3-adc51d0c9654", "name": "network-vif-unplugged", "status": "completed", "tag": "b91bee88-c99a-4a27-b1e4-81275d213722"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:08:57.997107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:57.997465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:57.998091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.021260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] Creating event network-vif-unplugged:b91bee88-c99a-4a27-b1e4-81275d213722 for instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 on n-h1-854121-3 Aug 24 02:08:58.043226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f093535e-43f2-40c8-9a59-daeb3eebcae6 req-689eb27e-7059-4f4f-8b35-8239ffba1c31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079354 Aug 24 02:08:58.045317 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2987/3979] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:08:58.058194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:58.059532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:58.069794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.070793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.071428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.072364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.073057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.073678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.433452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:08:58.461184 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a51fb29-e106-4da8-a042-6382d6e3b610 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.395273 Aug 24 02:08:58.464596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2988/3980] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:58 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:08:58.470352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:58.470857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:58.488859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.489347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.489788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.490501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.490986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.491447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.559940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:08:58.812469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9da33a54-3f44-43a1-bcb6-299bdda15af9 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 204 len: 0 microversion: 2.47 time: 0.342034 Aug 24 02:08:58.813207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2989/3981] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:08:58 2022] DELETE /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:08:58.840749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:08:58.841882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:08:58.851374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.861538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.862105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:08:58.862939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:08:58.863405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:08:58.865607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:00.018673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:00.031693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-265d26cb-4438-4a2a-86ce-13e97276ad60 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1528 microversion: 2.1 time: 1.212244 Aug 24 02:09:00.036430 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2990/3982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:08:58 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1528 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:00.045484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:00.046098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:00.071100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:00.072348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:00.072974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:00.073851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:00.074463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:00.075181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:00.308428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:00.375806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:00.395046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:00.400255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:00.421345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebc35d43-062c-439b-9557-4f4f29c02479 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1365 microversion: 2.47 time: 0.383516 Aug 24 02:09:00.424131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2991/3983] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:09:00 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:09:00.435406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:00.440209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:00.455968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:00.459160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:00.460975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:00.464542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:00.465258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:00.466024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:00.550730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:00.951609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:00.970439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5b43c45-f12d-45fa-ba79-cd5c2901dfd1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.541802 Aug 24 02:09:00.971121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2992/3984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:00 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:01.056380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:01.057500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:01.084278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:01.085134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:01.085858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:01.086726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:01.087321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:01.088149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:01.463389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:01.488648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4a7f0fe-5e7e-4358-8c4a-f1340e438c2e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 200 len: 1486 microversion: 2.1 time: 0.437411 Aug 24 02:09:01.506123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2993/3985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:01 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:01.521221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0947cf-0536-46f9-b5c3-adc51d0c9654", "name": "network-vif-deleted", "tag": "b91bee88-c99a-4a27-b1e4-81275d213722"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:01.561665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:01.564397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:01.565052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:01.586003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] Creating event network-vif-deleted:b91bee88-c99a-4a27-b1e4-81275d213722 for instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 on n-h1-854121-3 Aug 24 02:09:01.592839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-74d79415-f940-4385-8fb9-d63f86e6ec44 req-2c61bb2c-ea6b-40f4-9656-c6320e872311 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084535 Aug 24 02:09:01.593991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2994/3986] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:01.600870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:01.601812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:01.609674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:01.610823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:01.611571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:01.612654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:01.613271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:01.613839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:01.738027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:01.752078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:01.759949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f60e03de8ff84468a692f2464eef2310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffe8d72f3a04a3fac01828eb492248c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:01.763274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a428b49c-4271-4045-89da-56a6f96909f5 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 200 len: 1365 microversion: 2.47 time: 0.167994 Aug 24 02:09:01.766561 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2995/3987] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:09:01 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:09:01.992484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:01.993309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:02.014521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:02.016619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:02.018475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:02.019854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:02.021663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:02.022531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:02.107017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:02.448900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:02.479857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b59d760-36ac-415a-b824-8fc1ca3faed5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.491923 Aug 24 02:09:02.482932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2996/3988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:01 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:09:02.519148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:02.520468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:02.535155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:02.540015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:02.540521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:02.541307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:02.541772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:02.544117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:02.571462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 HTTP/1.1 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ee0947cf-0536-46f9-b5c3-adc51d0c9654'} Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:02.574582 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:02.578364 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:02.579836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:02.580895 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71d26a69-165d-4853-b100-a2862563236b tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 404 len: 111 microversion: 2.1 time: 0.067763 Aug 24 02:09:02.581481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2997/3989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:02 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:02.731985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-192347355", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:02.857480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] validate_networks() for [('ed0db8ed-7f52-46ea-98ac-2c32d57a7bae', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:09:03.926182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:09:03.926804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:09:03.927125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:09:03.927536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:09:03.927959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:09:03.947177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:03.947682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:03.948131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:03.948905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:03.949367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:03.956004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.003997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:04.015827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Getting quotas for user b36da10548a54bc984b0191739d85dfd and project a67ab94b7e834f37a5dd3fd9efd438c3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:04.032354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:09:04.034939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:09:04.090302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b412e8c-81d8-4860-a267-2ceddf39d3ac tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.363870 Aug 24 02:09:04.091734 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2998/3990] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:09:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:09:04.107867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:04.109070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] [instance: cca68129-798e-4362-a844-07192034cbbc] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:04.122719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.123223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.123665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.124384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.124973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.125392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.153620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] HTTP exception thrown: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Request method failure captured: Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc HTTP/1.1 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYgxN0xaekg5r1n5mNc64rXwzdw3Y6r5i9EuaGXtC9wIv6gNLCJV4pEhEhIVd6zm2KjnS79VApYf9PO79jKmm3SuDz5kiI4_HBT3Y-lFRVomnwhYH9Boe_3s5r20OzMlzE2ehzVkqrewfi0uYyxx8-zmdx4qcn9ISIX3HCTk5c7wE1Y Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 3ffe8d72f3a04a3fac01828eb492248c Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAaction247Test-168431669 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3ffe8d72f3a04a3fac01828eb492248c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ffe8d72f3a04a3fac01828eb492248c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3ffe8d72f3a04a3fac01828eb492248c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3ffe8d72f3a04a3fac01828eb492248c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAaction247Test-168431669 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 3ffe8d72f3a04a3fac01828eb492248c Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAaction247Test-168431669 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAaction247Test-168431669-project Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: f60e03de8ff84468a692f2464eef2310 Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAaction247Test-168431669-project Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cca68129-798e-4362-a844-07192034cbbc'} Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:04.155341 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] Returning 404 to user: Instance cca68129-798e-4362-a844-07192034cbbc could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:04.159125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75bf33a6-ba27-47c3-848d-63545e8cf188 tempest-ServersAaction247Test-168431669 tempest-ServersAaction247Test-168431669-project] 10.222.0.49 "GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc" status: 404 len: 111 microversion: 2.47 time: 0.063874 Aug 24 02:09:04.164655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 2999/3991] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:09:04 2022] GET /compute/v2.1/servers/cca68129-798e-4362-a844-07192034cbbc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:09:04.717561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:04.718198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:04.732253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.732950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.733596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.734550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.735573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.738166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.803624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd8bc34d-f1c9-400c-b7c7-0364f49bdcd2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/ips" status: 200 len: 149 microversion: 2.1 time: 0.637638 Aug 24 02:09:04.804845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3000/3992] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:09:04 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/ips => generated 149 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:04.810846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:04.811790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:04.820312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.821796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.822576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:04.823555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:04.824278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:04.825761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:06.558446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:06.573110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2de2393b-d41a-42fe-8089-5ed53a012593 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 1.766952 Aug 24 02:09:06.573765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3001/3993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:04 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:06.598053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:06.600018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:06.623289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:06.625128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:06.627645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:06.630855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:06.635798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:06.638835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:07.087642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:07.098746 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2483793-bded-48f1-a8c0-76f6e09eeec3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1282 microversion: 2.1 time: 0.522535 Aug 24 02:09:07.101001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3002/3994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:06 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1282 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:07.594902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99948d3c-1ae3-4aa6-8db5-b59eba2294c9"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:07.598174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:07.615296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:07.616852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:07.617948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:07.619141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:07.619692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:07.620135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:08.103721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b650b9c-f52e-402b-9f57-3b4fde1f55d0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513281 Aug 24 02:09:08.104281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3003/3995] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:09:07 2022] POST /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 194 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:08.139488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:08.140388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:08.154839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:08.157750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:08.158395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:08.160043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:08.161377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:08.163363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:09.283742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:09.292908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bad4f337-289c-4495-9740-9a170a9ba97b tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 1.172610 Aug 24 02:09:09.306190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3004/3996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:08 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:09.311337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:09.322728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:09.346500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:09.353789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:09.357899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:09.358838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:09.359463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:09.360037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:09.630256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:09.643439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-218ef614-e493-4c8d-800a-97da6f142b92 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1282 microversion: 2.1 time: 0.335944 Aug 24 02:09:09.662013 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3005/3997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:09 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1282 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:10.327741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:10.329326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:10.346449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:10.347206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:10.347785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:10.348657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:10.350626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:10.351457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:11.024847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:11.039335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d4ce7cc-327c-4cd0-ac10-6a9e70b13358 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.709692 Aug 24 02:09:11.039997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3006/3998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:10 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:11.062374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:11.063036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:11.077819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:11.081321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:11.081938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:11.086051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:11.086700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:11.087294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:11.979858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:11.991830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a48613d-6e64-4c9c-8f63-3f77ffead592 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.936832 Aug 24 02:09:11.993703 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3007/3999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:11 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:12.061861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:12.062499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:12.074559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:12.075064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:12.075509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:12.076524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:12.077186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:12.079235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:13.431317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:13.462769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd451820-0f4b-4b10-854d-059971456d29 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 1.405018 Aug 24 02:09:13.476848 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3008/4000] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:12 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:13.491495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:13.494203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:13.518259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:13.518915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:13.519879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:13.523507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:13.524169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:13.528338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:13.982959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:14.026316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:14.473335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:14.489732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-376dd7c1-aae8-488c-8eca-87f12248ce74 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 1.011391 Aug 24 02:09:14.490652 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3009/4001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:13 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:14.756925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c956f05d-41cb-417f-a780-e20433b39e0f tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b911dfb80>, body: {"keypair": {"name": "tempest-keypair-1820573237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvqKE8PQqze46oxh/3vl+C6p1crqY2HRFQhbBNwRy1NkqeCSD4lGbKUqPrfftUGwOKyx0JZo5MkXHs4y1YC2nGpT225qcwS5HfFLJxNN6RYEkOEzOeO5hntfjxyAbhNIw=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:14.779200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c956f05d-41cb-417f-a780-e20433b39e0f tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:14.785494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c956f05d-41cb-417f-a780-e20433b39e0f tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:14.791277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:14.820284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c956f05d-41cb-417f-a780-e20433b39e0f tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.325969 Aug 24 02:09:14.821596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3010/4002] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:14.830461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:14.832696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:14.840257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:14.841327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:14.842112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:14.846152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:14.847651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:14.848236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:15.292496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:15.309630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-670e462c-f128-46cb-b78e-994a01bc23ea tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.485412 Aug 24 02:09:15.311476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3011/4003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:14 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:15.318218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f90c9e9d-988d-4f09-a1e9-4becb7776c25 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b924bad30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:15.332437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f90c9e9d-988d-4f09-a1e9-4becb7776c25 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1820573237" status: 200 len: 498 microversion: 2.1 time: 0.019706 Aug 24 02:09:15.333725 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3012/4004] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:09:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1820573237 => generated 498 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:15.344498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d37700d9-f0f4-4a09-9671-0cd2cf50c164", "tag": "86696b3f-0df8-40dc-a953-8c91c234d874"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:15.359420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:15.360961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:15.361598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:15.380263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] Creating event network-changed:86696b3f-0df8-40dc-a953-8c91c234d874 for instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 on n-h1-854121-3 Aug 24 02:09:15.387188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f6c18f68-9908-4c17-8af0-c1a2017dcd36 req-e9b882d6-92b5-4437-8721-a6824852597f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050592 Aug 24 02:09:15.388607 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3013/4005] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:15.396232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c300c77c-40df-4507-9a75-95e4f2c52737 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b911c8280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:15.422146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c300c77c-40df-4507-9a75-95e4f2c52737 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820573237" status: 202 len: 0 microversion: 2.1 time: 0.031954 Aug 24 02:09:15.423608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3014/4006] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:09:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1820573237 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:15.438006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23ca1d50-0fcb-4097-a322-5241afdc6b7e tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b916ab9d0>, body: {"keypair": {"name": "tempest-keypair-1653897748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFitBevWwTATJVIhw19/bo/fLVPDrRrYgruzwAP2E7G0hLsjusNTX+zV9F+qTq4TdCZAJ8mWLxrH1W8J01qtZ+EIJPss3XncAWV/CoKFG0rhEqbM2LgeEmFnxI8mRhDvoA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:15.485987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-23ca1d50-0fcb-4097-a322-5241afdc6b7e tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:15.494914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-23ca1d50-0fcb-4097-a322-5241afdc6b7e tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:15.566820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23ca1d50-0fcb-4097-a322-5241afdc6b7e tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133802 Aug 24 02:09:15.574023 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3015/4007] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:15.590120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:15.591268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:15.601346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:15.602077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:15.602697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:15.604406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:15.605854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:15.607656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:16.044219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:16.060955 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ba51f49-2ca4-4435-9c90-c7e38bfdfeb8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.482991 Aug 24 02:09:16.077323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3016/4008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:15 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:16.082848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25ac0a7e-f42f-4bf3-bd9e-1970d0bd4ba3 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b911d9d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:16.109893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25ac0a7e-f42f-4bf3-bd9e-1970d0bd4ba3 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653897748" status: 202 len: 0 microversion: 2.1 time: 0.033699 Aug 24 02:09:16.111354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3017/4009] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1653897748 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:16.123545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f6af795-087e-4082-88e4-0777f05be398 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b911df550>, body: {"keypair": {"name": "tempest-keypair-217576220", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:16.161824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4f6af795-087e-4082-88e4-0777f05be398 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:16.176004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4f6af795-087e-4082-88e4-0777f05be398 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:16.250509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f6af795-087e-4082-88e4-0777f05be398 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.132012 Aug 24 02:09:16.251626 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3018/4010] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:16 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:16.269850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50880305-a061-44d1-8e14-584a760daa2a tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b9167fd30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:16.304082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50880305-a061-44d1-8e14-584a760daa2a tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217576220" status: 202 len: 0 microversion: 2.1 time: 0.045804 Aug 24 02:09:16.305681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3019/4011] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217576220 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:16.321533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-557590dc-0858-4e43-91ab-1a8ed4bd0af6 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b911df700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1873869080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWmdNryZn62opJfpEcvgBj9HFaV98AwfG4eVmZ7PNWeqhREw6E8yIu1KZNGWg+HbOo97sutC+KqOSGCMqcayOq7ny1W8KFUuzprdz73UiezWcZsiV7SlQWA2UybKif2OQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:16.345300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-557590dc-0858-4e43-91ab-1a8ed4bd0af6 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:16.358412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-557590dc-0858-4e43-91ab-1a8ed4bd0af6 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:16.402385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-557590dc-0858-4e43-91ab-1a8ed4bd0af6 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.087209 Aug 24 02:09:16.411325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3020/4012] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:09:16.417141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:16.417756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:16.424851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:16.425346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:16.425782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:16.426645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:16.427364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:16.427668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:16.721889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:16.735752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-261f8af6-0626-4b96-8ad6-8eded818761d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.322384 Aug 24 02:09:16.744912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3021/4013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:16 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:16.756656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54e427d7-dba7-4f1f-8b63-03c1a954b752 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b916b6ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1656320192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZ+oWy2gJ/JuCuOiyVHgVWO4ilO452Tu8rl8zy7uUlPWXYvo5O1xSPDP92GYd+7pEiuPZKdyX0rAheF55hd51tMkF5XKJEVSrteYirCahT1Gg+R8u2ikZTy4RvpLGh+Ag=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:16.786786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-54e427d7-dba7-4f1f-8b63-03c1a954b752 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:16.794297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-54e427d7-dba7-4f1f-8b63-03c1a954b752 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:16.862783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54e427d7-dba7-4f1f-8b63-03c1a954b752 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.115688 Aug 24 02:09:16.863949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3022/4014] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:16.877539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1cc35a6-54b4-4d3d-95d4-a090e62231ba tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Action: 'create', calling method: .version_select at 0x7f6b911dfe50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1374826569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvIfQPyYFMqqfeuO9Bcsyu2YTaMkPi+M9IyaLNArou2/PYURamuVoEZ1hIUYcwAA+fflC+rp8SnAJSfCR8x8/SPIXDEGE1XVBmA6VouKRV2HMBNNnn0sFuFEeomUhKrgA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:16.924217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d1cc35a6-54b4-4d3d-95d4-a090e62231ba tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:16.946315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d1cc35a6-54b4-4d3d-95d4-a090e62231ba tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Getting quotas for user ca34366f9127492bbd3ce756c0b809ec and project fc901ab0ff364dc3bc6b1f1b8ae1697b. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:17.012634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1cc35a6-54b4-4d3d-95d4-a090e62231ba tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.139466 Aug 24 02:09:17.019498 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3023/4015] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:16 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:17.031666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45a0ff9e-0fd1-4419-bab5-7cb03e35ed3b tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b912321f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:17.039116 n-d-854121-3 devstack@n-api.service[128567]: WARNING oslo_db.sqlalchemy.utils [None req-45a0ff9e-0fd1-4419-bab5-7cb03e35ed3b tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 02:09:17.047565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45a0ff9e-0fd1-4419-bab5-7cb03e35ed3b tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.026691 Aug 24 02:09:17.048414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3024/4016] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:09:17 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:17.061363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-155a3eb5-bdbd-40fe-a5c1-7ef70e2edba5 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b911d9ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:17.087356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-155a3eb5-bdbd-40fe-a5c1-7ef70e2edba5 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1374826569" status: 202 len: 0 microversion: 2.1 time: 0.031237 Aug 24 02:09:17.087963 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3025/4017] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 02:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1374826569 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:09:17.104659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:17.107413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:17.123395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:17.124616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:17.125338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:17.126272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:17.126940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:17.127630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:17.792120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:17.796298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:17.806150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1789906f-c3eb-41b2-8d89-bcec06b4b81e tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.713135 Aug 24 02:09:17.812854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3026/4018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:17 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:17.824264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40b3b3bb-2ed0-47af-b8ce-d1368f63df24 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b9167f5e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:17.871859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40b3b3bb-2ed0-47af-b8ce-d1368f63df24 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1656320192" status: 202 len: 0 microversion: 2.1 time: 0.057584 Aug 24 02:09:17.872778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3027/4019] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 02:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1656320192 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:17.882859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:17.890737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:17.903924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:17.913941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:17.914171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:17.915576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:17.917791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:17.918278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:17.918714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:18.139385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:18.163576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45d8e118-7a78-4f77-bfa3-ebe138109e7d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.288802 Aug 24 02:09:18.164813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3028/4020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:17 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:18.181933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59d53855-1dba-43d3-a790-d81bb46e3ce8 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] Calling method '.version_select at 0x7f6b911c8550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:18.215120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59d53855-1dba-43d3-a790-d81bb46e3ce8 tempest-KeyPairsV2TestJSON-1840420135 tempest-KeyPairsV2TestJSON-1840420135-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873869080" status: 202 len: 0 microversion: 2.1 time: 0.049012 Aug 24 02:09:18.216539 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3029/4021] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 02:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1873869080 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:18.827690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:18.828859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:18.850286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:18.850850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:18.851486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:18.853900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:18.857480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:18.858051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:19.622238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:19.634097 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9ea0dac-24d0-46f5-ba07-9666f38a359f tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.809813 Aug 24 02:09:19.649938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3030/4022] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:18 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:19.662620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:19.663230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:19.670139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:19.670857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:19.671446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:19.672313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:19.672978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:19.675135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:20.334585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:20.343135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34a04317-ea4f-4165-9fbd-fe5d11b87e47 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.685237 Aug 24 02:09:20.347475 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3031/4023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:19 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:20.658612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:20.659294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:20.676455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:20.681651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:20.682875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:20.685962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:20.688257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:20.689460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:21.038273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:21.048704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-885d1d9e-1b49-42b8-9a0c-3df2cbc104b6 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.397422 Aug 24 02:09:21.049323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3032/4024] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:20 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:21.369795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:21.370431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:21.386652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:21.387209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:21.387587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:21.388531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:21.392211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:21.393751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:21.772209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:21.785884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83958919-64be-4c9e-8fa2-a197f6fb8dc7 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1511 microversion: 2.1 time: 0.420926 Aug 24 02:09:21.791516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3033/4025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:21 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:09:22.036887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1264078536", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:22.124561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] validate_networks() for [('8aae0130-bac9-4b3e-b7be-4aac9366943e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:09:22.810836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:09:22.812132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:09:22.812972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:09:22.813673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:09:22.814732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:09:22.838198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:22.838691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:22.839127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:22.839865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:22.840390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:22.840923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:22.901490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Getting quotas for project b2ea2738dc514d189bf2f7d3f4b674c6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:22.916413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Getting quotas for user 10799223b6654cecb8746dfb68c73455 and project b2ea2738dc514d189bf2f7d3f4b674c6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:22.941154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:09:22.943509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:09:23.006187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b50f5288-4b5b-4cbf-b96a-6e6e44e417c2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.212984 Aug 24 02:09:23.007767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3034/4026] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:09:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:09:23.013945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:23.014734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:23.024782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:23.025506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:23.026236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:23.027094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:23.027692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:23.028448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:23.298179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:23.310763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6123bfa-5117-4949-babb-eae012e716bf tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.301567 Aug 24 02:09:23.312327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3035/4027] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:23 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:23.320707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:23.327866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:23.337784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:23.338562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:23.341334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:23.346550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:23.347263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:23.348026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:23.600457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:23.613726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-475bea59-66f6-41d8-a2e7-ad54438962d4 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1488 microversion: 2.1 time: 0.300041 Aug 24 02:09:23.614324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3036/4028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:23 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1488 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:23.666821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac43ea1c-2b70-4223-bdae-328068ef73aa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:23.670882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac43ea1c-2b70-4223-bdae-328068ef73aa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:23.955256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac43ea1c-2b70-4223-bdae-328068ef73aa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:23.964211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac43ea1c-2b70-4223-bdae-328068ef73aa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1214 microversion: 2.1 time: 0.317087 Aug 24 02:09:23.967334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3037/4029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:23 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:24.154735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1852732360", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:24.334571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] validate_networks() for [('71989932-3b2c-4e9f-830f-d15a2c283fcf', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:09:26.352348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:09:26.353430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:09:26.354052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:09:26.354621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:09:26.355204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:09:26.369031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.372201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.372932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:26.374436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.378424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.380097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:26.428286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Getting quotas for project e24309b7b5e940dea727ee00bfb0b23e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:26.442729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Getting quotas for user b97371aa07664302b5e7e1a5c35d12af and project e24309b7b5e940dea727ee00bfb0b23e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:26.485626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:09:26.490057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:09:26.562040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0523638-f48e-4d23-9258-54cca0a67da7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.562203 Aug 24 02:09:26.563004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3038/4030] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:09:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:09:26.570036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-20883306"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:26.572956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:26.582143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.582933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.583473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:26.584317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.585454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.587049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:26.735089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7de040d9-77d0-4307-92f1-17a26dc1a425 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "PUT /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1059 microversion: 2.1 time: 0.170675 Aug 24 02:09:26.736863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3039/4031] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:09:26 2022] PUT /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1059 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:26.756299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:26.756299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:26.774267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.774750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.776675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:26.778533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:26.781060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:26.781662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.309376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:27.321225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0d4cc7b-486a-4535-8fad-9e8fd5c36629 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.583274 Aug 24 02:09:27.338631 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3040/4032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:26 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:27.343936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37700d9-f0f4-4a09-9671-0cd2cf50c164", "name": "network-vif-plugged", "status": "completed", "tag": "86696b3f-0df8-40dc-a953-8c91c234d874"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:27.355015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.356230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.356844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.371868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] Creating event network-vif-plugged:86696b3f-0df8-40dc-a953-8c91c234d874 for instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 on n-h1-854121-3 Aug 24 02:09:27.378950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3fe50da0-fa37-4120-badd-af5c811012fb req-14624cdb-8be7-48ce-9db1-8b1396460284 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038487 Aug 24 02:09:27.381772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3041/4033] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:27.400355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:27.401253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:27.410253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.411015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.411976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.412938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.415586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.416535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.679797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:27.689016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e50c7ab-52f1-4ca4-ae47-2c90367d2c34 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1272 microversion: 2.1 time: 0.305705 Aug 24 02:09:27.689623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3042/4034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:27 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1272 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:27.704978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99948d3c-1ae3-4aa6-8db5-b59eba2294c9"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:27.707470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:27.728319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.728847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.735268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.736262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.737078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.737688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.921065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments HTTP/1.1 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 74 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: {"volumeAttachment": {"volumeId": "99948d3c-1ae3-4aa6-8db5-b59eba2294c9"}} Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'c8d8e63f-0e90-41a9-8afa-b4252cce8606', 'body': {'volumeAttachment': {'volumeId': '99948d3c-1ae3-4aa6-8db5-b59eba2294c9'}}} Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:09:27.930256 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 Aug 24 02:09:27.934030 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:27.934824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 400 to user: Invalid volume: volume 99948d3c-1ae3-4aa6-8db5-b59eba2294c9 is already attached to instances: c8d8e63f-0e90-41a9-8afa-b4252cce8606 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:27.941296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6acccc5-3f58-405b-8f25-ed5223b5230d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.240657 Aug 24 02:09:27.945423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3043/4035] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:09:27 2022] POST /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 174 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:09:27.959398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:27.965720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:27.984166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.985290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.985900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:27.986848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:27.987461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:27.988558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:28.164692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:28.174697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-522f7aa6-1965-47cc-b88b-fe905bab7dfa tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1275 microversion: 2.1 time: 0.227503 Aug 24 02:09:28.175288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3044/4036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:27 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:28.192458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:28.193165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:28.208378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:28.209445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:28.209884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:28.210590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:28.211040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:28.211466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:28.820060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:28.832816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99dd6ab9-fdd8-4e66-90ef-ba3d3836d3e8 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1486 microversion: 2.1 time: 0.656434 Aug 24 02:09:28.836736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3045/4037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:28 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1486 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:28.857878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:28.865790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:28.874086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:28.874818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:28.875456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:28.876391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:28.877148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:28.877773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:29.011983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'services' on Instance uuid c8d8e63f-0e90-41a9-8afa-b4252cce8606 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:29.156455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b1dca99-0378-4ffe-a37f-d18fa19cd268 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments/99948d3c-1ae3-4aa6-8db5-b59eba2294c9" status: 202 len: 0 microversion: 2.1 time: 0.304592 Aug 24 02:09:29.157858 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3046/4038] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:09:28 2022] DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments/99948d3c-1ae3-4aa6-8db5-b59eba2294c9 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:29.189873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:29.192230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:29.212663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:29.214077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:29.214715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:29.217156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:29.219029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:29.224144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:29.270835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:29.595536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:29.605304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-612181f9-402c-412b-97f4-18e70cd17605 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1324 microversion: 2.1 time: 0.445951 Aug 24 02:09:29.605914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3047/4039] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:29 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:29.620154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:29.620497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:29.633110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:29.633612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:29.634051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:29.634767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:29.635222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:29.635647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:29.947303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:29.962135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d64e918f-3c36-4ed2-be82-974676f735cf tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.355078 Aug 24 02:09:29.981025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3048/4040] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:29 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:29.987345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:29.989127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:30.000120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.001442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.002218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:30.003779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.005137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.006393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:30.241890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:30.259273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b651c0c-78d4-486e-b856-561e7ce48891 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1486 microversion: 2.1 time: 0.270538 Aug 24 02:09:30.261814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3049/4041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:29 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:30.276128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:30.285305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:30.366601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f4edcc5-b74f-4d86-97f1-e921e6a3d971 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103381 Aug 24 02:09:30.372779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3050/4042] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:09:30 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:30.380638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:30.381500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:30.398913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.400527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.401221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:30.403269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:30.404876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:30.405799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:31.089244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:31.101766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90e90dfa-a4a3-4a7e-8083-5214efb07329 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.729275 Aug 24 02:09:31.102786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3051/4043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:30 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:31.113521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:31.116848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:31.131421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:31.133406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:31.134088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:31.137308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:31.140522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:31.141430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:31.218121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:09:31.545154 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3afcd160-edca-46b0-9c75-d5b081e26571 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 204 len: 0 microversion: 2.1 time: 0.437158 Aug 24 02:09:31.548069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3052/4044] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:31 2022] DELETE /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:09:31.565968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:31.570060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:31.580591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:31.581119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:31.581615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:31.582259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:31.582718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:31.583146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:32.845850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:32.869376 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56c5276d-5933-4e7f-9f2b-2af83a818075 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1521 microversion: 2.1 time: 1.308007 Aug 24 02:09:32.870887 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3053/4045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:31 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1521 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:32.883092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:32.885515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:32.903575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:32.905515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:32.907418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:32.909848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:32.911058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:32.912985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:33.449134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:33.463922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f488c10b-2ce2-4955-9856-58a6e5b6f8b0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.583519 Aug 24 02:09:33.464694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3054/4046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:32 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:33.476430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:33.482050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:33.497066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:33.498056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:33.498210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:33.499549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:33.501291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:33.501821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:33.582333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25a8362f-347f-4c82-86dd-bb6ed58692c8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114346 Aug 24 02:09:33.582570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3055/4047] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:09:33 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:33.594136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:33.597132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:33.612610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:33.613224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:33.613653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:33.614937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:33.619748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:33.620436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.070380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:34.079762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e4a0fe3-8669-46eb-a82a-353731d4105d tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1492 microversion: 2.1 time: 0.494587 Aug 24 02:09:34.084418 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3056/4048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:33 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1492 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:34.097264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:34.098227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:34.112440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:34.113165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:34.113788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.114845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:34.123282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:34.123971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.709246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:34.725187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1ec2e08-7653-4d8b-95a6-2fe8bbdf85fd tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.639356 Aug 24 02:09:34.726318 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3057/4049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:34 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:34.737419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9", "tag": "5333027d-661f-480e-b52e-85bbac69d2d0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:34.785285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:34.786304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:34.787381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.819455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] Creating event network-changed:5333027d-661f-480e-b52e-85bbac69d2d0 for instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 on n-h2-854121-3 Aug 24 02:09:34.832209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-86de77d2-920a-418f-af20-1901c4c857ee req-3427ec95-3a14-4c86-a750-34170d7359c5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104241 Aug 24 02:09:34.837691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3058/4050] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:34.850610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:34.852921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:34.865187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:34.867064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:34.867831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:34.868371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.869215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:34.870021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:34.870786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:34.922934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:09:35.047811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75246949-d69f-4d69-8da0-da0b26c055ba tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 204 len: 0 microversion: 2.1 time: 0.207587 Aug 24 02:09:35.048693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3059/4051] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:34 2022] DELETE /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:09:35.055317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:35.075584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.076201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.076490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.095522 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] Creating event network-changed:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:09:35.102796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-86517147-1ed2-46d4-b551-915fd51b800b req-5496ba65-30ff-4e0e-8ff5-3133c34bf2e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052554 Aug 24 02:09:35.104452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3060/4052] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:35.111990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:35.112862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:35.120284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.120811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.121255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.121954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.122405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.122826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.464678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:35.472004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:35.480046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a55ad92a-b1d1-4502-8a7d-4b1cf573fd62 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.371034 Aug 24 02:09:35.494095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3061/4053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:35 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:35.510596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:35.518596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:35.550024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.550218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.551586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.552475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.557239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.557946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.598224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6256e85-d173-4589-8929-22b964ef3d8d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100658 Aug 24 02:09:35.599190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3062/4054] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:09:35 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:35.613825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:35.614457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:35.627090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.627595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.628039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:35.628777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:35.629237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:35.629665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.153353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:36.171404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a903f15-e784-43ef-a105-4a15b6481f54 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1527 microversion: 2.1 time: 0.571106 Aug 24 02:09:36.172442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3063/4055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:35 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1527 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:36.185006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:36.186042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:36.209914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.213300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.214172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.215209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.215921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.216870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.362455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:36.377520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ac9f533-2771-4fab-8bd5-37369273caa9 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1450 microversion: 2.1 time: 0.203517 Aug 24 02:09:36.378419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3064/4056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:36 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1450 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:36.388784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:36.389437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:36.403653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:36.413192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.413728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.414181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.415371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.415834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.416269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.474809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=38 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:36.757924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:36.767437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9d61916-f517-40cf-b528-1a57b7e481f4 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.387744 Aug 24 02:09:36.767437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3065/4057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:36 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:36.792347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:36.793080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:36.809865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.811872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.812334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:36.813090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:36.813560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:36.813996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:37.556541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:37.574853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-208f3782-7152-46c0-b24e-e07cdf09b6fc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.795525 Aug 24 02:09:37.576656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3066/4058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:36 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:37.582673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:37.586638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:37.593394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:37.594823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:37.595510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:37.596554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:37.597259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:37.597940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:37.632710 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5dc6b807-c11c-4007-848a-450ed7f4f3cc tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053656 Aug 24 02:09:37.639419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3067/4059] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:09:37 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:09:37.645777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff4ac929-886c-4b41-95b7-42554cff9488", "name": "network-vif-deleted", "tag": "85f1db79-0925-470c-ab83-9466364c9cc3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:37.656636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:37.657498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:37.658140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:37.680825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] Creating event network-vif-deleted:85f1db79-0925-470c-ab83-9466364c9cc3 for instance ff4ac929-886c-4b41-95b7-42554cff9488 on n-h2-854121-3 Aug 24 02:09:37.685926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d84eba1f-9e51-4be7-b20a-c5f0bbdad999 req-4d319501-b4b6-4a9a-954e-ea1afca50886 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044952 Aug 24 02:09:37.687113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3068/4060] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:37.694223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:37.695527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:37.703995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:37.704741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:37.705345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:37.706179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:37.706786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:37.707310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.035993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:38.050475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6779a53f-e802-4abd-90f2-5b654e0563a9 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1527 microversion: 2.1 time: 0.362074 Aug 24 02:09:38.052906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3069/4061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:37 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1527 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:38.059857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:38.060643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:38.069267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.070588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.071199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.073529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.074566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.075173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.125759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.126551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.127164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.127902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lazy-loading 'fault' on Instance uuid ff4ac929-886c-4b41-95b7-42554cff9488 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:38.221661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:38.250930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea1ccc5a-f94e-46d4-82ba-9c68f68c9428 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 200 len: 1308 microversion: 2.1 time: 0.196679 Aug 24 02:09:38.257387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3070/4062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:38 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:38.261953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:38.262613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:38.272567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.273244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.273819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.274664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.275858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.276453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.331406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:09:38.514709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53945fc1-fe4e-4c78-bd1f-8dd99b6b2014 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 204 len: 0 microversion: 2.1 time: 0.256149 Aug 24 02:09:38.515929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3071/4063] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:38 2022] DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:09:38.522966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:38.523928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:38.531879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.532873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.533535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.534733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.535419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.536199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.845404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:38.860291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc6a9708-6fcc-425b-8eae-ea5a1087ec4a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.342707 Aug 24 02:09:38.861066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3072/4064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:38 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:38.882384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:38.887329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:38.912588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.913760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.913760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:38.918452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:38.919789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:38.920396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:39.590651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:39.603069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-092caebc-127f-4291-abc4-97a97f28ce06 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1681 microversion: 2.1 time: 0.732002 Aug 24 02:09:39.604299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3073/4065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:38 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1681 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:39.619417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:39.621154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:39.641011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:39.642365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:39.643414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:39.644438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:39.645177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:39.646635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:39.929300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:39.939302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2fc1022-a42a-4c5c-ab6d-4d6c1984443a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.333493 Aug 24 02:09:39.947032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3074/4066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:39 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:39.968035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:39.969757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:39.985234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:39.986466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:40.006699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:40.009704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:40.010460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:40.011717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:40.093747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:40.096948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:40.097973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:40.099336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lazy-loading 'fault' on Instance uuid d37700d9-f0f4-4a09-9671-0cd2cf50c164 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:40.186547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36da10548a54bc984b0191739d85dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a67ab94b7e834f37a5dd3fd9efd438c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:40.199533 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e13adbb8-dfab-45e7-aba3-2e0341da19d3 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 200 len: 1314 microversion: 2.1 time: 0.251020 Aug 24 02:09:40.200516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3075/4067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:39 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:40.211576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-641595402", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "615a352a-bcbc-4d8e-a7b6-fce9c9afeff3"}, {"uuid": "a15d5fdb-26a2-425c-bd5a-fd6be257811d"}, {"uuid": "615a352a-bcbc-4d8e-a7b6-fce9c9afeff3"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:40.359744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] validate_networks() for [('615a352a-bcbc-4d8e-a7b6-fce9c9afeff3', None, None, None, None, None), ('a15d5fdb-26a2-425c-bd5a-fd6be257811d', None, None, None, None, None), ('615a352a-bcbc-4d8e-a7b6-fce9c9afeff3', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:09:42.378551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:09:42.379110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:09:42.379717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:09:42.380268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:09:42.380824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:09:42.393145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.399208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.400367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.401586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.407186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.407929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.436993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Getting quotas for project 8d7b8be3aa804069a0a9c7dc149dec3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:42.445040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Getting quotas for user c67fbb100ca04eebbd3dd6bb40802561 and project 8d7b8be3aa804069a0a9c7dc149dec3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:42.460504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:09:42.463238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:09:42.576413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4a2598c-2509-4640-b329-3f278a3ee5d4 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.374218 Aug 24 02:09:42.580613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3076/4068] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:09:42.593581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:42.594452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:42.632417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.633018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.633479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.634213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.634685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.635230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.653661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 HTTP/1.1 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ff4ac929-886c-4b41-95b7-42554cff9488'} Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:42.655617 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:42.659217 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:42.660983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:42.662307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8925067e-3b8f-4e9f-84a0-0d6a8434e46f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 404 len: 111 microversion: 2.1 time: 0.080246 Aug 24 02:09:42.667534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3077/4069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:42 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:42.679626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d37700d9-f0f4-4a09-9671-0cd2cf50c164", "name": "network-vif-deleted", "tag": "86696b3f-0df8-40dc-a953-8c91c234d874"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:42.706956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.708498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.709335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.742433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:42.749252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] Creating event network-vif-deleted:86696b3f-0df8-40dc-a953-8c91c234d874 for instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 on n-h1-854121-3 Aug 24 02:09:42.765383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7b00f142-987c-42e2-af70-f5ffaf9e32fc req-9db0873e-939d-4cad-8d0a-d1ac0a9e8c84 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093489 Aug 24 02:09:42.767469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3078/4070] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:42.778075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:42.781527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:42.817972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.818716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.819887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:42.824894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:42.825885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:42.826697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.184757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:43.195168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a446480-e09c-4f81-a8e3-fb8bbd558b08 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.426197 Aug 24 02:09:43.196733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3079/4071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:42 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:43.201782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:43.202570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:43.222711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.225003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.226488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.228159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.230266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.235765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.315415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.317108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.321257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.322090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'fault' on Instance uuid c8d8e63f-0e90-41a9-8afa-b4252cce8606 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:43.415059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:43.425040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1f2c6a7-2634-4526-a3e8-f10ba4d322db tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 200 len: 1331 microversion: 2.1 time: 0.227036 Aug 24 02:09:43.437148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3080/4072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:43 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 1331 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:43.443318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:43.462480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:43.490346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.493633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.494279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.503341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.504233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.504896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.787829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:43.799264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c6b301f-3b95-40c5-a8f9-8d372b0bdbfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.366864 Aug 24 02:09:43.801386 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3081/4073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:43 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:43.813026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:43.813838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: d37700d9-f0f4-4a09-9671-0cd2cf50c164] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:43.828588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.829314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.829831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.830997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.831533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.832588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.850427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 HTTP/1.1 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd37700d9-f0f4-4a09-9671-0cd2cf50c164'} Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:43.852769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. Aug 24 02:09:43.857044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:43.864869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance d37700d9-f0f4-4a09-9671-0cd2cf50c164 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:43.866016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffcebcbb-4a30-4dff-95e9-049ec676fba2 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164" status: 404 len: 111 microversion: 2.1 time: 0.062977 Aug 24 02:09:43.868223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3082/4074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:43 2022] GET /compute/v2.1/servers/d37700d9-f0f4-4a09-9671-0cd2cf50c164 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:43.875386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9", "name": "network-vif-plugged", "status": "completed", "tag": "5333027d-661f-480e-b52e-85bbac69d2d0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:43.887139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:43.888155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:43.888850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:43.906794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] Creating event network-vif-plugged:5333027d-661f-480e-b52e-85bbac69d2d0 for instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 on n-h2-854121-3 Aug 24 02:09:43.934013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a312df99-688e-4d1a-bbee-5e865f5dc441 req-8426de82-9076-4776-a86b-38f1922eb686 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064144 Aug 24 02:09:43.936154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3083/4075] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:43.952382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:43.955482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:44.000359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.005160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.008854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:44.012296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.014071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.014547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:44.602509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:44.615226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a709e70-18da-4ea3-a008-ca93e515545d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1264 microversion: 2.1 time: 0.675359 Aug 24 02:09:44.629485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3084/4076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:43 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1264 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:44.635946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:44.636452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:44.645270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.646302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.646751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:44.647470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.648596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.649081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:44.690997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 HTTP/1.1 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ff4ac929-886c-4b41-95b7-42554cff9488'} Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:44.694388 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:44.698227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acc90ead-47bd-4506-94e1-3f903ae74296 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 404 len: 111 microversion: 2.1 time: 0.066285 Aug 24 02:09:44.703541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3085/4077] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:44 2022] DELETE /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:44.712702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf64436c-6d4d-4eb6-b7ca-15f042c55fce tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b91232e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:44.746067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bf64436c-6d4d-4eb6-b7ca-15f042c55fce tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Image not found. Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf64436c-6d4d-4eb6-b7ca-15f042c55fce tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea HTTP/1.1 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c012bc5c-f307-4803-9e1d-d5a5899503ea'} Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c012bc5c-f307-4803-9e1d-d5a5899503ea to delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c012bc5c-f307-4803-9e1d-d5a5899503ea could not be found. Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:44.748694 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:09:44.752213 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:44.756149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf64436c-6d4d-4eb6-b7ca-15f042c55fce tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:44.757318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf64436c-6d4d-4eb6-b7ca-15f042c55fce tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea" status: 404 len: 62 microversion: 2.1 time: 0.051679 Aug 24 02:09:44.758447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3086/4078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:44 2022] DELETE /compute/v2.1/images/c012bc5c-f307-4803-9e1d-d5a5899503ea => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:09:44.764143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:44.765160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:44.773455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.774282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.774970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:44.776010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:44.777444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:44.778118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.066820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:45.081137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f337f01-e4c3-4e7a-967d-632463a999d7 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.320863 Aug 24 02:09:45.082128 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3087/4079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:44 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:45.088513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.089628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.097455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.098362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.099182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.100181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.101315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.102015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.120167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 HTTP/1.1 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c8d8e63f-0e90-41a9-8afa-b4252cce8606'} Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.123235 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:09:45.126698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.130758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:45.132631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d820d057-f821-4818-b0dd-93e7787686a0 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 404 len: 111 microversion: 2.1 time: 0.047882 Aug 24 02:09:45.134836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3088/4080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:45 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:45.144450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.146907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: ff4ac929-886c-4b41-95b7-42554cff9488] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.156332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.157259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.157959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.159030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.160224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.160918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.177976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 HTTP/1.1 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ff4ac929-886c-4b41-95b7-42554cff9488'} Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.180285 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. Aug 24 02:09:45.184673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.186566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance ff4ac929-886c-4b41-95b7-42554cff9488 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:45.188191 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df5697ce-a317-4376-bf6c-e19332bab694 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488" status: 404 len: 111 microversion: 2.1 time: 0.051788 Aug 24 02:09:45.189348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3089/4081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:45 2022] GET /compute/v2.1/servers/ff4ac929-886c-4b41-95b7-42554cff9488 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:45.203744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.205658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.227251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.228702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.229554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.230743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.231445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.232107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.275111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 HTTP/1.1 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ee0947cf-0536-46f9-b5c3-adc51d0c9654'} Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:45.278837 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.282460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:45.284091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbd52726-c39e-46db-ae2c-04f612d785fd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 404 len: 111 microversion: 2.1 time: 0.093314 Aug 24 02:09:45.285344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3090/4082] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:45 2022] DELETE /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:45.293129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.294187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.300340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.300858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.301731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.303233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.304104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.304750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.586621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:45.594816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ea29dd0-7004-4c9d-a671-63b70b1d48a2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1314 microversion: 2.1 time: 0.307323 Aug 24 02:09:45.611403 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3091/4083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:45 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:45.611403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d8e63f-0e90-41a9-8afa-b4252cce8606", "name": "network-vif-deleted", "tag": "5788815c-e49d-430c-800d-9a9bb2faf1e6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:45.634546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.634546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.634546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.659251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] Creating event network-vif-deleted:5788815c-e49d-430c-800d-9a9bb2faf1e6 for instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 on n-h1-854121-3 Aug 24 02:09:45.673753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a917e279-6be7-43c1-8fd1-bb2d779242a6 req-9aab4113-74a3-4a9e-aaf4-c1442139419a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069592 Aug 24 02:09:45.675826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3092/4084] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:45.691570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f2f61c3-e413-46b3-8bad-da1356586937 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '.version_select at 0x7f6b91900ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.725178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:45.733719 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f2f61c3-e413-46b3-8bad-da1356586937 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267148490" status: 202 len: 0 microversion: 2.1 time: 0.055945 Aug 24 02:09:45.736818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3093/4085] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267148490 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:45.751360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.753254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.770059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.771492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.773835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.774683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.775202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.775739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.792654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 HTTP/1.1 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3aa5bd45-358d-4bbb-9d2f-264686839ec4'} Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:45.794504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:45.798607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9bb3ec6-85a9-4f9c-ad4b-1d49b41de1b5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 404 len: 111 microversion: 2.1 time: 0.054669 Aug 24 02:09:45.799779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3094/4086] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:45 2022] DELETE /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:45.808149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.808784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: ee0947cf-0536-46f9-b5c3-adc51d0c9654] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.816288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.816870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.818018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.818716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.819168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.819589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.840235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 HTTP/1.1 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ee0947cf-0536-46f9-b5c3-adc51d0c9654'} Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.842475 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance ee0947cf-0536-46f9-b5c3-adc51d0c9654 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3009c4da-fa76-45af-b4a5-a03bf7cac140 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654" status: 404 len: 111 microversion: 2.1 time: 0.043152 Aug 24 02:09:45.847131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3095/4087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:45 2022] GET /compute/v2.1/servers/ee0947cf-0536-46f9-b5c3-adc51d0c9654 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:45.850902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:45.851608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:45.860290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.860884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.861338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:45.863772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:45.864656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:45.865125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:46.323238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:46.346292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a160fadf-51e4-4158-a0d1-af0f244be17e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1312 microversion: 2.1 time: 0.497092 Aug 24 02:09:46.347348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3096/4088] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:45 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1312 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:46.355196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:46.363612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 3aa5bd45-358d-4bbb-9d2f-264686839ec4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:46.378021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:46.382383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:46.383118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:46.385627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:46.386288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:46.387456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:46.416420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 HTTP/1.1 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3aa5bd45-358d-4bbb-9d2f-264686839ec4'} Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:46.418378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 3aa5bd45-358d-4bbb-9d2f-264686839ec4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:46.422129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62ddea19-0055-4243-820e-f112049243c5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4" status: 404 len: 111 microversion: 2.1 time: 0.068859 Aug 24 02:09:46.424763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3097/4089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:46 2022] GET /compute/v2.1/servers/3aa5bd45-358d-4bbb-9d2f-264686839ec4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:46.429436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27fce132-ddb4-435d-a46d-f4311fd074a8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b91133550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:46.452834 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27fce132-ddb4-435d-a46d-f4311fd074a8 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716576232" status: 202 len: 0 microversion: 2.1 time: 0.026670 Aug 24 02:09:46.470108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3098/4090] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1716576232 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:09:46.480226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:46.480893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:46.490352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:46.491204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:46.491873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:46.492861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:46.493560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:46.494833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:47.217306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:47.234960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f7a8df1-6740-4e72-aa30-3823d33096ff tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.759733 Aug 24 02:09:47.238448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3099/4091] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:46 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:47.250392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "name": "network-vif-plugged", "status": "completed", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:47.261217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:47.262036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:47.262573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:47.274693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] Creating event network-vif-plugged:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:09:47.280218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d16de963-d652-4070-a629-31ef169280f9 req-625f52cd-3044-4277-bb3b-51ea6bdb3d31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038620 Aug 24 02:09:47.281346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3100/4092] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:47.699620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:47.700301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:47.720095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:47.720519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:47.729377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:47.730577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:47.731219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:47.732443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:47.768072 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e HTTP/1.1 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '946b0fc3-d438-495e-9557-52af7a5cfd7e'} Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:47.772236 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-503f2954-bc6a-44b4-b5fc-53f9076e4da6 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 404 len: 111 microversion: 2.1 time: 0.491150 Aug 24 02:09:47.775653 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3101/4093] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:47 2022] DELETE /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 111 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:47.779345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:47.779967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:47.793655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:47.794170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:47.797350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:47.797988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:47.798472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:47.798915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.199383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:48.208878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d8694ce-3996-4696-8415-263886f867e7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1500 microversion: 2.1 time: 0.432605 Aug 24 02:09:48.209464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3102/4094] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:47 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:48.214190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:48.218865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:48.239280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.240356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.241107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.242062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.242726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.243417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.529654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:48.550726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6435f54-c800-4b01-8081-70994913b6b6 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1333 microversion: 2.1 time: 0.339881 Aug 24 02:09:48.551479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3103/4095] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:48 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1333 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:48.561744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:48.562696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 946b0fc3-d438-495e-9557-52af7a5cfd7e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:48.575687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.576252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.576798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.577564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.578626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.579112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.596468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e HTTP/1.1 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '946b0fc3-d438-495e-9557-52af7a5cfd7e'} Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.606070 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. Aug 24 02:09:48.610347 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.611835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 946b0fc3-d438-495e-9557-52af7a5cfd7e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:48.613834 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b6ae1bd-e4bc-47c1-9052-05c7114c3c89 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e" status: 404 len: 111 microversion: 2.1 time: 0.058744 Aug 24 02:09:48.615537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3104/4096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:48 2022] GET /compute/v2.1/servers/946b0fc3-d438-495e-9557-52af7a5cfd7e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:48.621800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7e15e2b-11cf-4c86-be6e-45a450dd77f7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: .version_select at 0x7f6b91314310>, body: {"keypair": {"name": "tempest-keypair-1505522950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpRIrfrUXzx1vAR72byX0+Ma91Ift+y9gykGvWE51lRTQMGC+Beo+nVE9QKKHLv2WklbSRwUgk4LNpfB8RZH1w1S87N8eqbZDWS6SsJXOGIOactsa2EfYmNdOFm74mqog=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:48.650573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e7e15e2b-11cf-4c86-be6e-45a450dd77f7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:48.659920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e7e15e2b-11cf-4c86-be6e-45a450dd77f7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:48.702794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7e15e2b-11cf-4c86-be6e-45a450dd77f7 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085725 Aug 24 02:09:48.712505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3105/4097] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:09:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:48.720458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0aa73ec-08db-46cc-9174-3fc3d7b22e8d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '.version_select at 0x7f6b91160f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:48.750542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c0aa73ec-08db-46cc-9174-3fc3d7b22e8d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Image not found. Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0aa73ec-08db-46cc-9174-3fc3d7b22e8d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/images/a08dee5f-f775-4ffc-9a69-bb9a1d94939b HTTP/1.1 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: exception: Image not found. Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a08dee5f-f775-4ffc-9a69-bb9a1d94939b'} Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a08dee5f-f775-4ffc-9a69-bb9a1d94939b to delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a08dee5f-f775-4ffc-9a69-bb9a1d94939b could not be found. Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:48.752330 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0aa73ec-08db-46cc-9174-3fc3d7b22e8d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Image not found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:48.757156 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0aa73ec-08db-46cc-9174-3fc3d7b22e8d tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/images/a08dee5f-f775-4ffc-9a69-bb9a1d94939b" status: 404 len: 62 microversion: 2.1 time: 0.042966 Aug 24 02:09:48.765690 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3106/4098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:48 2022] DELETE /compute/v2.1/images/a08dee5f-f775-4ffc-9a69-bb9a1d94939b => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:09:48.774793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:48.787075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:48.800165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.802966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.803588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.804447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:48.808979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:48.809610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:48.866991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lazy-loading 'flavor' on Instance uuid 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:48.954794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:49.016699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68d6657d-118b-4478-8822-d60461680208 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "POST /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9/action" status: 200 len: 32 microversion: 2.1 time: 0.249391 Aug 24 02:09:49.026170 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3107/4099] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:09:48 2022] POST /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:09:49.050792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:49.053114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:49.085095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.085783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.086258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.088043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.088734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.089455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.490182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:49.506010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4f38df7-92be-4e0e-b8c0-7afebf56c4c0 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1323 microversion: 2.1 time: 0.477543 Aug 24 02:09:49.517097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3108/4100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:49 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:49.543751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:49.546793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:49.563919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.564763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.565545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.566619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.568947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.569617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.587333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de HTTP/1.1 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '33a0a35f-b094-48f2-83fe-1427ff9814de'} Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:49.589654 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:49.593114 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.595763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:49.597555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f30e0010-e036-4eb6-84ce-717ce183f2c1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 404 len: 111 microversion: 2.1 time: 0.079057 Aug 24 02:09:49.602368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3109/4101] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:49 2022] DELETE /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:49.609008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:49.609841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:49.619342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.620155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.620840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.621855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.622691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.623322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.656607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c HTTP/1.1 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c'} Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:49.658307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:49.662438 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:49.664398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:49.665316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e5f286f-9564-44a8-9990-557e7e4df8e0 tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 404 len: 111 microversion: 2.1 time: 0.061632 Aug 24 02:09:49.668119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3110/4102] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:49 2022] DELETE /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:49.679952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:49.680591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:49.696601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.697278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.697723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.698447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:49.698907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:49.699347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:49.998665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:50.024095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5a9bd02-6e85-4375-9084-92b6b82a80b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.354844 Aug 24 02:09:50.033695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3111/4103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:49 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:50.048827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:50.053012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:50.070833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.074058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.074541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.076140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.079141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.079660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.588768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:50.596600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3cb4e98-f12e-47b6-966a-9575b52247b7 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.562021 Aug 24 02:09:50.597217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3112/4104] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:50 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:50.605957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:50.606574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 33a0a35f-b094-48f2-83fe-1427ff9814de] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:50.625430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.626165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.626795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.634585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.635325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.635926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.659121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de HTTP/1.1 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '33a0a35f-b094-48f2-83fe-1427ff9814de'} Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.660690 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 33a0a35f-b094-48f2-83fe-1427ff9814de could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e52394ad-60ab-4cb1-8757-f5eadae51787 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de" status: 404 len: 111 microversion: 2.1 time: 0.060500 Aug 24 02:09:50.665678 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3113/4105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:50 2022] GET /compute/v2.1/servers/33a0a35f-b094-48f2-83fe-1427ff9814de => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:50.684115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:50.684795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] [instance: 5fb113c2-ee3c-4bf5-9e11-11ec0074560c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:50.701391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.702266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.703068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.705633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.706955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.707622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.732372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] HTTP exception thrown: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Request method failure captured: Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c HTTP/1.1 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYfgcPi7GR8ozzdTDIOwTlJWmq50ZV2A8Xgh4OIBjbWqY8lHaW3idArFwoWpZ4GClM3eZnurZXpjGKW3iLnEzq9Ew-Ijug73nQIQkh2CSfBlKjXuYvB8Z40V7XgmUsjlXkVbxZJCgjwqYg7BwJdJZ32HGuM7NHM5oHxS_m3D4xMQ2Nw Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a67ab94b7e834f37a5dd3fd9efd438c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a67ab94b7e834f37a5dd3fd9efd438c3 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-548097015 Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b36da10548a54bc984b0191739d85dfd Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-548097015-project Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '5fb113c2-ee3c-4bf5-9e11-11ec0074560c'} Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.734572 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. Aug 24 02:09:50.739422 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:50.742429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] Returning 404 to user: Instance 5fb113c2-ee3c-4bf5-9e11-11ec0074560c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:50.744273 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dad3c96-d0cb-4961-a581-95d6f4b7eddd tempest-ImagesOneServerNegativeTestJSON-548097015 tempest-ImagesOneServerNegativeTestJSON-548097015-project] 10.222.0.49 "GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c" status: 404 len: 111 microversion: 2.1 time: 0.063569 Aug 24 02:09:50.745505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3114/4106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:50 2022] GET /compute/v2.1/servers/5fb113c2-ee3c-4bf5-9e11-11ec0074560c => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:50.752663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:50.753648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:50.773850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.775036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.775967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:50.777301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:50.778360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:50.778976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.107214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:51.133637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df34789b-4dae-40f7-80b3-2185f179b167 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1518 microversion: 2.1 time: 0.386034 Aug 24 02:09:51.134246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3115/4107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:50 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:51.143876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:51.145027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:51.178344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.179133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.181382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.183799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.184480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.185290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.216258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 HTTP/1.1 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a1bee85f-a32b-4c24-950d-5565e17de841'} Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:51.225758 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.230050 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.242739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:51.243795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7be2d965-dbfb-4cf0-a5de-bbd164299eda tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 404 len: 111 microversion: 2.1 time: 0.106012 Aug 24 02:09:51.245379 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3116/4108] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:51 2022] DELETE /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:51.280561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "tag": "42938828-6a74-4f4c-b0a2-112391d5cf7b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:51.309247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.310005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.310638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.323352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] Creating event network-changed:42938828-6a74-4f4c-b0a2-112391d5cf7b for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:09:51.329096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1ef6874a-eac5-491d-8a03-3ffd5a444ccd req-d4b86d6b-b26d-434c-a753-01b6b9a6137b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082069 Aug 24 02:09:51.329786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3117/4109] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:51.335968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:51.336828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:51.343292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.344062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.344699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.345704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.346275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.347081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.732280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:51.746414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74e0e18a-6d94-463e-9f40-1121b92eba1c tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.414893 Aug 24 02:09:51.747389 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3118/4110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:51 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:51.752672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:51.755494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:51.765628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.766474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.767516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.768795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.769608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.770041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.799438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lazy-loading 'flavor' on Instance uuid df4657a3-a13d-4286-b0aa-c7cf877a9757 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:09:51.886215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fad8367-1817-48e5-b212-b45a628f4af1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action" status: 200 len: 32 microversion: 2.1 time: 0.136885 Aug 24 02:09:51.886851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3119/4111] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:09:51 2022] POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:09:51.895709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:51.897674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: a1bee85f-a32b-4c24-950d-5565e17de841] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:51.909865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.910421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.911437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.912150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.912613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.913317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.932388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 HTTP/1.1 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a1bee85f-a32b-4c24-950d-5565e17de841'} Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.934110 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. Aug 24 02:09:51.937911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:51.939357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance a1bee85f-a32b-4c24-950d-5565e17de841 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:51.940437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14d4bf78-3c49-4d24-b52b-1fd42bf2b7d5 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841" status: 404 len: 111 microversion: 2.1 time: 0.052114 Aug 24 02:09:51.941061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3120/4112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:51 2022] GET /compute/v2.1/servers/a1bee85f-a32b-4c24-950d-5565e17de841 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:51.959545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:51.960183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:51.966683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.967188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.967627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:51.968346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:51.969000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:51.969657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:52.423638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:52.536992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:52.550704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c884e643-8ed6-4758-b3b0-e892ddd915ad tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.607896 Aug 24 02:09:52.565334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3121/4113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:51 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:52.565334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:52.565334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:52.575029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:52.575524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:52.575960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:52.576666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:52.577157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:52.577651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:52.941422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:52.957228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81317407-3225-4b07-ba41-7ce1a014c0e8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.402651 Aug 24 02:09:52.959922 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3122/4114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:52 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:52.965360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:52.966132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:52.973074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:52.974883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:52.975555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:52.977011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:52.977666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:52.978279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:52.998802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 HTTP/1.1 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '20921901-2044-462f-b074-ef15308c7696'} Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:53.002395 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e192b86-fc2d-4944-980a-2f917fc32fc1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 404 len: 111 microversion: 2.1 time: 0.041082 Aug 24 02:09:53.007326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3123/4115] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:52 2022] DELETE /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:53.012859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:53.013551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:53.021380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.022242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.022956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.023913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.024747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.025531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.369359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:53.388452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c88ce72-03f1-41f2-bec2-2f46b8ec8882 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.381260 Aug 24 02:09:53.391334 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3124/4116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:53 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:53.403659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:53.405502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 20921901-2044-462f-b074-ef15308c7696] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:53.430825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.431334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.433994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.434735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.437314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.437849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.462257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 HTTP/1.1 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '20921901-2044-462f-b074-ef15308c7696'} Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.464459 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. Aug 24 02:09:53.467982 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.469915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 20921901-2044-462f-b074-ef15308c7696 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:53.471040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fdcfd4a0-767e-4ff6-aedd-f6a6c360b273 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696" status: 404 len: 111 microversion: 2.1 time: 0.077497 Aug 24 02:09:53.472212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3125/4117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:53 2022] GET /compute/v2.1/servers/20921901-2044-462f-b074-ef15308c7696 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:53.478065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "tag": "f80a3510-e407-41e8-8a4b-a55cd78dc5cc"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:53.488212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.489185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.489825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.506590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] Creating event network-changed:f80a3510-e407-41e8-8a4b-a55cd78dc5cc for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:09:53.520918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-186a18c8-f646-4f37-bb78-dfeb033ed20c req-e09b9fdd-ed55-4bb8-b821-3185a8931ebe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046263 Aug 24 02:09:53.522236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3126/4118] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:53.528863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:53.529661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:53.536745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.537588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.538777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.539886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.540554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.541250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.559471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f HTTP/1.1 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c67381bb-5bf9-4f3a-a19b-4be89be6974f'} Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:53.561767 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:53.565445 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:53.568734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:53.569779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d76a834-039c-4d04-a1be-b7dc2a1e669c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 404 len: 111 microversion: 2.1 time: 0.045959 Aug 24 02:09:53.570759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3127/4119] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:53 2022] DELETE /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:53.575895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:53.577852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:53.584237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.584817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.585340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:53.586112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:53.586672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:53.587165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:54.051186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:54.056770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:54.062383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90a52202-2b1c-49ea-9ddf-7a6ca7093373 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.490428 Aug 24 02:09:54.078121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3128/4120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:53 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:54.088397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:54.089054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: c67381bb-5bf9-4f3a-a19b-4be89be6974f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:54.118929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:54.119749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:54.120189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:54.121007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:54.121467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:54.121896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:54.149945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f HTTP/1.1 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c67381bb-5bf9-4f3a-a19b-4be89be6974f'} Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:54.151502 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance c67381bb-5bf9-4f3a-a19b-4be89be6974f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e090fd89-c1bd-4d82-880e-c0b8e8e86c6c tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f" status: 404 len: 111 microversion: 2.1 time: 0.072225 Aug 24 02:09:54.158860 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3129/4121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:54 2022] GET /compute/v2.1/servers/c67381bb-5bf9-4f3a-a19b-4be89be6974f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:09:54.162033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:54.162646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:54.168675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:54.169259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:54.169763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:54.170616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:54.171045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:54.171565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:54.552937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:54.562655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e04fbe2-bf43-4b43-aaf1-83eb31a07e72 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.404691 Aug 24 02:09:54.573339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3130/4122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:54 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:54.582347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1253087089", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "802f15e4-b690-4ef7-b7bc-f44a2f083514"}], "security_groups": [{"name": "tempest-securitygroup--1346981531"}], "key_name": "tempest-keypair-1505522950", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:54.777119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] validate_networks() for [('802f15e4-b690-4ef7-b7bc-f44a2f083514', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:09:55.679310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:09:55.681121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:09:55.682517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:09:55.683151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:09:55.684453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:09:55.706234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:55.709372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:55.712690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:55.714684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:55.716677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:55.717350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:55.756270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:55.766950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Getting quotas for user 0d0e3e1f15764a1ab1c97b02cf71a903 and project 9cf0544f17254646a4a598e097692f96. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:55.789920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:09:55.792295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:09:55.812423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:09:55.867030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab0df199-c1d6-4175-aa65-b9fec4cfc718 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.292395 Aug 24 02:09:55.868022 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3131/4123] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:09:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:09:55.872759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:55.873338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:55.890033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:55.890534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:55.890975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:55.891698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:55.892153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:55.892580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:55.974454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:09:56.173551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9b3f9b2-c5aa-4ebd-bf83-30ce6c71b8b3 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 204 len: 0 microversion: 2.1 time: 0.302676 Aug 24 02:09:56.177287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3132/4124] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:09:55 2022] DELETE /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:09:56.194563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:56.200978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:56.219824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.220539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.221628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:56.225329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.227352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.228539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:56.470920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:56.481423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7eb2879-8a60-4fb3-b517-2bdd2ba2b411 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.302587 Aug 24 02:09:56.482207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3133/4125] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:56 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:56.487573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:56.488574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:56.496190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.496898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.497495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:56.498450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.499100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.499820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:56.836626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:56.853481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-058d54ea-0183-474e-9e51-60432fc93e5b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.366529 Aug 24 02:09:56.853481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3134/4126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:56 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:56.862761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:56.863379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:56.899413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.899926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.900428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:56.901895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:56.901895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:56.902909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.189010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:57.199756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39818b6a-3f9f-4917-92ef-a11ab4c9f2ce tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.340773 Aug 24 02:09:57.200955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3135/4127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:56 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:57.206308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "tag": "1eca80c4-11ea-4108-befb-d5dcda62573d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:57.216999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.217569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.218063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.232494 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] Creating event network-changed:1eca80c4-11ea-4108-befb-d5dcda62573d for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:09:57.237886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-65b5a7e9-8369-4cac-a907-4809f956a5f1 req-3d07a7c4-ab64-4148-b2a2-630831dd891b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035084 Aug 24 02:09:57.238573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3136/4128] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:09:57.243731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:57.245845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:57.254147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.255397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.256038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.257001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.257695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.258318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.389368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:57.402476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0657da3-b318-4ed7-b1ce-117ca19d4ac8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1246 microversion: 2.1 time: 0.162467 Aug 24 02:09:57.417591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3137/4129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:57 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1246 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:57.429216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:57.430590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:57.444530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.445069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.445667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.446377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.447554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.447974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.863366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:57.873650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7152d2c1-17ff-4173-b711-b623f9a3e7d1 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1479 microversion: 2.1 time: 0.454455 Aug 24 02:09:57.890028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3138/4130] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:57 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1479 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:57.895824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:57.900455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:57.908064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.908566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.909163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:57.909911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:57.910605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:57.911706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:58.286372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:58.295498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e3192b8-5d8f-47aa-aedb-4b4b9f15953d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.403448 Aug 24 02:09:58.315721 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3139/4131] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:57 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:58.326657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:58.329814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:58.342828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:58.343577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:58.344611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:58.347260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:58.350037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:58.350649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:58.841083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:58.856503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb7da12f-e63c-4e44-8839-213d91444ee2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.538973 Aug 24 02:09:58.858786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3140/4132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:58 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:58.867986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:58.868596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:58.874934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:58.875484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:58.875854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:58.876820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:58.877274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:58.877696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.212408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:59.222006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-167ce259-e704-46b8-bbd7-8b47ca558466 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.362125 Aug 24 02:09:59.222722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3141/4133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:58 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:59.227555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:59.228394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:59.234786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.235567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.236213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.237491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.238527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.239492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.339031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:59.349083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-516ec6d6-83e7-44f9-a873-ad14cd5655d5 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1300 microversion: 2.1 time: 0.124912 Aug 24 02:09:59.349774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3142/4134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:59 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:59.354622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:59.355292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:59.361384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.362122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.362769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.363466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.365080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.365611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.474193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:59.485396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6aca8da3-d9f8-4f7e-ab88-020b2072a67e tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1437 microversion: 2.1 time: 0.134134 Aug 24 02:09:59.485940 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3143/4135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:59 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1437 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:59.628142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55b723e8-dca7-4c99-9166-1c43d42b5fd8 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b916ab8b0>, body: {"keypair": {"name": "tempest-keypair-1421529907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEA6J3nGycjFsvUi8ZVdt7Mh/aPCfSCGDOrPJ3LPCzc9VKMWUJJ1ymraJiUOLyVzQuxGAqxKSeRecR1maB26f11hAih2mOAwEVtO3vib/qXMlwGqzAuae33dDyMHN0rMsA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:59.647341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-55b723e8-dca7-4c99-9166-1c43d42b5fd8 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:09:59.652815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-55b723e8-dca7-4c99-9166-1c43d42b5fd8 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:09:59.679779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55b723e8-dca7-4c99-9166-1c43d42b5fd8 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.192203 Aug 24 02:09:59.680603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3144/4136] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:09:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:09:59.689874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:09:59.690699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:09:59.698455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.698815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.699328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.700044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.700666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.701197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:09:59.956062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:09:59.964422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ddb2303-6081-4cfe-8437-3114a58e2aca tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.278535 Aug 24 02:09:59.965712 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3145/4137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:09:59 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:09:59.988609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e04718e-0d60-4d8a-b96a-a96d01f84637", "name": "network-vif-deleted", "tag": "878afc8b-810d-4d43-8dcb-79518e066151"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:09:59.998873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:09:59.999279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:09:59.999708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.015537 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] Creating event network-vif-deleted:878afc8b-810d-4d43-8dcb-79518e066151 for instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 on n-h1-854121-3 Aug 24 02:10:00.021082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-221bc23c-22c7-40c9-8d8a-1f5ca0210526 req-0b6ce09c-da29-4299-8e5a-fe2ca9c87978 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040181 Aug 24 02:10:00.022033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3146/4138] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:00.027021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fb51c28-eb9f-456e-a4fa-f6e6d9292300 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b90e8b1f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:00.038209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fb51c28-eb9f-456e-a4fa-f6e6d9292300 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1421529907" status: 200 len: 513 microversion: 2.2 time: 0.014993 Aug 24 02:10:00.045387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3147/4139] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Aug 24 02:10:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1421529907 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:00.051038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:00.052701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:00.060989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.061638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.062220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.063152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.063772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.064342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.084939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:00.677202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:00.685124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0dc05a59-55f6-4557-88de-b3b8f7359f69 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.638710 Aug 24 02:10:00.685694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3148/4140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:00 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:00.690091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ab4f092-0315-4a85-81b9-f60d95d09d4e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b9125a5e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:00.713015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ab4f092-0315-4a85-81b9-f60d95d09d4e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421529907" status: 204 len: 0 microversion: 2.2 time: 0.026181 Aug 24 02:10:00.713604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3149/4141] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Aug 24 02:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1421529907 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:00.718529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:00.719197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:00.726077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.726558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.726994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.727682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.728131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.728554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.945790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:00.953926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6ba9d2f-759c-4992-a681-bc5610a3a816 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.239034 Aug 24 02:10:00.954558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3150/4142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:00 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:00.959683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:00.960288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:00.966274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.966762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.967232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:00.967929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:00.968385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:00.968837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.165331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:01.173074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b095af11-3a86-4082-ad81-34cc67b6f27a tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.217464 Aug 24 02:10:01.185004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3151/4143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:00 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:01.188593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:01.189420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:01.196338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.196790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.197235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.197931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.198390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.198817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.263884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4880d06f464d18aa1dbc51355f4ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdcb59fe8c664c16b4b64d8acb508f3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:01.272100 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09976f1f-b040-4a5e-9fa5-e0ae4295c577 tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 200 len: 1437 microversion: 2.1 time: 0.097456 Aug 24 02:10:01.272666 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3152/4144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:01 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:01.278685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f47c6f48-7137-445b-b4e4-a60cbf43928e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b9125aca0>, body: {"keypair": {"name": "tempest-keypair-1039668921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp5q1TcJl/0Iy5VKYiqwgdeDCCShQIsCrTDhnTNimHpfNS++3aIMbYAcoi8/4kIsQ88VAhqSipA9MWLCy9WKCqbe42NVIj/Hp5k6v9ZmQFuoO7QQTSHASX3JB5KWW0GYg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:01.318209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f47c6f48-7137-445b-b4e4-a60cbf43928e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:01.324278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f47c6f48-7137-445b-b4e4-a60cbf43928e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:01.349430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f47c6f48-7137-445b-b4e4-a60cbf43928e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.075392 Aug 24 02:10:01.350420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3153/4145] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:10:01.356671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:01.357519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:01.371787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.372343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.372869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.373838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.374348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.375116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.737587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:01.746278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf6092fe-cc61-44de-8aa2-9e76d82629ef tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.394792 Aug 24 02:10:01.747114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3154/4146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:01 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:01.751591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86dc00e5-eeb5-48dd-a6a0-a6227d8b338e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b9125a8b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:01.773965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86dc00e5-eeb5-48dd-a6a0-a6227d8b338e tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039668921" status: 204 len: 0 microversion: 2.2 time: 0.026018 Aug 24 02:10:01.780430 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3155/4147] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Aug 24 02:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039668921 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:01.780430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:01.780641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:01.788414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.788982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.789628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:01.791135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:01.791608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:01.792063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.164280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:02.177193 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2609c162-16c4-431a-adaf-c70096e801bd tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.400666 Aug 24 02:10:02.178024 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3156/4148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:01 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:02.184413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c64c14ba-ac85-4036-83ad-118682fdf3f7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b910755e0>, body: {"keypair": {"name": "tempest-keypair-1962086831", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:02.207600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c64c14ba-ac85-4036-83ad-118682fdf3f7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:02.214641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c64c14ba-ac85-4036-83ad-118682fdf3f7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:02.246315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c64c14ba-ac85-4036-83ad-118682fdf3f7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.065429 Aug 24 02:10:02.247355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3157/4149] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:02 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:10:02.256080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883f5bee-8c01-4701-9a3a-469c58e12b65", "tag": "41362601-3267-4941-8f8e-9c701c0f4535"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:02.267086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.267611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.268013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.278917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] Creating event network-changed:41362601-3267-4941-8f8e-9c701c0f4535 for instance 883f5bee-8c01-4701-9a3a-469c58e12b65 on n-h1-854121-3 Aug 24 02:10:02.283643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0b1322db-7064-4352-8200-fc3c62471c90 req-c0ab4e7a-103c-4287-ad3a-c73360679b48 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032981 Aug 24 02:10:02.284317 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3158/4150] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:02.291770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:02.292502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:02.298892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.299374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.299812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.300509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.300997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.301990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.605468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:02.621549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79d4324e-9f8a-41d5-8f2f-81b0c5aa98e9 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.336004 Aug 24 02:10:02.622143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3159/4151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:02 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:02.627938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:02.628665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:02.631667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:02.636841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.637700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.638138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.638844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.639294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.639767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.786773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:02.794860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca96d435-ff06-4da6-96ee-85202a8ae452 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.171679 Aug 24 02:10:02.795415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3160/4152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:02 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:02.802874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49cce225-e15e-45d2-8b1f-d5315f034d35 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b911c8280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:02.819446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49cce225-e15e-45d2-8b1f-d5315f034d35 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962086831" status: 204 len: 0 microversion: 2.2 time: 0.022945 Aug 24 02:10:02.820027 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3161/4153] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Aug 24 02:10:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1962086831 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:02.824759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:02.825435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] [instance: 4e04718e-0d60-4d8a-b96a-a96d01f84637] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:02.831571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.832053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.833046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.833769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.834216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.834636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.848641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] HTTP exception thrown: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Request method failure captured: Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 HTTP/1.1 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYc9x_E6xaCXBi2WUUp5woehsU1xhrR2l2CJAgvAdoYKgfWO6Jj3sa3NnLmydjjYYcgt3Qma6eL1_Tgc1UE0FRcQX3OKIFGzJvo5XD9jDFa_9neNXK8h6W2YiiY0nC6zaz5UKuhJnUKTa3Yl3DU5SRoauUoYX86cC_eTTcYMwSw8dn8 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestJSON-422475956 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_cdcb59fe8c664c16b4b64d8acb508f3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestJSON-422475956 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: cdcb59fe8c664c16b4b64d8acb508f3d Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestJSON-422475956 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestJSON-422475956-project Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7d4880d06f464d18aa1dbc51355f4ca9 Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestJSON-422475956-project Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4e04718e-0d60-4d8a-b96a-a96d01f84637'} Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:02.850353 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] Returning 404 to user: Instance 4e04718e-0d60-4d8a-b96a-a96d01f84637 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-061d5821-114e-463c-832b-44cea0dd231f tempest-ServersTestJSON-422475956 tempest-ServersTestJSON-422475956-project] 10.222.0.49 "GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637" status: 404 len: 111 microversion: 2.1 time: 0.030797 Aug 24 02:10:02.854674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3162/4154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:02 2022] GET /compute/v2.1/servers/4e04718e-0d60-4d8a-b96a-a96d01f84637 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:10:02.856814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:02.857417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:02.863444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.863983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.864380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:02.865096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:02.865543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:02.865971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:03.033103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:03.041404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b227f7c9-2e7c-426b-b633-30fdd6ae7823 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.188124 Aug 24 02:10:03.052996 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3163/4155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:02 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:03.052996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eed4be75-8723-4353-b969-ce7f55415f84 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b919003a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-581145308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8cx2j+bhU6NSbDWoRGzAZ6nEDH2jlEAya1TAcimy7tU3Re1j113zQctysl/tOdRVo7TEbdT6FLaCofN5bRI+ANL+KHv+a+frQzfoIe2vAkQE/u3yApchSDmvJii/YJag=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:03.072120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eed4be75-8723-4353-b969-ce7f55415f84 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:03.077463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-eed4be75-8723-4353-b969-ce7f55415f84 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:03.104122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eed4be75-8723-4353-b969-ce7f55415f84 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.061147 Aug 24 02:10:03.104866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3164/4156] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:10:03.121961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-413f0d3e-5e5c-420e-a71e-be8efce4a095 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b91160e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-444422481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1DxbscoVIhExNdrCvet+dpsPAZJF2CiAtLD4sBnKcVIF005uA1zJp2+2AlTHAZXJTsJKTdDpMOQwVVbWe6yBrbtDnETozpOgoXd1jEZi4SNFpyXu4AHtwvueVpuziJmA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:03.145729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-413f0d3e-5e5c-420e-a71e-be8efce4a095 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:03.151842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-413f0d3e-5e5c-420e-a71e-be8efce4a095 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:03.179046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-413f0d3e-5e5c-420e-a71e-be8efce4a095 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.061071 Aug 24 02:10:03.179949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3165/4157] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:10:03.192908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-371b832a-091d-4c17-bf72-58ebb0f8428b tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b91314dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-298299674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWqsjhXrb16lZwSOIpJElJhyNueojxx4JUZEGtGDXASFv8xVj5HTC7aSm2vciXkNbCoUFWXhfTuiAgW/Os0H4l51WXlHSU6J2JPF9cB4Np8ae4okWBrRp59LP0B8hJuYA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:03.209844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-371b832a-091d-4c17-bf72-58ebb0f8428b tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:03.215657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-371b832a-091d-4c17-bf72-58ebb0f8428b tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:03.252286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-371b832a-091d-4c17-bf72-58ebb0f8428b tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.063732 Aug 24 02:10:03.252932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3166/4158] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:03 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 24 02:10:03.258575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:03.259518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:03.265691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:03.266425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:03.266890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:03.267745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:03.268191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:03.268791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:03.611062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:03.619399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f209f7a-a43f-46c2-a273-8c2b55009b53 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.365141 Aug 24 02:10:03.632914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3167/4159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:03 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:03.632914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2be855d7-0435-441f-b43a-fbb0fe6b1a48 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b91760b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:03.632914 n-d-854121-3 devstack@n-api.service[128567]: WARNING oslo_db.sqlalchemy.utils [None req-2be855d7-0435-441f-b43a-fbb0fe6b1a48 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 02:10:03.634149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2be855d7-0435-441f-b43a-fbb0fe6b1a48 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.013206 Aug 24 02:10:03.634691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3168/4160] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Aug 24 02:10:03 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:03.644027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:03.644654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:03.650411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:03.650898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:03.651343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:03.652035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:03.652489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:03.652959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:04.004968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:04.021877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa33676d-452e-4a1c-b28c-8a1f575af140 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.381318 Aug 24 02:10:04.022815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3169/4161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:03 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:04.027626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-806d6d93-0a0a-4b68-af77-97466b05ced7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b910d2c10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:04.068381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-806d6d93-0a0a-4b68-af77-97466b05ced7 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-298299674" status: 204 len: 0 microversion: 2.2 time: 0.044249 Aug 24 02:10:04.069386 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3170/4162] 10.222.0.49 () {60 vars in 1318 bytes} [Wed Aug 24 02:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-298299674 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:04.074869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:04.075574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:04.082939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:04.083550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:04.084000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:04.084737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:04.085358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:04.085794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:04.726126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:04.735017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37f4a63b-e9a7-4485-bbb0-4bb96ec4212e tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.664671 Aug 24 02:10:04.736134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3171/4163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:04 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:04.740974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:04.741778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:04.753361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:04.753854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:04.754831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:04.755543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:04.756001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:04.756460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.084765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:05.095546 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-304b02db-2071-46e6-8e47-8568ee8d6706 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.358139 Aug 24 02:10:05.096231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3172/4164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:04 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:05.116733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cb07e2b-c778-4eeb-be1b-96409b5dd380 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b91075700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:05.144508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8cb07e2b-c778-4eeb-be1b-96409b5dd380 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-444422481" status: 204 len: 0 microversion: 2.2 time: 0.033622 Aug 24 02:10:05.146346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3173/4165] 10.222.0.49 () {60 vars in 1318 bytes} [Wed Aug 24 02:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-444422481 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:05.151905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:05.152707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:05.162289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.163013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.163520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.165001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.165464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.165893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.505480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:05.514798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4c0c9fc-21f2-4ef8-a593-dd386d8d8889 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.367145 Aug 24 02:10:05.515392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3174/4166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:05 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:05.523484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:05.529198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:05.535339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.536245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.536881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.537749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.538358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.538960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.741637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:05.817373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:05.829489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18633b34-99ff-4d32-ba41-7a32ae48bb75 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.310100 Aug 24 02:10:05.842673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3175/4167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:05 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:05.845990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b6ce6a8-42e6-4258-98e3-2129dc40c636 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b91160b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:05.880776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b6ce6a8-42e6-4258-98e3-2129dc40c636 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-581145308" status: 204 len: 0 microversion: 2.2 time: 0.048430 Aug 24 02:10:05.882190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3176/4168] 10.222.0.49 () {60 vars in 1318 bytes} [Wed Aug 24 02:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-581145308 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:05.897878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:05.898513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:05.910562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.911067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.917964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:05.918759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:05.919243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:05.919677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.213639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:06.221732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e20eeca-027e-45dd-8aff-5954b464a515 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.338530 Aug 24 02:10:06.222305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3177/4169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:05 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:06.230304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e521ed6e-0cea-48bd-bce1-4083857db3e9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b91132430>, body: {"keypair": {"name": "tempest-keypair-1388748783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTvov5UooC9fZSAvSJdtn+AbM8kYeGnhRtF8IEGhwboITnjhkdcYplr3u4gGPcoXBi9jyC6vpS+PcGIq7wmPqcXSR0VTO8ouU7a2q+J7d8SElrFHrVE4H9oUFbprqxf5Q=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:06.291185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e521ed6e-0cea-48bd-bce1-4083857db3e9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:06.298116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e521ed6e-0cea-48bd-bce1-4083857db3e9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:06.363643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e521ed6e-0cea-48bd-bce1-4083857db3e9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.136666 Aug 24 02:10:06.364990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3178/4170] 10.222.0.49 () {62 vars in 1199 bytes} [Wed Aug 24 02:10:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:10:06.379802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:06.380361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:06.405557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.406243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.406711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.407477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.407950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.408390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.444099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:06.650120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:06.659194 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa6d84e6-b3e6-4ec2-b170-589a64d84ab0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.293304 Aug 24 02:10:06.662091 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3179/4171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:06 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:06.667824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20863d82-1acf-4f45-8560-68cabc7286dc tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b90efa550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:06.679711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20863d82-1acf-4f45-8560-68cabc7286dc tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1388748783" status: 200 len: 513 microversion: 2.2 time: 0.016351 Aug 24 02:10:06.681826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3180/4172] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Aug 24 02:10:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1388748783 => generated 513 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:06.687107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:06.688090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:06.694598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.695301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.695863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.696886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.697592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.698251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.880874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:06.888940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b59c4182-da6a-4069-a46f-37314242120d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.205601 Aug 24 02:10:06.889725 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3181/4173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:06 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:06.903390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ef7e0ac-076b-4d45-80b5-d58b2bc65150 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b919005e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:06.910011 n-d-854121-3 devstack@n-api.service[128567]: WARNING oslo_db.sqlalchemy.utils [None req-6ef7e0ac-076b-4d45-80b5-d58b2bc65150 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 02:10:06.917145 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ef7e0ac-076b-4d45-80b5-d58b2bc65150 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.022019 Aug 24 02:10:06.923898 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3182/4174] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Aug 24 02:10:06 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:06.929042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:06.929662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:06.935863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.936365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.936822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:06.937712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:06.938179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:06.938610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:07.081064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:07.090053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-540e377a-6448-4dfb-9e21-383e7491f2e1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.164795 Aug 24 02:10:07.105274 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3183/4175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:06 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:07.112650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6ce0472-1128-4f5f-b68c-967f60226c27 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b919003a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.140079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6ce0472-1128-4f5f-b68c-967f60226c27 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388748783" status: 204 len: 0 microversion: 2.2 time: 0.033327 Aug 24 02:10:07.147535 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3184/4176] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Aug 24 02:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1388748783 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:07.152806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Action: 'create', calling method: .version_select at 0x7f6b90eb8040>, body: {"keypair": {"name": "tempest-keypair-1490406117", "type": "x509"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:07.161907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:07.182624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=45 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:07.188679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:07.195867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:07.221953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.processutils [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpk5y4m8c0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk5y4m8c0/temp.key -subj /CN=db6604dc60894089be88ee822a759095 -extensions v3_req_client {{(pid=128567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 02:10:07.485162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.processutils [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpk5y4m8c0/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpk5y4m8c0/temp.key -subj /CN=db6604dc60894089be88ee822a759095 -extensions v3_req_client" returned: 0 in 0.263s {{(pid=128567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 02:10:07.486609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.processutils [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpk5y4m8c0/temp.key -password pass: {{(pid=128567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 24 02:10:07.510456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.processutils [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpk5y4m8c0/temp.key -password pass:" returned: 0 in 0.023s {{(pid=128567) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 24 02:10:07.564391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:07.569895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Getting quotas for user db6604dc60894089be88ee822a759095 and project 1b6c6676c7ae477a9fd19bb2ac96d0db. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:07.587225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9932d0be-9d5f-45b9-80c4-7b4322ebbbe9 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.438310 Aug 24 02:10:07.593635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3185/4177] 10.222.0.49 () {62 vars in 1198 bytes} [Wed Aug 24 02:10:07 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:07.594297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.595004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:07.602334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:07.602866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:07.603320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:07.604184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:07.604653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:07.605171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:07.765347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:07.776990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03fa8929-57ff-4570-93b9-508a41b95838 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.187350 Aug 24 02:10:07.777587 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3186/4178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:07 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:07.782335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7db09200-c3fd-4fb8-9fa5-321198233d59 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b90eb8ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.792209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7db09200-c3fd-4fb8-9fa5-321198233d59 tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs/tempest-keypair-1490406117" status: 200 len: 1534 microversion: 2.2 time: 0.013392 Aug 24 02:10:07.793016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3187/4179] 10.222.0.49 () {60 vars in 1258 bytes} [Wed Aug 24 02:10:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1490406117 => generated 1534 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:07.802857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.803477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:07.810161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:07.810881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:07.811486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:07.812195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:07.812652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:07.813105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:07.958177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:07.968105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-839ffa6b-88c9-4610-b651-980668d42ab6 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.173305 Aug 24 02:10:07.969254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3188/4180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:07 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:07.975056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81607dd8-1a33-45c6-8a10-da4086ea936d tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b91160700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.979200 n-d-854121-3 devstack@n-api.service[128567]: WARNING oslo_db.sqlalchemy.utils [None req-81607dd8-1a33-45c6-8a10-da4086ea936d tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 24 02:10:07.985252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81607dd8-1a33-45c6-8a10-da4086ea936d tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014570 Aug 24 02:10:07.993077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3189/4181] 10.222.0.49 () {60 vars in 1177 bytes} [Wed Aug 24 02:10:07 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:07.998488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:07.999178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:08.005687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.006271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.006814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:08.007600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.008125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.008622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:08.165314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:08.174068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa50bad4-aef6-4fa3-a9a9-6f83952b368c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.179923 Aug 24 02:10:08.175103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3190/4182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:07 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:08.180910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9f2d4d0-f566-4a8c-ba35-9ca090dd7ece tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] Calling method '.version_select at 0x7f6b90e5bf70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:08.207139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9f2d4d0-f566-4a8c-ba35-9ca090dd7ece tempest-KeyPairsV22TestJSON-1751582724 tempest-KeyPairsV22TestJSON-1751582724-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490406117" status: 204 len: 0 microversion: 2.2 time: 0.030756 Aug 24 02:10:08.208581 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3191/4183] 10.222.0.49 () {60 vars in 1261 bytes} [Wed Aug 24 02:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490406117 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:08.218378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:08.219460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:08.228462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.229307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.229906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:08.230801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.231461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.232073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:08.448919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:08.460028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-615bec09-5d0a-4441-8398-035b2b553c82 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.246114 Aug 24 02:10:08.460861 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3192/4184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:08 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:08.799573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:08.800706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:08.810872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.811812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.814412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:08.825381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:08.826401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:08.827255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.058377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:09.067895 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cc92857-0754-4e2c-896a-e4f59bfbca1c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.272913 Aug 24 02:10:09.081583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3193/4185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:08 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:09.087763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:09.088394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:09.094384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.094878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.095343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.096044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.096500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.096965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.247009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:09.255053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57f442da-3e97-47e3-95e0-d08607309db7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.172139 Aug 24 02:10:09.262743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3194/4186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:09 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:09.262743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:09.262743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:09.273315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.274027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.274563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.275378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.276148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.276587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.897420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:09.913775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05976570-0198-4f75-bc39-1fe7d01943ab tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.654541 Aug 24 02:10:09.916061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3195/4187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:09 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:09.931114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:09.933435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:09.949260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.951482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.952332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:09.953984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:09.954796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:09.955388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.135453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:10.150423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0440fd9f-02e0-4908-8b90-c7274148912b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.231846 Aug 24 02:10:10.156066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3196/4188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:09 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:10.161630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-plugged", "status": "completed", "tag": "f80a3510-e407-41e8-8a4b-a55cd78dc5cc"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:10.183426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.184455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.185329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.199530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] Creating event network-vif-plugged:f80a3510-e407-41e8-8a4b-a55cd78dc5cc for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:10.206296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-24d0100a-bd7b-4b50-bcd8-71ace6f3b56b req-15df30b0-f4c4-4f48-8990-b767b52c32ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048793 Aug 24 02:10:10.208016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3197/4189] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:10.213764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:10.214628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:10.221776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.222486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.223731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.224665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.225581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.226226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.480081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:10.493110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06c16596-7fb6-47aa-856e-acc5859a722d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.283232 Aug 24 02:10:10.507337 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3198/4190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:10 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:10.518821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:10.519370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:10.547287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.547843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.548308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.549325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.549559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.550016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.839890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:10.852445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86924267-82eb-43e6-ae3a-637dcf4c710a tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.343900 Aug 24 02:10:10.860872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3199/4191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:10 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:10.940273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:10.942367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:10.949736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.950620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.951274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:10.952121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:10.952971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:10.954110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:11.152737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:11.162460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a55f0265-4494-4a95-8118-7dff7bb35b1e tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.228433 Aug 24 02:10:11.177912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3200/4192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:10 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:11.186102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:11.187373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:11.195279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:11.196005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:11.196850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:11.198306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:11.198992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:11.199640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:11.611117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:11.620601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba3555c9-ea09-4602-81b7-99c556433e2f tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.441309 Aug 24 02:10:11.649391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3201/4193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:11 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:11.663059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:11.664082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:11.681060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:11.682695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:11.683577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:11.684586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:11.685312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:11.686056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:12.025796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:12.040304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e5f12ec-31d6-4daa-bfa6-7477a1570d4c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.387648 Aug 24 02:10:12.044838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3202/4194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:11 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:12.548386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:12.549055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:12.559933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:12.560440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:12.563824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:12.564584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:12.565098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:12.565531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:12.601817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:10:12.605427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:12.741491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94d0c1ce-fdcb-4965-aaa8-dea13209f93f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 204 len: 0 microversion: 2.42 time: 0.694364 Aug 24 02:10:12.745924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3203/4195] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:10:12 2022] DELETE /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:10:12.753645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:12.755833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:12.764010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:12.764795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:12.765483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:12.766497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:12.767307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:12.767857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:13.356900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:13.365869 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96299a57-2224-480a-ba6a-813892ac25ea tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.618335 Aug 24 02:10:13.366800 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3204/4196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:12 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:13.371832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:13.372949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:13.390474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:13.391290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:13.391958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:13.392926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:13.393460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:13.393961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:13.698040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:13.707392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3970018-7a1d-4ffa-a3d0-24ccda23105f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.339187 Aug 24 02:10:13.708204 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3205/4197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:13 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:13.732264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-plugged", "status": "completed", "tag": "42938828-6a74-4f4c-b0a2-112391d5cf7b"}, {"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-plugged", "status": "completed", "tag": "1eca80c4-11ea-4108-befb-d5dcda62573d"}, {"server_uuid": "883f5bee-8c01-4701-9a3a-469c58e12b65", "name": "network-vif-plugged", "status": "completed", "tag": "41362601-3267-4941-8f8e-9c701c0f4535"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:13.744655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:13.745175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:13.745818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:13.768422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Creating event network-vif-plugged:42938828-6a74-4f4c-b0a2-112391d5cf7b for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:13.769259 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Creating event network-vif-plugged:1eca80c4-11ea-4108-befb-d5dcda62573d for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:13.771912 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] Creating event network-vif-plugged:41362601-3267-4941-8f8e-9c701c0f4535 for instance 883f5bee-8c01-4701-9a3a-469c58e12b65 on n-h1-854121-3 Aug 24 02:10:13.781357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3d597a23-418c-4d7f-836b-7ff1ccc593f0 req-7121b3b7-16be-4818-8239-d614c1a2f9ed service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069770 Aug 24 02:10:13.783194 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3206/4198] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:13.795513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:13.796323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:13.803887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:13.804604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:13.805944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:13.806933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:13.807618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:13.808271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:14.155829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:14.165124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b31b83e-1baa-4c37-bd48-9e2dac0a4eac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.380180 Aug 24 02:10:14.165942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3207/4199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:13 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:14.182907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:14.183873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:14.190627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:14.191122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:14.192128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:14.192889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:14.193373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:14.193791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:14.496843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:14.510055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:14.513014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:14.514939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-813af6db-483c-458a-8191-1c8d8e2c27e7 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2955 microversion: 2.42 time: 0.346774 Aug 24 02:10:14.515689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3208/4200] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:14 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2955 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:14.758421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-299367446", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:14.854106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:10:14.854539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:10:14.855770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:10:14.856182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:10:14.857549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:10:14.877601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:14.878464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:14.879074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:14.885388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:14.886348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:14.886990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:14.927396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Getting quotas for project 02bbbfacbc4646b4bae119b23ade398b. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:14.943254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Getting quotas for user c046a1e8ae694b55a7e427b19b2d7a75 and project 02bbbfacbc4646b4bae119b23ade398b. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:14.969030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:10:14.972346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:10:15.034039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55c83e60-eb50-4cad-8c38-bbbc7413bb8c tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.507083 Aug 24 02:10:15.040316 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3209/4201] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:10:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:10:15.045441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:15.046157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:15.052896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:15.053529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:15.054078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:15.054897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:15.055471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:15.056032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:15.730008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:15.741911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-707a445f-6663-442c-9b9d-49c89a4ef746 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.705495 Aug 24 02:10:15.742959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3210/4202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:15 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:15.754694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:15.755681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:15.785878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:15.787210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:15.787946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:15.797981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:15.798945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:15.799798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.089814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:16.101018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-782b7ebd-1142-4688-8376-d7000befb4fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.354541 Aug 24 02:10:16.114165 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3211/4203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:15 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:16.128337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:16.140131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:16.175669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.179407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.181354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.182308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.182783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.183217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.505998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:16.514882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc31811c-1649-4b9d-b5b9-4234ddf23068 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1354 microversion: 2.1 time: 0.390489 Aug 24 02:10:16.515938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3212/4204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:16 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1354 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:16.522484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:16.523358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:16.541381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.541977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.542418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.545021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.549044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.549665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.664416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:16.673900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:16.676292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:16.678094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-218e3e04-57cd-4b2f-b84d-a0c40bfa7c48 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1329 microversion: 2.57 time: 0.160703 Aug 24 02:10:16.679185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3213/4205] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:16 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1329 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:16.686230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:16.686868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:16.693389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:16.695013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.695862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.696492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.697495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:16.698143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:16.698730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:16.993457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:17.009760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4167ae3-d832-45aa-b420-8c5040a55bf5 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.329168 Aug 24 02:10:17.021575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3214/4206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:16 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:17.029496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:17.030408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:17.037906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.038604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.039196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:17.040061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.040668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.041551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:17.524154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:17.535654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:17.537514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:17.539023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01f37713-adc2-4cbd-8155-3c78c587df1d tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2955 microversion: 2.42 time: 0.516195 Aug 24 02:10:17.539755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3215/4207] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:17 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2955 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:17.544993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:17.546005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:17.552663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.553437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.556020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:17.556986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.557607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.558222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:17.883191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:17.896321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db792cae-f974-4b11-8361-ddaf8e36ab2c tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1368 microversion: 2.1 time: 0.354687 Aug 24 02:10:17.898454 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3216/4208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:17 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1368 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:17.912899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:17.921688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:17.944618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.945521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.946336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:17.947441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:17.948241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:17.948919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.263941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:18.274131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-278f1fc8-5e38-4f8e-89fc-c0a2f11670b4 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.365229 Aug 24 02:10:18.290162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3217/4209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:17 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:18.296577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:18.297437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:18.316859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.317593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.318491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.318836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.319292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.319727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.672575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:18.691648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af2ba091-8cbc-4a9a-a970-ee64d299a97b tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1804 microversion: 2.1 time: 0.399474 Aug 24 02:10:18.692469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3218/4210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:18 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1804 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:18.718819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:18.719456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:18.731979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.732875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.733503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.735196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.737128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.737919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.861299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:18.871351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:18.873178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:18.875433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fa5627b-51f4-4ff4-a5c6-9ab33ea0cee5 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1335 microversion: 2.57 time: 0.167522 Aug 24 02:10:18.876450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3219/4211] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:18 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:18.884563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "e5033fef-a564-47de-afca-e9f98457ee5f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:18.909269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.912957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.913701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.928811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:18.933495 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] Creating event network-vif-unplugged:e5033fef-a564-47de-afca-e9f98457ee5f for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:18.944331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b4fef114-38e4-4e46-b530-244f7dc592d9 req-0311da7a-1072-416d-981f-684668ff8511 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065292 Aug 24 02:10:18.947072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3220/4212] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:18.954882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:18.955807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:18.971799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.973245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.974562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:18.975683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:18.976452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:18.976995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.285616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:19.295963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aee057b7-c809-4281-82b3-84c8c6d8873a tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.345781 Aug 24 02:10:19.296799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3221/4213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:18 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:19.302711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:19.303638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:19.313070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.315256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.316088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.317684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.318498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.319237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.609428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:19.637832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:19.640072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:19.642247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-094be7d4-84a8-4e97-a493-525817a7a05f tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2955 microversion: 2.42 time: 0.344352 Aug 24 02:10:19.643399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3222/4214] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:19 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2955 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:19.651049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:19.651839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:19.659498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.660467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.661353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.662330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.663538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.664231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.689840 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4eb43014-e7f0-43cb-b59d-5e67c6b3aeaf tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2/ips" status: 200 len: 218 microversion: 2.1 time: 0.043443 Aug 24 02:10:19.690464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3223/4215] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:10:19 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2/ips => generated 218 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:19.703968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:19.705061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:19.714895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.715784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.716492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.717523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:19.719493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:19.720407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:19.981359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:19.990186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41717e46-c108-4b6d-9148-bdfd6d187642 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1558 microversion: 2.1 time: 0.298691 Aug 24 02:10:19.990784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3224/4216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:19 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1558 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:20.091165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Calling method '.version_select at 0x7f6b90eacc10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:20.137697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:10:20.139047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Neutron security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:10:20.140358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] HTTP exception thrown: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.140358 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Request method failure captured: Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f HTTP/1.1 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYiL2WUfAaBOrjptPMK_GXqKrRMugvZ6SeMCrXntjraDR8Eof45iSJwAboYafKmxs6w9r31VK_n48OIrDwODIvActNw8RNUjF5g5ZjkAP5wn7fXHUMnDuPHCjXqs3dX3PxlYt2SA03euM7eFsLrwaLDSmoOIeOcVeez5z2M4hOFUtsQ Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1a1eefcd1e5a4275af3068aa8ac43696 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f'} Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:10:20.142707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Returning 404 to user: Security group ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f does not exist Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-b7497427-e262-483b-8495-3d79c2568327'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6723a046-2847-4868-be4d-13f2044a4e3f tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f" status: 404 len: 194 microversion: 2.1 time: 0.139299 Aug 24 02:10:20.146919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3225/4217] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:10:19 2022] DELETE /compute/v2.1/os-security-groups/ff07a3f6-c4fb-4077-a3f1-3cb27aa9695f => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:10:20.156326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:20.157164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:20.166094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:20.167480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:20.168127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:20.168913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:20.169505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:20.169944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:20.910994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:20.930097 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80bb5fe1-7bcb-4086-9cb0-5662d98cc6fe tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1506 microversion: 2.1 time: 0.783998 Aug 24 02:10:20.930682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3226/4218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:20 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1506 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:20.936519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:20.936933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:20.949619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:20.950354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:20.950945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:20.951858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:20.952468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:20.953271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:20.982951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:10:21.123162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8c7ac1d-63bb-43ff-bf40-42fc9f0126c5 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 204 len: 0 microversion: 2.1 time: 0.190371 Aug 24 02:10:21.123792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3227/4219] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:10:20 2022] DELETE /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:21.132846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:21.133659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:21.141490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.141989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.142433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.143147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.143608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.144036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.220731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:21.230013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:21.231517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:21.232661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a9b3a34-7e6b-49df-80cc-87b0bff68e93 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1335 microversion: 2.57 time: 0.107780 Aug 24 02:10:21.249362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3228/4220] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:21 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:21.258599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:21.260026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:21.267331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.267916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.268433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.269276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.269884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.270799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.436078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cee2c82d-101d-4bd3-980c-93516c685377 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184633 Aug 24 02:10:21.436919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3229/4221] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:10:21 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:21.441700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24a46df7-22f3-490b-af57-78af0d04ae79 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003745 Aug 24 02:10:21.442221 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3230/4222] 10.222.0.49 () {58 vars in 1164 bytes} [Wed Aug 24 02:10:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 02:10:21.452332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:21.453180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:21.469338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.469905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.470541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.471449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.472026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.472510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.922174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:21.932200 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3768584c-7cb7-451a-9558-f62085575074 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.488872 Aug 24 02:10:21.933534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3231/4223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:21 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:21.942111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:21.943094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:21.952281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.952826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.953274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:21.954273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:21.954735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:21.955167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:22.357580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:22.369945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:22.371477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:22.379987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5998833-731f-4bcf-807d-41e1c7e8b260 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 2821 microversion: 2.42 time: 0.435865 Aug 24 02:10:22.380654 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3232/4224] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:21 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 2821 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:22.387872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-deleted", "tag": "2bf1c21f-a29e-41ab-a631-6dff684ae532"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:22.423821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:22.424335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:22.424811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:22.451270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] Creating event network-vif-deleted:2bf1c21f-a29e-41ab-a631-6dff684ae532 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.463530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9605bfa4-cfca-4ca2-a564-20d1f77c92f9 req-6491ac96-f549-4b91-9cb2-913303639911 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081389 Aug 24 02:10:22.468335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3233/4225] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:22.486888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "f6e64947-7833-44b6-9b87-8bbfcd12fd50"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "143cc44b-46f2-443b-a1db-394f635ebbca"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "cae35217-a025-43a3-80a2-d1bc17a9ad49"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf1c21f-a29e-41ab-a631-6dff684ae532"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-unplugged", "status": "completed", "tag": "992a88a2-6fc6-40a0-b337-eabd50ecd258"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:22.498272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:22.498779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:22.499223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:22.512408 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Creating event network-vif-unplugged:f6e64947-7833-44b6-9b87-8bbfcd12fd50 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.512964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Creating event network-vif-unplugged:143cc44b-46f2-443b-a1db-394f635ebbca for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.514545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Creating event network-vif-unplugged:cae35217-a025-43a3-80a2-d1bc17a9ad49 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.514832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Creating event network-vif-unplugged:2bf1c21f-a29e-41ab-a631-6dff684ae532 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.515341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] Creating event network-vif-unplugged:992a88a2-6fc6-40a0-b337-eabd50ecd258 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:22.528029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5c40c711-971f-4af2-ab34-794436a13e7c req-afbfa00e-41e4-4404-b7fc-b6b64ce4730e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.057169 Aug 24 02:10:22.530313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3234/4226] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:22.540218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:22.541150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:22.551434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:22.551642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:22.551962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:22.552819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:22.553240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:22.553783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:23.307179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:23.318915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2a52baf-ba84-4c09-b058-bbbc4149a1db tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1810 microversion: 2.1 time: 0.786765 Aug 24 02:10:23.320074 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3235/4227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:22 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1810 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:23.325864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3ef3ce8-9221-46d8-b896-816b94c59454 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Calling method '.version_select at 0x7f6b90eacc10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:24.235787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3ef3ce8-9221-46d8-b896-816b94c59454 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.914345 Aug 24 02:10:24.244639 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3236/4228] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:10:23 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:24.244639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:24.244639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:24.258041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.261885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.262496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.264673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.265954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.270084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.634158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:24.644453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a67ac55d-7d0f-42b0-835e-77ca80c09971 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1486 microversion: 2.1 time: 0.406440 Aug 24 02:10:24.662325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3237/4229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:24 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1486 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:24.667538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:24.668151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:24.677406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.678185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.678783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.679654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.680271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.680887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.778494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:24.793253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:24.797613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:24.801338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-daefd6d9-319a-4835-aaa4-a2b72fa6ff62 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1356 microversion: 2.57 time: 0.137371 Aug 24 02:10:24.802578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3238/4230] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:24 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1356 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:24.808292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:24.809146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:24.816574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.817560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.818327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.819198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:24.819859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:24.820296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:24.901789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:24.962287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=13 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:25.369480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:25.385694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f2cd695-6d9b-44ad-b15b-a8a14013c5bb tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1524 microversion: 2.1 time: 0.581761 Aug 24 02:10:25.386292 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3239/4231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:24 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1524 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:25.395021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:25.395898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:25.420327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:25.421546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:25.422669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:25.423572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:25.424185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:25.424948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:25.831172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:25.839631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:25.851635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:25.854044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:25.856127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5962182c-4bc2-407f-950b-864d0180d76b tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.468634 Aug 24 02:10:25.897425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3240/4232] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:25 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:25.911063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Calling method '.version_select at 0x7f6b910d2820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:26.360080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:10:26.361735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 24 02:10:26.361735 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Request method failure captured: Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-security-groups/1b599f95-35a0-4b50-83dc-6e1aaf543e9e HTTP/1.1 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYiL2WUfAaBOrjptPMK_GXqKrRMugvZ6SeMCrXntjraDR8Eof45iSJwAboYafKmxs6w9r31VK_n48OIrDwODIvActNw8RNUjF5g5ZjkAP5wn7fXHUMnDuPHCjXqs3dX3PxlYt2SA03euM7eFsLrwaLDSmoOIeOcVeez5z2M4hOFUtsQ Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1a1eefcd1e5a4275af3068aa8ac43696 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: exception: Insufficient rights for removing default security group. Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1b599f95-35a0-4b50-83dc-6e1aaf543e9e'} Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:10:26.364995 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] Aug 24 02:10:26.369210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:26.373323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 24 02:10:26.373323 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8a12dc81-86fa-4bc8-8331-927a86fa6585'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:26.374241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d5dc8fc-f4b7-40b1-b979-7743c3ea04db tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/1b599f95-35a0-4b50-83dc-6e1aaf543e9e" status: 400 len: 182 microversion: 2.1 time: 0.469677 Aug 24 02:10:26.390192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3241/4233] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:10:25 2022] DELETE /compute/v2.1/os-security-groups/1b599f95-35a0-4b50-83dc-6e1aaf543e9e => generated 182 bytes in 492 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:10:26.395722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:26.396901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:26.408915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:26.413108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:26.413919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:26.415451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:26.416084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:26.417241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:26.912657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:26.926561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d14fbded-88d6-4033-abb4-1225edf00ee3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 200 len: 1768 microversion: 2.1 time: 0.534312 Aug 24 02:10:26.951770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3242/4234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:26 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 1768 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:26.958300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-deleted", "tag": "cae35217-a025-43a3-80a2-d1bc17a9ad49"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-deleted", "tag": "992a88a2-6fc6-40a0-b337-eabd50ecd258"}, {"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-deleted", "tag": "e5033fef-a564-47de-afca-e9f98457ee5f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:26.993711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:26.994204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:26.997110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.036084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Creating event network-vif-deleted:cae35217-a025-43a3-80a2-d1bc17a9ad49 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:27.037045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Creating event network-vif-deleted:992a88a2-6fc6-40a0-b337-eabd50ecd258 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:27.037882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] Creating event network-vif-deleted:e5033fef-a564-47de-afca-e9f98457ee5f for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:27.044434 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c540bfe9-37af-44ac-9f8b-bcdb8bcbe68b req-8fe51f1c-dc3d-496e-b2fe-a004a0353579 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.091290 Aug 24 02:10:27.045453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3243/4235] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:27.053343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1184006038", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:27.117368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] validate_networks() for [('8aae0130-bac9-4b3e-b7be-4aac9366943e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:10:27.571201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:10:27.571636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:10:27.572116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:10:27.572530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:10:27.573291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:10:27.583216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.583754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.584334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.585116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.585574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.586175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.604874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Getting quotas for project b2ea2738dc514d189bf2f7d3f4b674c6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:27.611028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Getting quotas for user 10799223b6654cecb8746dfb68c73455 and project b2ea2738dc514d189bf2f7d3f4b674c6. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:27.624520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:10:27.627435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:10:27.680183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc6b31ac-299a-4897-af13-1803cc47af61 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.633249 Aug 24 02:10:27.681117 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3244/4236] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:10:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:10:27.686406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:27.689596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:27.699857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.700619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.701249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.702357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.702967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.703814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.810627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:10:27.811630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:10:27.812299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:10:27.812900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:10:27.813528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:10:27.895064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:27.902453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.902889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.903314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.904016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.904484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.904928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.941679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-100019c3-6935-4cea-bd68-02eb3a3cd82f tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "POST /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022/action" status: 202 len: 1137 microversion: 2.57 time: 0.258846 Aug 24 02:10:27.953488 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3245/4237] 10.222.0.49 () {62 vars in 1320 bytes} [Wed Aug 24 02:10:27 2022] POST /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022/action => generated 1137 bytes in 271 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 02:10:27.962702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-deleted", "tag": "1eca80c4-11ea-4108-befb-d5dcda62573d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:27.974731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:27.975304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:27.976150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:27.991039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] Creating event network-vif-deleted:1eca80c4-11ea-4108-befb-d5dcda62573d for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:27.997841 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-393f0eee-6106-418c-9b00-07652c86e6f3 req-b19945f4-0c4f-4d44-b4c6-cb02bd7d7eee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042589 Aug 24 02:10:27.999120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3246/4238] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:28.007055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Calling method '.version_select at 0x7f6b910d2ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.094215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:10:28.094879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Neutron security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:10:28.095414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] HTTP exception thrown: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.095414 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Request method failure captured: Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-security-groups/4f6616ea-6060-4ae4-af43-003fc35ffe92 HTTP/1.1 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYiL2WUfAaBOrjptPMK_GXqKrRMugvZ6SeMCrXntjraDR8Eof45iSJwAboYafKmxs6w9r31VK_n48OIrDwODIvActNw8RNUjF5g5ZjkAP5wn7fXHUMnDuPHCjXqs3dX3PxlYt2SA03euM7eFsLrwaLDSmoOIeOcVeez5z2M4hOFUtsQ Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1a1eefcd1e5a4275af3068aa8ac43696 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4f6616ea-6060-4ae4-af43-003fc35ffe92'} Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:10:28.098603 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Returning 404 to user: Security group 4f6616ea-6060-4ae4-af43-003fc35ffe92 does not exist Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-24f5c6ab-90d1-485d-a23d-4b185d4a1615'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cde98f8-9109-40d5-b2d1-eda4feb0f3f2 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "GET /compute/v2.1/os-security-groups/4f6616ea-6060-4ae4-af43-003fc35ffe92" status: 404 len: 194 microversion: 2.1 time: 0.099552 Aug 24 02:10:28.107789 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3247/4239] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:10:27 2022] GET /compute/v2.1/os-security-groups/4f6616ea-6060-4ae4-af43-003fc35ffe92 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:10:28.113912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.116590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:28.137346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.137346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.137811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.139011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.139422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.139870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.370605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.381043 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89628d15-3354-4070-b925-0a2a7a944636 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1504 microversion: 2.1 time: 0.278760 Aug 24 02:10:28.381916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3248/4240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:28 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:28.386431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-unplugged", "status": "completed", "tag": "42938828-6a74-4f4c-b0a2-112391d5cf7b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:28.398284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.398753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.399239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.412906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] Creating event network-vif-unplugged:42938828-6a74-4f4c-b0a2-112391d5cf7b for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:28.418557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-caa8b31d-cf94-48b3-9484-9265ede4f685 req-9ef972a2-1a5f-4d1a-9827-f6e6d845e46a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035305 Aug 24 02:10:28.419331 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3249/4241] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:28.428469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.429367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:28.436359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.437331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.437918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.438764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.439354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.440034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.518822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.529771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.531492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.532900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52ff30b0-bdb4-467c-8c18-3e907498e375 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.109440 Aug 24 02:10:28.549025 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3250/4242] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:28 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:28.560245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.560930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:28.567635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.568137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.568580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.569839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.570455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.571045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.642574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.651435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6758aea-1c3f-4746-a1b0-85a58e764c08 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1218 microversion: 2.1 time: 0.101310 Aug 24 02:10:28.652007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3251/4243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:28 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:28.656879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.657646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:28.663471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.664210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.668888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.669840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.670516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.671934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.692354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 HTTP/1.1 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9f51889a-a5ac-4eed-905a-e61e715714f2'} Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.694998 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:10:28.699172 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.699891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:28.701057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09657ef1-b3ba-435e-bbba-01e89c9688ec tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 404 len: 111 microversion: 2.1 time: 0.047747 Aug 24 02:10:28.704862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3252/4244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:28 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:10:28.714805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:28.720483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:28.734120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.736031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.736775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.738469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:28.738950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:28.739484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:28.865647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.879992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.884162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:28.887384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4cb90c8-43d1-44c4-ba14-5193db888ac7 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.181344 Aug 24 02:10:28.888486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3253/4245] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:28 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:28.894790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Action: 'update', calling method: .version_select at 0x7f6b91578790>, body: {"security_group": {"name": "tempest-sg-847648257", "description": "tempest-description-1667733807"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:28.926311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG neutronclient.v2_0.client [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist", "detail": ""}} {{(pid=128567) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 24 02:10:28.927294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.security_group_api [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Neutron security group b8b11666-a4de-4c01-b85d-cf03618b9214 not found {{(pid=128567) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 24 02:10:28.928155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] HTTP exception thrown: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.928155 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Request method failure captured: Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/os-security-groups/b8b11666-a4de-4c01-b85d-cf03618b9214 HTTP/1.1 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 101 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYiL2WUfAaBOrjptPMK_GXqKrRMugvZ6SeMCrXntjraDR8Eof45iSJwAboYafKmxs6w9r31VK_n48OIrDwODIvActNw8RNUjF5g5ZjkAP5wn7fXHUMnDuPHCjXqs3dX3PxlYt2SA03euM7eFsLrwaLDSmoOIeOcVeez5z2M4hOFUtsQ Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_23836c0cf9814daeb5e94c4fe4e9e5a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 23836c0cf9814daeb5e94c4fe4e9e5a6 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 1a1eefcd1e5a4275af3068aa8ac43696 Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1162241275-project Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: {"security_group": {"name": "tempest-sg-847648257", "description": "tempest-description-1667733807"}} Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: exception: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b8b11666-a4de-4c01-b85d-cf03618b9214', 'body': {'security_group': {'name': 'tempest-sg-847648257', 'description': 'tempest-description-1667733807'}}} Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 24 02:10:28.931263 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] Aug 24 02:10:28.934664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:28.938018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] Returning 404 to user: Security group b8b11666-a4de-4c01-b85d-cf03618b9214 does not exist Aug 24 02:10:28.938018 n-d-854121-3 devstack@n-api.service[128567]: Neutron server returns request_ids: ['req-8ce48573-a7d9-42ab-9fac-7b11009e5de6'] {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:28.938998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e6698e8-b97f-41ff-8e8b-4a78af06bb82 tempest-SecurityGroupsNegativeTestJSON-1162241275 tempest-SecurityGroupsNegativeTestJSON-1162241275-project] 10.222.0.49 "PUT /compute/v2.1/os-security-groups/b8b11666-a4de-4c01-b85d-cf03618b9214" status: 404 len: 194 microversion: 2.1 time: 0.049258 Aug 24 02:10:28.947143 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3254/4246] 10.222.0.49 () {60 vars in 1290 bytes} [Wed Aug 24 02:10:28 2022] PUT /compute/v2.1/os-security-groups/b8b11666-a4de-4c01-b85d-cf03618b9214 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:10:28.950552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b00a4c10-406d-48e6-ba08-f9ed84c04d39 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'create', calling method: .version_select at 0x7f6b9125a790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-441982230", "description": "tempest-description-1491296938"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:29.187386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b00a4c10-406d-48e6-ba08-f9ed84c04d39 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.244791 Aug 24 02:10:29.188008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3255/4247] 10.222.0.49 () {60 vars in 1180 bytes} [Wed Aug 24 02:10:28 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:29.193583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5691e11-0f7c-44d0-870e-b23183e9a6e6", "name": "network-vif-deleted", "tag": "f6e64947-7833-44b6-9b87-8bbfcd12fd50"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:29.207498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:29.207979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:29.208549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:29.219940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] Creating event network-vif-deleted:f6e64947-7833-44b6-9b87-8bbfcd12fd50 for instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 on n-h1-854121-3 Aug 24 02:10:29.225591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f18b4240-d9a3-4e8d-bbfb-ce87a5bce1bf req-2e11fa83-4a5a-48a0-82f0-fc65017c87ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036300 Aug 24 02:10:29.226551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3256/4248] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:29.232015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-441982230"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:29.232658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:29.252767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:29.253817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:29.255093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:29.256502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:29.257211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:29.257870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:29.515731 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Adding security group ed099b04-9b4d-4e31-91fb-7ae944758073 to port 923c350a-22fe-4fba-b072-0369f2b6eab6 Aug 24 02:10:30.508878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a38ea343-e103-416c-9d62-1d6139212cf1 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action" status: 202 len: 0 microversion: 2.1 time: 1.281030 Aug 24 02:10:30.509802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3257/4249] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:10:29 2022] POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:10:30.515518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:30.516414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:30.528813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.536073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.536881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:30.538147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.538857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.543686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:30.659088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:30.677587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:30.679387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:30.684849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99bfcf1c-7c6b-4173-b8ed-7f7dbc525f47 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.173687 Aug 24 02:10:30.685665 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3258/4250] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:30 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:30.696757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:30.699412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:30.708892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:30.715130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.720062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.721754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:30.724121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.726548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.727191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:30.864183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:30.873497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec42d88-5df3-414e-85a0-77502fa83dd2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1272 microversion: 2.1 time: 0.186623 Aug 24 02:10:30.876746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3259/4251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:30 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:30.884879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:30.889523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:30.896543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.897298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.898253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:30.899116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:30.899733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:30.900169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:31.175655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:31.190170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:31.197348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:31.199854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5349d2a4-b015-4878-98b9-2f604c3dbe70 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.320592 Aug 24 02:10:31.203403 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3260/4252] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:30 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:31.220881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883f5bee-8c01-4701-9a3a-469c58e12b65", "tag": "41362601-3267-4941-8f8e-9c701c0f4535"}, {"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-deleted", "tag": "f80a3510-e407-41e8-8a4b-a55cd78dc5cc"}, {"server_uuid": "9f51889a-a5ac-4eed-905a-e61e715714f2", "name": "network-vif-deleted", "tag": "42938828-6a74-4f4c-b0a2-112391d5cf7b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:31.251397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:31.252823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:31.254634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:31.287903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Creating event network-changed:41362601-3267-4941-8f8e-9c701c0f4535 for instance 883f5bee-8c01-4701-9a3a-469c58e12b65 on n-h1-854121-3 Aug 24 02:10:31.290003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Creating event network-vif-deleted:f80a3510-e407-41e8-8a4b-a55cd78dc5cc for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:31.293248 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] Creating event network-vif-deleted:42938828-6a74-4f4c-b0a2-112391d5cf7b for instance 9f51889a-a5ac-4eed-905a-e61e715714f2 on n-h1-854121-3 Aug 24 02:10:31.304643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3596b904-d346-4fd0-a141-14ed417f2355 req-3da79a1c-da3b-498d-b468-0eb485ef66c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.097883 Aug 24 02:10:31.311196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3261/4253] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:31.327377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-441982230"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:31.330437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:31.349513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:31.354797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:31.359593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:31.361990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:31.363197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:31.365910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:31.933407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Removing security group ed099b04-9b4d-4e31-91fb-7ae944758073 from port 923c350a-22fe-4fba-b072-0369f2b6eab6 Aug 24 02:10:33.646759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ca6ac43-cfdb-43b8-a8bb-707db7cacc58 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action" status: 202 len: 0 microversion: 2.1 time: 2.333255 Aug 24 02:10:33.652695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3262/4254] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:10:31 2022] POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action => generated 0 bytes in 2340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:10:33.658891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:33.660397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:33.679935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:33.680656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:33.681266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:33.682330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:33.684235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:33.685078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:33.828155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:33.856643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:33.859762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:33.869060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96537a0d-b705-49b0-8547-92157e087c29 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.213353 Aug 24 02:10:33.873007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3263/4255] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:33 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:33.885855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:33.889812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:33.913513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:33.914524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:33.915974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:33.919788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:33.920543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:33.922151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:34.663554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:34.667748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:34.683032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8901294e-4b85-41bd-bcda-ebbfccf8fbc7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1314 microversion: 2.1 time: 0.808692 Aug 24 02:10:34.687484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3264/4256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:33 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:34.701858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:34.707901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:34.739386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:34.739905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:34.750887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:34.751690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:34.752176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:34.752629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:34.953008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:34.962889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:34.964397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:34.967296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f26a377c-6e90-4eef-9b81-49db93fff4e0 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.273519 Aug 24 02:10:34.988512 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3265/4257] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:34 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:35.000296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:35.027021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:35.027520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:35.027955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:35.040845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] Creating event network-changed:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:10:35.054002 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6ab05b78-9c4d-4a17-aaef-556c74cf3c11 req-bd3f22d7-85ce-4ab7-889f-8e2b446b9b77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064058 Aug 24 02:10:35.056805 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3266/4258] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:35.075002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97f02189-413a-4553-b0f6-395b96645780 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'create', calling method: .version_select at 0x7f6b90eac940>, body: {"pool": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:36.640588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97f02189-413a-4553-b0f6-395b96645780 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.582224 Aug 24 02:10:36.641755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3267/4259] 10.222.0.49 () {60 vars in 1170 bytes} [Wed Aug 24 02:10:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:36.650657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:36.651924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:36.663959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:36.666401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:36.666967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:36.667817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:36.668503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:36.669078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:36.751909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:36.768327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:36.771024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:36.774325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b7158d2-9f76-4caa-8d42-7788c29b91a4 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.130962 Aug 24 02:10:36.775671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3268/4260] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:36 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:36.803267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:36.804074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:36.812821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:36.813583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:36.814182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:36.815230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:36.815894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:36.816648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:37.075815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:37.087041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-faf875ac-28b2-45d8-b9f9-75f4f7c96246 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1314 microversion: 2.1 time: 0.308170 Aug 24 02:10:37.087878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3269/4261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:36 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:37.104470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:37.105214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:37.111382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:37.111953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:37.126823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:37.127428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:37.127986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:37.128568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:37.286454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:37.296858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:37.298616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:37.300149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f14c097c-acee-4b57-8424-f33ce2e8fc56 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.210558 Aug 24 02:10:37.300850 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3270/4262] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:37 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:37.307000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.201"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:37.310122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:37.317699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:37.319104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:37.319965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:37.320943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:37.321763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:37.322585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:37.365210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 02:10:37.365716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquired lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 02:10:37.596118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:37.619020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:39.698787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Building network info cache for instance {{(pid=128567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 02:10:40.805896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Updating instance_info_cache with network_info: [{"id": "923c350a-22fe-4fba-b072-0369f2b6eab6", "address": "fa:16:3e:c2:13:c6", "network": {"id": "71989932-3b2c-4e9f-830f-d15a2c283fcf", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1685009545-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e24309b7b5e940dea727ee00bfb0b23e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap923c350a-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 02:10:40.822533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Releasing lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 02:10:40.823545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f920ee93-97a4-4bca-adff-90806e95c778 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action" status: 202 len: 0 microversion: 2.1 time: 3.521329 Aug 24 02:10:40.827512 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3271/4263] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:10:37 2022] POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action => generated 0 bytes in 3526 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 02:10:40.843874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}, {"name": "network-changed", "server_uuid": "900e8375-4a6a-420c-b92d-ace512602619", "tag": "2ffe3697-174c-4a1e-993c-32baa8969297"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:40.878974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:40.881403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:40.883147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:40.924817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Creating event network-changed:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:10:40.928222 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] Creating event network-changed:2ffe3697-174c-4a1e-993c-32baa8969297 for instance 900e8375-4a6a-420c-b92d-ace512602619 on n-h1-854121-3 Aug 24 02:10:40.955085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4f307a9a-f53b-49a3-bbac-367a021f37df req-19c88853-48bd-4ab7-970c-f0675d9ab644 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121903 Aug 24 02:10:40.957754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3272/4264] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:40.967055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:40.970575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:40.990212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:40.990759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:40.992423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:40.993230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:40.995286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:40.998509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:41.159923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:41.188814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:41.198390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '888486438a2747f1ba4eeb34cb04bb02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4bf1499aec34fe5a9be0b8c83fa0d42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:41.203565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ccceabb-7296-43eb-977b-ed4b47b2a5b0 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 200 len: 1603 microversion: 2.42 time: 0.239094 Aug 24 02:10:41.205112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3273/4265] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:40 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 1603 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:41.210713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:41.211564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:41.220688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:41.221479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:41.222854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:41.224042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:41.224797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:41.225650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:41.897735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:41.909014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae217bc4-cb56-4c8a-8863-bab4f031fe4f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1314 microversion: 2.1 time: 0.702386 Aug 24 02:10:41.914298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3274/4266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:41 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:41.922901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:41.924434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:41.940406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:41.942565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:41.945485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:41.946406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:41.947044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:41.948962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:42.130478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:42.141828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:42.150257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:42.151493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0043e3f5-e038-4960-b871-8cd064dcb0c6 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.235741 Aug 24 02:10:42.152234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3275/4267] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:41 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:42.157316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-434079172", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "a92ba0f5-ca5b-415a-bc59-1bf11dc9764f"}, {"uuid": "b7f21731-48e9-4692-b12d-b9bc727703fa"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:42.276831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] validate_networks() for [('a92ba0f5-ca5b-415a-bc59-1bf11dc9764f', None, None, None, None, None), ('b7f21731-48e9-4692-b12d-b9bc727703fa', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:10:43.598451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:10:43.602063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:10:43.602875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:10:43.603525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:10:43.604174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:10:43.618743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:43.620807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:43.623291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:43.625190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:43.628914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:43.629619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:43.666891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Getting quotas for project 8d7b8be3aa804069a0a9c7dc149dec3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:43.677936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Getting quotas for user c67fbb100ca04eebbd3dd6bb40802561 and project 8d7b8be3aa804069a0a9c7dc149dec3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:43.694393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:10:43.698043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:10:43.771976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c4bb89d-f371-4143-83c2-dc64f76c5dba tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618000 Aug 24 02:10:43.773041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3276/4268] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:10:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:10:43.778979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.201"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:44.419958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:44.428082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:44.428877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:44.430869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:44.431844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:44.432525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:44.433193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:44.911935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 02:10:44.912570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquired lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 02:10:47.747899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Building network info cache for instance {{(pid=128567) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 24 02:10:49.720023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Updating instance_info_cache with network_info: [{"id": "923c350a-22fe-4fba-b072-0369f2b6eab6", "address": "fa:16:3e:c2:13:c6", "network": {"id": "71989932-3b2c-4e9f-830f-d15a2c283fcf", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1685009545-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e24309b7b5e940dea727ee00bfb0b23e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap923c350a-22", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 02:10:49.736220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Releasing lock "refresh_cache-df4657a3-a13d-4286-b0aa-c7cf877a9757" {{(pid=128567) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 02:10:49.738398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d14bb1cc-a790-4109-b90b-2215d997674e tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action" status: 202 len: 0 microversion: 2.1 time: 5.964023 Aug 24 02:10:49.743291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3277/4269] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:10:43 2022] POST /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757/action => generated 0 bytes in 5965 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 24 02:10:49.759203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:49.763655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:49.775889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:49.777168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:49.779544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:49.780533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:49.780946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:49.781640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:49.798269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] HTTP exception thrown: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Request method failure captured: Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 HTTP/1.1 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcm5t43ZbcYB7hCj6-qnwM76QdjzLj9Z28e67K-noaPBzOPRIMrkUiaA2t_m-aDCJN9sbm9kpSjMlWHk1Ek9mGA7VulVkm-IryTkIWlendAZGCMFBZ_3gObC2WpxJMChUL0H_wjcHM_qxrPrLbVW70H0O8-TnDsqPYQuARtZroJFI4 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 888486438a2747f1ba4eeb34cb04bb02 Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f5691e11-0f7c-44d0-870e-b23183e9a6e6'} Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:49.801215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:10:49.805121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:10:49.807449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Returning 404 to user: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:10:49.808417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ad99291-fa42-429c-a721-a83e6c80fc51 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 404 len: 111 microversion: 2.42 time: 0.059680 Aug 24 02:10:49.812337 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3278/4270] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:49 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:10:49.819275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:49.821874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:49.829333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:49.830091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:49.830805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:49.831544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:49.831999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:49.832422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.186469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:50.196699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cea6d3e5-efc5-4eb3-ace9-bfda55a04414 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1314 microversion: 2.1 time: 0.384938 Aug 24 02:10:50.209928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3279/4271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:49 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:50.216507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:50.230368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:50.231887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:50.233281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.254381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] Creating event network-changed:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:10:50.260796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5eeb358a-20df-44cc-be9d-397742d7e238 req-aafd0cda-56c6-436e-8074-74be8da2c7a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048377 Aug 24 02:10:50.262026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3280/4272] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:50.268009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:50.269335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:50.276259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:50.276775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:50.277233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.277955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:50.278423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:50.278859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.372008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:50.381390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:50.383539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:50.385052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74fbcf9b-c9c6-432a-b9b6-bf46f00aaa53 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.121887 Aug 24 02:10:50.401412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3281/4273] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:50 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:50.407675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:50.408426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:50.415191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:50.416310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:50.416310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.416989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:50.417748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:50.418412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:50.893927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:50.925243 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f77b2c6-6788-43f0-8f2d-c2fd5c0d0fb2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.521678 Aug 24 02:10:50.947330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3282/4274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:50 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:50.978303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900e8375-4a6a-420c-b92d-ace512602619", "name": "network-vif-plugged", "status": "completed", "tag": "2ffe3697-174c-4a1e-993c-32baa8969297"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:51.007765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:51.009241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:51.009751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:51.036446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] Creating event network-vif-plugged:2ffe3697-174c-4a1e-993c-32baa8969297 for instance 900e8375-4a6a-420c-b92d-ace512602619 on n-h1-854121-3 Aug 24 02:10:51.042435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-47aa24e7-d3b6-42d2-9cd7-82de26d9ca29 req-4916eb49-00f9-4b82-9cbb-d98b1d7a6c50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105867 Aug 24 02:10:51.043873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3283/4275] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:51.051423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec4bd1dd-ef0c-46b6-974a-e55d51dca619 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '.version_select at 0x7f6b91232430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:52.774507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec4bd1dd-ef0c-46b6-974a-e55d51dca619 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "DELETE /compute/v2.1/os-floating-ips/c80b8aba-8b99-491c-a4da-05de7f224074" status: 202 len: 0 microversion: 2.1 time: 1.728585 Aug 24 02:10:52.777694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3284/4276] 10.222.0.49 () {58 vars in 1263 bytes} [Wed Aug 24 02:10:51 2022] DELETE /compute/v2.1/os-floating-ips/c80b8aba-8b99-491c-a4da-05de7f224074 => generated 0 bytes in 1733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:10:52.793654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0bd3c8e-7cc9-41ac-abd3-f84f09ed8208 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '.version_select at 0x7f6b91578670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:52.893809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0bd3c8e-7cc9-41ac-abd3-f84f09ed8208 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540739081" status: 204 len: 0 microversion: 2.42 time: 0.113721 Aug 24 02:10:52.912848 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3285/4277] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 02:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540739081 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:10:52.919300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:52.920062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:52.947031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:52.947558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:52.948027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:52.951614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:52.952109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:52.952557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:53.231704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:53.248906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:53.264398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e84140c-af2a-4afc-8a4e-d01b2d02c60e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1499 microversion: 2.1 time: 0.349342 Aug 24 02:10:53.266707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3286/4278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:52 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1499 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:53.293030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:53.297315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:53.309345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:53.309852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:53.310300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:53.311024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:53.311492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:53.311940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:53.469846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:53.481928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:53.484270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:53.502813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c95e43d6-6c09-47c0-933f-dbeea9631b87 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1365 microversion: 2.57 time: 0.234373 Aug 24 02:10:53.503482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3287/4279] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:53 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:53.655742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:53.689246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:53.838365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-584498660", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8d400eea-bf97-4d4b-bff4-716e4328458b"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:53.907444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] validate_networks() for [('8d400eea-bf97-4d4b-bff4-716e4328458b', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:10:54.789527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:10:54.790070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:10:54.790757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:10:54.791330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:10:54.791954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:10:54.822899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:54.826101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:54.830929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:54.832921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:54.833768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:54.834220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:54.886486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Getting quotas for project 810db131a600433dadc3c66ec940b9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:10:54.901468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Getting quotas for user 69c66a3c94544dc896ceb361ac15831c and project 810db131a600433dadc3c66ec940b9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:10:54.953199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Going to run 2 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:10:54.968854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 7ef11833-26ad-4128-8704-fb020023d7e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:10:55.052601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=7ef11833-26ad-4128-8704-fb020023d7e6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:10:55.131252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2de76f67-c242-4ea8-a901-82e8f7665b76 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626285 Aug 24 02:10:55.138445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3288/4280] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:10:55.143936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:55.144774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:55.151740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:55.152440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:55.153093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:55.153962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:55.154581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:55.155167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:55.439591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:55.449628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19cd62bc-9b62-40a4-977f-3fbbdae67629 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.309894 Aug 24 02:10:55.468110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3289/4281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:55 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:55.475070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}, {"name": "network-changed", "server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "tag": "6aa4e72b-31ca-48be-9634-e6e7b5e75ad7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:55.488536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:55.489440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:55.490059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:55.504930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Creating event network-changed:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:10:55.505711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] Creating event network-changed:6aa4e72b-31ca-48be-9634-e6e7b5e75ad7 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:10:55.515643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7af4d96d-5de3-4759-b97d-c102deb16942 req-cdb72f7b-cbad-4f2e-95b2-3d039444393a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045938 Aug 24 02:10:55.516500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3290/4282] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:55.523801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83298094-01d2-4b31-992b-74e996f908bf tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '.version_select at 0x7f6b91259670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:55.890921 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83298094-01d2-4b31-992b-74e996f908bf tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "DELETE /compute/v2.1/os-security-groups/ed099b04-9b4d-4e31-91fb-7ae944758073" status: 202 len: 0 microversion: 2.1 time: 0.372830 Aug 24 02:10:55.892239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3291/4283] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:10:55 2022] DELETE /compute/v2.1/os-security-groups/ed099b04-9b4d-4e31-91fb-7ae944758073 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:10:55.898562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:55.907983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:55.936219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:55.937796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:55.938521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:55.939522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:55.941699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:55.942334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:55.972818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lazy-loading 'flavor' on Instance uuid 900e8375-4a6a-420c-b92d-ace512602619 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:10:56.077733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9adfc057-ec47-4f2c-904d-875716b403f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "POST /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619/action" status: 200 len: 32 microversion: 2.1 time: 0.183383 Aug 24 02:10:56.085193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3292/4284] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:10:55 2022] POST /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:10:56.092206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:56.094668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:56.104425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.104971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.105425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.106127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.106768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.107220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.214152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:56.224317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:56.226134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:56.227558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c22b940-6523-450c-879c-6f61cf620d80 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1371 microversion: 2.57 time: 0.144938 Aug 24 02:10:56.228583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3293/4285] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:56 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:56.250424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:56.256092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:56.257332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Searching by: {'deleted': False, 'project_id': '810db131a600433dadc3c66ec940b9a3'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:10:56.270895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.271456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.271975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.272658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.273154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.273647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.319731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Listed batch of 2 results from cell out of 999 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:10:56.385461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19b504f6-aaed-4221-8af8-661558ff446f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.145422 Aug 24 02:10:56.386046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3294/4286] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:10:56 2022] GET /compute/v2.1/servers => generated 675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:56.391415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:56.391982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:56.398700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:56.401393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.402130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.402768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.403638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.404216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.405453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.442578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:10:56.546549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd192862-7f00-4aca-b27f-16034ecc9aea tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "DELETE /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 204 len: 0 microversion: 2.1 time: 0.158774 Aug 24 02:10:56.547164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3295/4287] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:10:56 2022] DELETE /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:10:56.553342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:56.554109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:56.561074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.561956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.562599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.563332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.564007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.564565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.907516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:56.919213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cc770dc-ed8e-4320-b478-2da802ec02b9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.370497 Aug 24 02:10:56.920623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3296/4288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:56 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:56.926734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:56.927350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:56.935591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.936086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.936523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:56.937885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:56.938338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:56.938766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:57.046723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:57.057615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4eb1a7d8-a714-4910-9ea7-39f91bb964dd tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1223 microversion: 2.1 time: 0.134326 Aug 24 02:10:57.058814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3297/4289] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:56 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:57.068632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:57.069507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:57.078058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:57.079118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:57.084888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:57.086102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:57.086835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:57.087642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:57.546737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:57.554584 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32c09a5b-c522-418c-84ae-0e6355e418a9 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.494432 Aug 24 02:10:57.555184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3298/4290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:57 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:57.563079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:57.563712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:57.585235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:57.595972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:57.597538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:57.598472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:57.599117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:57.599718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.193198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:58.209773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ee3542a-6ead-4f20-a034-a7da8e7b3af8 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1510 microversion: 2.1 time: 0.646681 Aug 24 02:10:58.211376 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3299/4291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:57 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:58.223365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:58.224408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:58.233883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:58.242164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:58.243345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.246221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:58.249040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:58.249769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.414375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:58.425014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:58.426727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:58.427946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bedab0f3-4b71-4d32-ba33-c911c540f9ea tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1371 microversion: 2.57 time: 0.215076 Aug 24 02:10:58.428865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3300/4292] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:10:58 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:10:58.434815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "tag": "8703519c-9dc4-4a8f-b634-53a47d2a3fc8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:10:58.449922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:58.450607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:58.450805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.469322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] Creating event network-changed:8703519c-9dc4-4a8f-b634-53a47d2a3fc8 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:10:58.476513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c9ed91ea-3bfa-48cc-a28d-3e945a5f3122 req-0eedf8d6-9eed-4297-a307-a062fc5bab4c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046258 Aug 24 02:10:58.478266 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3301/4293] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:10:58.483072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:58.483967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:58.491375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:58.491877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:58.492614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.493424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:58.493897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:58.494504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:58.518379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:10:58.949416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:58.969768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a54beba-11b1-45a9-8597-6d7191a11026 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.489668 Aug 24 02:10:58.971761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3302/4294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:58 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:59.004053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:59.006213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:59.025883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.026545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.027740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.029695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.031474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.032644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.215251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:59.231737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-482747c0-c9e4-4c5d-a663-09ab736e4595 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1223 microversion: 2.1 time: 0.256455 Aug 24 02:10:59.233720 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3303/4295] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:58 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1223 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:59.252006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:59.254610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:59.278538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.279047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.279498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.280293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.281641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.282120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.584809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:59.614357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa8365be-0973-485a-8dbe-7f7310d22f67 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.375777 Aug 24 02:10:59.616958 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3304/4296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:59 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:59.638679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:59.643186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:59.649706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.659994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.665171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.665949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.669336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.671949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.964515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:10:59.973667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce2ddc13-1daf-45c3-b518-3e22bae22229 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1510 microversion: 2.1 time: 0.354556 Aug 24 02:10:59.974248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3305/4297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:10:59 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:10:59.979154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:10:59.979816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:10:59.985797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.986531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.987160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:10:59.988042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:10:59.988676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:10:59.989131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.005223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] HTTP exception thrown: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Request method failure captured: Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 HTTP/1.1 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcm5t43ZbcYB7hCj6-qnwM76QdjzLj9Z28e67K-noaPBzOPRIMrkUiaA2t_m-aDCJN9sbm9kpSjMlWHk1Ek9mGA7VulVkm-IryTkIWlendAZGCMFBZ_3gObC2WpxJMChUL0H_wjcHM_qxrPrLbVW70H0O8-TnDsqPYQuARtZroJFI4 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 888486438a2747f1ba4eeb34cb04bb02 Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f5691e11-0f7c-44d0-870e-b23183e9a6e6'} Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:00.006732 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.011015 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.012679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Returning 404 to user: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:00.013738 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad5ee9b7-6bc7-4372-8b55-6a1edde1120e tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 404 len: 111 microversion: 2.42 time: 0.038397 Aug 24 02:11:00.019466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3306/4298] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:10:59 2022] DELETE /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:11:00.025948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.026807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:00.033989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.034729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.035374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.036240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.036897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.037541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.120516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.129707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.131452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.132658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6de1996c-b638-4120-8ee0-64263eaaf976 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1371 microversion: 2.57 time: 0.111707 Aug 24 02:11:00.133585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3307/4299] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:00.138236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.138833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:00.145590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.146266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.146910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.147767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.148381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.149017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.351475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.359763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba228d0b-2756-4a10-a4b5-740d3cfa6f1b tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.225069 Aug 24 02:11:00.360332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3308/4300] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:00.370221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.370870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] [instance: f5691e11-0f7c-44d0-870e-b23183e9a6e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:00.377151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.379203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.379680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.380378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.380872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.381302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.405047 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] HTTP exception thrown: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Request method failure captured: Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 HTTP/1.1 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYcm5t43ZbcYB7hCj6-qnwM76QdjzLj9Z28e67K-noaPBzOPRIMrkUiaA2t_m-aDCJN9sbm9kpSjMlWHk1Ek9mGA7VulVkm-IryTkIWlendAZGCMFBZ_3gObC2WpxJMChUL0H_wjcHM_qxrPrLbVW70H0O8-TnDsqPYQuARtZroJFI4 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.42 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a4bf1499aec34fe5a9be0b8c83fa0d42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a4bf1499aec34fe5a9be0b8c83fa0d42 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2063179962 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 888486438a2747f1ba4eeb34cb04bb02 Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2063179962-project Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f5691e11-0f7c-44d0-870e-b23183e9a6e6'} Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.406978 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. Aug 24 02:11:00.410680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:00.412757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] Returning 404 to user: Instance f5691e11-0f7c-44d0-870e-b23183e9a6e6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:00.413861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b34c1d8-fbb4-4023-9842-b1d07d1a5038 tempest-TaggedBootDevicesTest_v242-2063179962 tempest-TaggedBootDevicesTest_v242-2063179962-project] 10.222.0.49 "GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6" status: 404 len: 111 microversion: 2.42 time: 0.052581 Aug 24 02:11:00.414644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3309/4301] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/f5691e11-0f7c-44d0-870e-b23183e9a6e6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:11:00.431689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.432869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:00.439177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.439749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.440928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.441720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.442746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.443250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.551745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.560645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-254b0f50-c852-4f4f-8f5c-7ebf1a2e152b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1271 microversion: 2.1 time: 0.144722 Aug 24 02:11:00.573414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3310/4302] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:00.582433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ef11833-26ad-4128-8704-fb020023d7e6", "tag": "d7dc6da9-6661-450f-a724-c4a38eb24561"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:00.600773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.601551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.602175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.615185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] Creating event network-changed:d7dc6da9-6661-450f-a724-c4a38eb24561 for instance 7ef11833-26ad-4128-8704-fb020023d7e6 on n-h1-854121-3 Aug 24 02:11:00.620052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4aa46fa1-51ac-4e96-853a-1ba28b677435 req-b688c66b-8a01-4830-8575-6574bd4377b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045266 Aug 24 02:11:00.620770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3311/4303] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:00.637793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.638508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:00.644900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.645406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.645853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.646564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:00.647027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:00.647462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:00.816919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:00.826327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-877519b7-7c90-454b-95bb-a25056980b56 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.192588 Aug 24 02:11:00.827452 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3312/4304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:00.995768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:00.996491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:01.008316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.008918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.009456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:01.010791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.011328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.011767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:01.363955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:01.376876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b68b3da8-bcb9-4fcd-84ab-4445c5ae0772 tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1510 microversion: 2.1 time: 0.384670 Aug 24 02:11:01.378219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3313/4305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:00 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:01.390487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:01.391790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:01.402966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.407762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.408396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:01.409395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.409989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.410536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:01.834488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:01.847788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:01.850730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:01.853129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ff45bcd-a427-44bc-bb8b-0e51e5c0c89e tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1371 microversion: 2.57 time: 0.472930 Aug 24 02:11:01.854100 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3314/4306] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:01 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:01.867539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:01.869597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:01.884638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.886919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.888461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:01.890830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:01.891575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:01.894554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.161826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:02.172693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eab03414-924d-4cdf-af11-2312b978756d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.317208 Aug 24 02:11:02.176387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3315/4307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:01 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:02.187926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:02.189815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:02.201231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.202005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.202580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.203617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.204581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.205284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.316126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:02.326333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30b90434-89fd-4066-ab59-73876c7cdba1 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1277 microversion: 2.1 time: 0.148676 Aug 24 02:11:02.331423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3316/4308] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:02 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:02.337745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:02.338606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:02.362052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.364795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.365443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.366071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.367689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.368419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.679893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:02.689800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-108db74a-e928-4a35-9980-6273806bda7f tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.357450 Aug 24 02:11:02.690978 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3317/4309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:02 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:02.697431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4657a3-a13d-4286-b0aa-c7cf877a9757", "name": "network-vif-deleted", "tag": "923c350a-22fe-4fba-b072-0369f2b6eab6"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:02.711896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.712297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.712872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.725089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] Creating event network-vif-deleted:923c350a-22fe-4fba-b072-0369f2b6eab6 for instance df4657a3-a13d-4286-b0aa-c7cf877a9757 on n-h2-854121-3 Aug 24 02:11:02.732165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c3016c94-b823-4852-8c6a-910da546c852 req-2025697c-ad58-4a21-8163-913bc85be85b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039937 Aug 24 02:11:02.733001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3318/4310] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:02.743317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "name": "network-vif-plugged", "status": "completed", "tag": "6aa4e72b-31ca-48be-9634-e6e7b5e75ad7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:02.759534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.760033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.760481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.773049 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] Creating event network-vif-plugged:6aa4e72b-31ca-48be-9634-e6e7b5e75ad7 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:11:02.786835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9db07a19-a8d4-427d-a8f0-927db8ff57cb req-c6ffd3d9-d237-4186-9b1c-93fd79ae1418 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047934 Aug 24 02:11:02.795367 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3319/4311] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:02.806203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:02.806936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:02.823230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.823740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.826376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.827105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.827579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.828021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.882822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.883333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.883775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.884433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lazy-loading 'fault' on Instance uuid df4657a3-a13d-4286-b0aa-c7cf877a9757 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:11:02.931383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b97371aa07664302b5e7e1a5c35d12af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e24309b7b5e940dea727ee00bfb0b23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:02.939795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06c353ce-91cd-47b1-a717-f999ca8b714b tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 200 len: 1313 microversion: 2.1 time: 0.143072 Aug 24 02:11:02.940988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3320/4312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:02 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:02.945629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:02.946242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:02.952296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.952826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.953271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:02.954448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:02.955211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:02.955911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.026237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.051684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.055129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.058323 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad081731-7c10-444f-b966-12106930c342 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1356 microversion: 2.57 time: 0.116360 Aug 24 02:11:03.060373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3321/4313] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:02 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:03.089602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:03.090120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:03.097084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.097851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.098288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.099012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.099481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.099918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.104386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:03.130715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:03.273917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d113cdc-78ba-4df6-b06f-cac09e53ab0b tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 204 len: 0 microversion: 2.57 time: 0.188438 Aug 24 02:11:03.278164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3322/4314] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:11:03 2022] DELETE /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 02:11:03.288523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:03.289328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:03.298299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.298812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.299313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.302831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.304290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.306292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.717325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.727724 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12c7d233-5e66-4168-a67a-09ac1ccd3bfa tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.448274 Aug 24 02:11:03.732515 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3323/4315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:03 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:03.746264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:03.747088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:03.762577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.763166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.764279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.765534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.765695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.766221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.875467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.886349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.888350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:03.889864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3c3f377-a4dd-49c6-9784-445aa7b8a6e4 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1362 microversion: 2.57 time: 0.156132 Aug 24 02:11:03.890711 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3324/4316] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:03 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:03.913323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:03.914195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:03.930131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.933530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.934094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:03.934932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:03.937119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:03.937728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.139938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:04.153966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f21083d7-9753-4b38-ace3-863b7f7ac340 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.250818 Aug 24 02:11:04.154874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3325/4317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:03 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:04.173481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:04.174385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:04.180427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.180965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.181412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.182708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.183746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.184193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.373183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:04.385048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5572efe5-c087-4efb-8cb2-cc863f994576 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.218343 Aug 24 02:11:04.385869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3326/4318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:04 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:04.402068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:04.403189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] [instance: df4657a3-a13d-4286-b0aa-c7cf877a9757] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:04.415562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.415978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.416425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.417201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.417661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.418098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.434750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] HTTP exception thrown: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Request method failure captured: Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 HTTP/1.1 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhT8r2buFoua2QVAr6FADoXTdTa4iCzovbHXIYvc6_NxMVnVDXQ-ZUtHKG3lzx3w2GAZqE9OwG0VhJyisYKpfeE_pnbr0pDgc03CRrh-3HSFDP1sJBBOpKbze3N8r_gHGOOjJ_2fojVFd0J2Kpb7FZMeRdt8wiAiwT9LlTpe1N0sl4 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e24309b7b5e940dea727ee00bfb0b23e Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-34170973 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e24309b7b5e940dea727ee00bfb0b23e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e24309b7b5e940dea727ee00bfb0b23e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e24309b7b5e940dea727ee00bfb0b23e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e24309b7b5e940dea727ee00bfb0b23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-34170973 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e24309b7b5e940dea727ee00bfb0b23e Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-34170973 Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueTestJSONUnderV235-34170973-project Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b97371aa07664302b5e7e1a5c35d12af Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-34170973-project Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'df4657a3-a13d-4286-b0aa-c7cf877a9757'} Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:04.436320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] Returning 404 to user: Instance df4657a3-a13d-4286-b0aa-c7cf877a9757 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf89029f-830b-4bd0-b8e7-c84db62c51ac tempest-ServerRescueTestJSONUnderV235-34170973 tempest-ServerRescueTestJSONUnderV235-34170973-project] 10.222.0.49 "GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757" status: 404 len: 111 microversion: 2.1 time: 0.051144 Aug 24 02:11:04.440238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3327/4319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:04 2022] GET /compute/v2.1/servers/df4657a3-a13d-4286-b0aa-c7cf877a9757 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:04.762371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:04.762938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:04.782898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.783560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.786371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.788145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:04.788641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:04.790655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:04.929404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:05.144338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:05.159904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28a94689-77e7-4b10-83d4-5e32d1814f3d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.409704 Aug 24 02:11:05.161273 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3328/4320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:04 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:05.178207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "name": "network-vif-plugged", "status": "completed", "tag": "8703519c-9dc4-4a8f-b634-53a47d2a3fc8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:05.201500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.202054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.204622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.280554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] Creating event network-vif-plugged:8703519c-9dc4-4a8f-b634-53a47d2a3fc8 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:11:05.299386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-90967cba-3f13-4548-a977-513cafac37aa req-dbc14d52-df5b-489d-9e6b-0eed948c67f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132293 Aug 24 02:11:05.301478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3329/4321] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:05.316426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715b8c4f-61cc-43bb-b8a6-0c7a428c1526", "tag": "b24cf6ef-5eb0-486b-8f67-400a66e7407e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:05.341058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.341547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.342178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.362967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] Creating event network-changed:b24cf6ef-5eb0-486b-8f67-400a66e7407e for instance 715b8c4f-61cc-43bb-b8a6-0c7a428c1526 on n-h2-854121-3 Aug 24 02:11:05.379122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cd309c78-8a0c-4156-bd33-4ca830436888 req-efb3bb83-5fbe-4f37-8df7-d8d0798d1cd2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075385 Aug 24 02:11:05.380069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3330/4322] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:05.385366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:05.386078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:05.405029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.405527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.406279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.407001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.407464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.407897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.730690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:05.756664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:05.758240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c046a1e8ae694b55a7e427b19b2d7a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02bbbfacbc4646b4bae119b23ade398b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:05.759437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e99d69a-8180-4abb-a968-97d326ee144d tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 200 len: 1362 microversion: 2.57 time: 0.378238 Aug 24 02:11:05.760299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3331/4323] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:05 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:05.774155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:05.774799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:05.785943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.786463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.786916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.789977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:05.790519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:05.791072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:05.978533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:06.006697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df85a317-688b-45f6-9535-a7c6ff058244 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.240101 Aug 24 02:11:06.009569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3332/4324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:05 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:06.024562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:06.029933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:06.053736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.054767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.057394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.069777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.070512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.071148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.288701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:06.331080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:06.341943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7000a934-60a1-4f84-af86-aeab23be7707 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1333 microversion: 2.1 time: 0.331217 Aug 24 02:11:06.355514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3333/4325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:06 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1333 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:06.355514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:06.355514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:06.367919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.368436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.368922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.369780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.373912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.374279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.821881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:06.831048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce4c658f-d9a2-477a-bf32-8a8d41a1d0e8 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.481807 Aug 24 02:11:06.835160 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3334/4326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:06 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:06.849802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:06.850781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] [instance: c3ee2601-fc8f-460a-936a-548c06e06022] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:06.860928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.863174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.864478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.865858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:06.869157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:06.869684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:06.903247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] HTTP exception thrown: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Request method failure captured: Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 HTTP/1.1 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYiES2mpFzTmBLfW_lvOsw4Vz8e-l-89NM4pKZRnD35Sc0jDavDJTnUeCyfc81nF-3QzveohUGvs0xe9w4UBJGgcNWKNyyF85rWyp6iidNzE0cIl03lBej8GA4HG7jriGVqv0zGJKyng5sZJ8NGkKi-T0AOQR74aM2tW94Yld-BIQaQ Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.57 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 02bbbfacbc4646b4bae119b23ade398b Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerShowV257Test-606605824 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/02bbbfacbc4646b4bae119b23ade398b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02bbbfacbc4646b4bae119b23ade398b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/02bbbfacbc4646b4bae119b23ade398b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_02bbbfacbc4646b4bae119b23ade398b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerShowV257Test-606605824 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 02bbbfacbc4646b4bae119b23ade398b Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerShowV257Test-606605824 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerShowV257Test-606605824-project Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c046a1e8ae694b55a7e427b19b2d7a75 Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerShowV257Test-606605824-project Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c3ee2601-fc8f-460a-936a-548c06e06022'} Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:06.905380 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. Aug 24 02:11:06.909962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:06.910656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] Returning 404 to user: Instance c3ee2601-fc8f-460a-936a-548c06e06022 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:06.913041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23aba0c4-eab9-4201-9adf-66a426faca63 tempest-ServerShowV257Test-606605824 tempest-ServerShowV257Test-606605824-project] 10.222.0.49 "GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022" status: 404 len: 111 microversion: 2.57 time: 0.074692 Aug 24 02:11:06.920067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3335/4327] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:06 2022] GET /compute/v2.1/servers/c3ee2601-fc8f-460a-936a-548c06e06022 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:11:07.032616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:07.033545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:07.043895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:07.044728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:07.048297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:07.049230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:07.049811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:07.050352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:07.446252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:07.459264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d7b2d31-5fc4-42c0-b16f-82d17a9254e3 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.430404 Aug 24 02:11:07.461437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3336/4328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:07 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:07.468532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef11833-26ad-4128-8704-fb020023d7e6", "name": "network-vif-plugged", "status": "completed", "tag": "d7dc6da9-6661-450f-a724-c4a38eb24561"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:07.489128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:07.489872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:07.490772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:07.508201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] Creating event network-vif-plugged:d7dc6da9-6661-450f-a724-c4a38eb24561 for instance 7ef11833-26ad-4128-8704-fb020023d7e6 on n-h1-854121-3 Aug 24 02:11:07.514596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-197ce936-bcad-4061-8de8-237a022e0903 req-ccc1d3a4-912a-4c7f-81b4-0f1bdfc085fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050507 Aug 24 02:11:07.516591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3337/4329] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:07.524173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:07.525348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:07.533620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:07.536344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:07.537318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:07.538021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:07.538997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:07.539732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:07.540378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.192525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:08.201839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca61a994-71c3-4a39-8a22-d9b6e79c2fac tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1668 microversion: 2.1 time: 0.682727 Aug 24 02:11:08.203241 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3338/4330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:07 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1668 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:08.221705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:08.224171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:08.245372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.247292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.248629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.250760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.252727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.253732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.516093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:08.525669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-356f7b62-c4d5-42b2-b7b5-ce4b056eeae9 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.320899 Aug 24 02:11:08.526903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3339/4331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:08 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:08.546657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:08.547528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:08.567613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.568127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.568564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.569367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.569758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.570532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.619103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:08.628503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49f7c868-d3bc-4943-bdf7-e095036805a3 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c/ips" status: 200 len: 179 microversion: 2.1 time: 0.096838 Aug 24 02:11:08.633442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3340/4332] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:11:08 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c/ips => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:08.645697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:08.646329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:08.655224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.655766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.656244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.657037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.657543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.658074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.891640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:08.903150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a2c030b-bd09-41f5-baa4-c2da109a3f1f tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.268523 Aug 24 02:11:08.905079 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3341/4333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:08 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:08.932214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:08.932650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:08.947649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.949183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.950300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:08.953099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:08.953634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:08.954445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:09.016605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:09.149924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c8ad506-b096-49db-bee1-8e10ce0b7978 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 204 len: 0 microversion: 2.1 time: 0.241894 Aug 24 02:11:09.150602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3342/4334] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:08 2022] DELETE /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:09.163624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:09.164489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:09.175333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:09.176170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:09.177819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:09.179468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:09.180194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:09.180995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:09.446112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:09.459639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-114a1092-5ee8-4c33-b2e4-60a7a3232001 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1674 microversion: 2.1 time: 0.303474 Aug 24 02:11:09.467576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3343/4335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:09 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1674 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:09.552964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:09.553608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:09.588566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:09.589191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:09.589654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:09.590410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:09.590876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:09.591308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:10.082791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:10.097241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a410aa7-a32a-49f5-bc4a-cd387584eeb2 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.549240 Aug 24 02:11:10.098625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3344/4336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:09 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:10.104400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:10.105132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:10.113801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:10.114507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:10.115210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:10.116129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:10.116882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:10.117540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:10.511385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:10.520576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-280376be-6409-498c-babc-d5fd2898db5b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.420688 Aug 24 02:11:10.526093 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3345/4337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:10 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:10.536788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:10.537402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:10.550084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:10.550624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:10.551067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:10.551949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:10.552228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:10.552661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:10.991161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:11.004237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-478cfe85-6929-4b9f-93cb-43ef1fec1a9c tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1674 microversion: 2.1 time: 0.476992 Aug 24 02:11:11.005450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3346/4338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:10 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1674 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:11.124449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:11.125860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:11.135912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:11.135912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:11.135912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:11.136189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:11.136620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:11.137545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:11.805050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:11.815069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-062bb612-fb7a-4eb4-9440-13e88d8d171f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.695882 Aug 24 02:11:11.824402 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3347/4339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:11 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:11.831638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:11.832316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:11.867695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:11.902303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:11.910719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:11.918999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:11.919516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:11.919964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:12.336933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:12.345195 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c933b41-4016-4a17-9d31-bfb0ec53ba6c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.519551 Aug 24 02:11:12.349732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3348/4340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:11 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:12.362494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:12.364659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:12.388965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:12.394792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:12.395842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:12.396975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:12.399028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:12.408039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:12.727829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:12.754478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96a5b2f1-0cb8-44cb-8aad-1d0816a87ada tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1674 microversion: 2.1 time: 0.403605 Aug 24 02:11:12.758793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3349/4341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:12 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1674 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:12.777941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c684a5e4-2525-4a28-9945-5cf0d559ec78 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b917603a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:12.907160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c684a5e4-2525-4a28-9945-5cf0d559ec78 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ca51604a-7f0f-4529-92f9-1dc6c73428aa" status: 200 len: 351 microversion: 2.1 time: 0.136231 Aug 24 02:11:12.907999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3350/4342] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:12 2022] GET /compute/v2.1/os-volumes/ca51604a-7f0f-4529-92f9-1dc6c73428aa => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:12.939410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:12.943143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:12.960072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:12.962227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:12.967575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:12.970606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:12.972626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:12.977263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:13.406025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:13.420219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb6bbbac-d9ed-4f35-92a1-5a5f5b22f6cc tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.509587 Aug 24 02:11:13.425099 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3351/4343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:12 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:13.435437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "name": "network-vif-deleted", "tag": "8703519c-9dc4-4a8f-b634-53a47d2a3fc8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:13.470372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:13.472350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:13.473677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:13.503436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] Creating event network-vif-deleted:8703519c-9dc4-4a8f-b634-53a47d2a3fc8 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:11:13.511036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f1191b3e-f7f1-4bcb-b394-bb4c0ee24eda req-d6e559a0-e266-428e-9039-3e60a813f419 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083591 Aug 24 02:11:13.512479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3352/4344] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:13.537142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:13.539312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:13.553358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:13.554139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:13.554847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:13.555910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:13.557707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:13.558476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:13.948037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:13.958201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f76de9e2-8228-4390-b817-40d9a932305a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.433801 Aug 24 02:11:13.960461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3353/4345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:13 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:13.984392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:13.986137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:13.996260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:13.997415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:13.998290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:13.999190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:13.999819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:14.001294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:14.115315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c67fbb100ca04eebbd3dd6bb40802561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7b8be3aa804069a0a9c7dc149dec3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:14.128349 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bcd5150-14ff-4037-b206-27a7fa56582d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 200 len: 1297 microversion: 2.1 time: 0.166587 Aug 24 02:11:14.143959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3354/4346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:13 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 1297 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:14.391999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d791a28-3b9e-4e98-9646-1cf79440fb48 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Action: 'create', calling method: .version_select at 0x7f6b911fb700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-384601843"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:14.951030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d791a28-3b9e-4e98-9646-1cf79440fb48 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.805811 Aug 24 02:11:14.965249 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3355/4347] 10.222.0.49 () {60 vars in 1155 bytes} [Wed Aug 24 02:11:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 821 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 02:11:14.977837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:14.978943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:14.999329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.000230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.001362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.003148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.004660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.006976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.219146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:15.236480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-720a3571-2c74-4ef6-b8e5-f9fde264eff7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.269650 Aug 24 02:11:15.237918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3356/4348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:14 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:15.245521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715b8c4f-61cc-43bb-b8a6-0c7a428c1526", "name": "network-vif-plugged", "status": "completed", "tag": "b24cf6ef-5eb0-486b-8f67-400a66e7407e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:15.272318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.272831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.273974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.305685 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] Creating event network-vif-plugged:b24cf6ef-5eb0-486b-8f67-400a66e7407e for instance 715b8c4f-61cc-43bb-b8a6-0c7a428c1526 on n-h2-854121-3 Aug 24 02:11:15.313132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d2d9997f-26b9-4bee-8ca6-fae72f8a795f req-9fe75ac2-c616-47b3-a4b0-e15a9221914c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073647 Aug 24 02:11:15.317204 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3357/4349] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:15.328287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b5cf8b1-9ed2-44c1-a6ad-958e780c2d1c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b9269be50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:15.462230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b5cf8b1-9ed2-44c1-a6ad-958e780c2d1c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 200 len: 344 microversion: 2.1 time: 0.143751 Aug 24 02:11:15.468285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3358/4350] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:15 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:15.468830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:15.471053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:15.483576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.484189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.485412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.491305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.492213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.495432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.703000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:15.711684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-512f39a1-92bd-451d-a922-883295221e57 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.247455 Aug 24 02:11:15.725883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3359/4351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:15 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:15.747659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:15.752054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:15.767852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.773549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.774278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.775910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.777535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.786076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.793061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:15.814261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c HTTP/1.1 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8a5f7397-68c3-46d3-a92d-9aa05e2c504c'} Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:15.820434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:15.824867 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:15.828699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:15.832377 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58217c2e-47d0-4d1c-89da-e6c09e234fc0 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 404 len: 111 microversion: 2.1 time: 0.105343 Aug 24 02:11:15.833569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3360/4352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:15 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:15.848466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a5f7397-68c3-46d3-a92d-9aa05e2c504c", "name": "network-vif-deleted", "tag": "6aa4e72b-31ca-48be-9634-e6e7b5e75ad7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:15.877817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:15.878499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:15.879464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:15.921369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] Creating event network-vif-deleted:6aa4e72b-31ca-48be-9634-e6e7b5e75ad7 for instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c on n-h1-854121-3 Aug 24 02:11:15.928917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-12e825e4-73a6-4381-b107-89bcf131ed0e req-13635e0e-a22e-42c2-8e2e-19ec7e1a0f3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091323 Aug 24 02:11:15.929847 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3361/4353] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:15.937534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7814181-3b1b-4b6b-8568-f5b2d2e39b04 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b91760b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:16.039513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7814181-3b1b-4b6b-8568-f5b2d2e39b04 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/423337d2-1946-43f0-ae76-2f404c6dd5ee" status: 200 len: 350 microversion: 2.1 time: 0.108310 Aug 24 02:11:16.041042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3362/4354] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:15 2022] GET /compute/v2.1/os-volumes/423337d2-1946-43f0-ae76-2f404c6dd5ee => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:16.260013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:16.260967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:16.288252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:16.290026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:16.293440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:16.297313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:16.297822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:16.298272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:16.691012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:16.700142 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-324bde20-8a26-4334-9bde-efdef3a3c8f1 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.445684 Aug 24 02:11:16.701852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3363/4355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:16 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:16.707415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ff27521-64d8-4a8d-979a-a845068e0880 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b91869280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:16.836206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ff27521-64d8-4a8d-979a-a845068e0880 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 200 len: 345 microversion: 2.1 time: 0.132897 Aug 24 02:11:16.836812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3364/4356] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:16 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:16.841514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:16.842132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:16.850650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:16.851296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:16.851745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:16.852459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:16.852949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:16.853379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:17.272245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:17.285266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af4264c1-2816-4395-8c3b-6d0ad6c32c0c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1319 microversion: 2.1 time: 0.447250 Aug 24 02:11:17.286288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3365/4357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:16 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:17.305336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c117b1a2-def6-401a-8256-328001728309 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Action: 'create', calling method: .version_select at 0x7f6b912de430>, body: {"snapshot": {"volume_id": "2144b5bc-68d8-4008-a22a-213bd6acab03", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1126372332"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:17.739591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c117b1a2-def6-401a-8256-328001728309 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.452039 Aug 24 02:11:17.743462 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3366/4358] 10.222.0.49 () {60 vars in 1162 bytes} [Wed Aug 24 02:11:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:17.748551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:17.757641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:17.784672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:17.788503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:17.791654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:17.797166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:17.797742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:17.798208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:18.148535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:18.171263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fe239e7-de94-45cf-87e6-9589433e4203 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.419905 Aug 24 02:11:18.175501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3367/4359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:17 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:18.203453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ef4f1fa-df81-4e7e-a143-a24205bf3699 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b911fb280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:18.395905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ef4f1fa-df81-4e7e-a143-a24205bf3699 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 200 len: 287 microversion: 2.1 time: 0.216593 Aug 24 02:11:18.397580 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3368/4360] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:11:18 2022] GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 287 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:18.409059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:18.410480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:18.424513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:18.426815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:18.427595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:18.429255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:18.432705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:18.433451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:19.102911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:19.116119 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-072deb69-903f-4d7f-af24-0ecfe962d3e9 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 200 len: 1508 microversion: 2.1 time: 0.716723 Aug 24 02:11:19.133447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3369/4361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:18 2022] GET /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:19.145070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f55875b3-74de-49f2-98a1-f317dcfb7d2e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b919008b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:19.258137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f55875b3-74de-49f2-98a1-f317dcfb7d2e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.123471 Aug 24 02:11:19.258804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3370/4362] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 02:11:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:19.269107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c9ad97c-859a-489b-8514-00633bb61310 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b917b2ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:19.334604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c9ad97c-859a-489b-8514-00633bb61310 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/c84c72be-1c57-49e3-b85a-f552fe3674b0" status: 200 len: 351 microversion: 2.1 time: 0.073914 Aug 24 02:11:19.334873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3371/4363] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:19 2022] GET /compute/v2.1/os-volumes/c84c72be-1c57-49e3-b85a-f552fe3674b0 => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:19.334873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:19.334873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 7ef11833-26ad-4128-8704-fb020023d7e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:19.368494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:19.369251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:19.369461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:19.370189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:19.370657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:19.371145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:19.637815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:19.651532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af3ece4f-2391-4ad2-b7b7-e331a83eb332 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/7ef11833-26ad-4128-8704-fb020023d7e6" status: 200 len: 1507 microversion: 2.1 time: 0.315145 Aug 24 02:11:19.664309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3372/4364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:19 2022] GET /compute/v2.1/servers/7ef11833-26ad-4128-8704-fb020023d7e6 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:19.664309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:19.664309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:19.671691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:19.671691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:19.673117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:19.673117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:19.673525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:19.673997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.075462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:20.103611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ccaa09d-0464-4ad2-92a9-6318122ad674 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1485 microversion: 2.1 time: 0.450180 Aug 24 02:11:20.113893 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3373/4365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:19 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1485 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:20.128827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20a4f931-29f5-4645-b22d-2400cf83d439 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b916abee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.178002 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20a4f931-29f5-4645-b22d-2400cf83d439 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 200 len: 287 microversion: 2.1 time: 0.054011 Aug 24 02:11:20.185414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3374/4366] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:11:20 2022] GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:20.192486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6eb590f2-2db2-4d8f-a8d3-bb03bd09563f tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b91900550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.351992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6eb590f2-2db2-4d8f-a8d3-bb03bd09563f tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.163781 Aug 24 02:11:20.352937 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3375/4367] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 02:11:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:20.357741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.358454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 7ef11833-26ad-4128-8704-fb020023d7e6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:20.374224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.378179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.379545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.380839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.385347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.386119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.477163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 7ef11833-26ad-4128-8704-fb020023d7e6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:20.581421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-187b0f7d-16aa-4e33-88ee-1802428972a5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7ef11833-26ad-4128-8704-fb020023d7e6" status: 204 len: 0 microversion: 2.1 time: 0.227146 Aug 24 02:11:20.582552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3376/4368] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:20 2022] DELETE /compute/v2.1/servers/7ef11833-26ad-4128-8704-fb020023d7e6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:20.593939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.595383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:20.621745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.623385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.623385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.623385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.623767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.624426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.641970 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c HTTP/1.1 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8a5f7397-68c3-46d3-a92d-9aa05e2c504c'} Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:20.644319 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddc71dcf-f8dc-4fb6-bed4-2f46fb4f147d tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 404 len: 111 microversion: 2.1 time: 0.058866 Aug 24 02:11:20.648028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3377/4369] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:20 2022] DELETE /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:20.651487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:20.652084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:20.662715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.663214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.663656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.664836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.665020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.669453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.805710 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efe141da-febb-4180-a925-bddb0a0afd96 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "POST /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619/action" status: 202 len: 0 microversion: 2.1 time: 0.157667 Aug 24 02:11:20.807364 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3378/4370] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:11:20 2022] POST /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:11:20.812336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a1c41cc-c3d3-4cb7-b3ae-a6366160562d tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b91232310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.901436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a1c41cc-c3d3-4cb7-b3ae-a6366160562d tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093819 Aug 24 02:11:20.902093 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3379/4371] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:11:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:20.906691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:20.907454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:20.917963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.918456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.918897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.919607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:20.920183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:20.920617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:20.947531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 715b8c4f-61cc-43bb-b8a6-0c7a428c1526] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:21.039986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-223d1585-fe63-48b5-bb6d-557c6986e240 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "DELETE /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526" status: 204 len: 0 microversion: 2.1 time: 0.135831 Aug 24 02:11:21.041166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3380/4372] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:20 2022] DELETE /compute/v2.1/servers/715b8c4f-61cc-43bb-b8a6-0c7a428c1526 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:21.046697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:21.051924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 8a5f7397-68c3-46d3-a92d-9aa05e2c504c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:21.061450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.062138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.062775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.069760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.070417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.071004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.089862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c HTTP/1.1 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '8a5f7397-68c3-46d3-a92d-9aa05e2c504c'} Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:21.091807 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. Aug 24 02:11:21.096148 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.098095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 8a5f7397-68c3-46d3-a92d-9aa05e2c504c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:21.099208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3086919-5055-459f-8183-bcd28e7f8175 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c" status: 404 len: 111 microversion: 2.1 time: 0.056529 Aug 24 02:11:21.102902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3381/4373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:21 2022] GET /compute/v2.1/servers/8a5f7397-68c3-46d3-a92d-9aa05e2c504c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:21.107628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:21.108507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:21.115242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.116024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.117002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.117938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.118621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.119812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.318357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:21.326683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6f34d5e-5935-4317-9833-859921177f7f tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1493 microversion: 2.1 time: 0.222771 Aug 24 02:11:21.342746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3382/4374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:21 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:21.348205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58cf3024-099b-43ce-8a04-e90c668e2493 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b90eace50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:21.446615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58cf3024-099b-43ce-8a04-e90c668e2493 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102354 Aug 24 02:11:21.447676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3383/4375] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 02:11:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:21.454645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:21.456958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:21.469645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.470394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.471094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.472023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:21.472875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:21.474053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:21.499763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 HTTP/1.1 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9f51889a-a5ac-4eed-905a-e61e715714f2'} Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:21.503363 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:21.507250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdeb9aa3-b230-4895-987d-07952110b6ce tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 404 len: 111 microversion: 2.1 time: 0.056949 Aug 24 02:11:21.511254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3384/4376] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:21 2022] DELETE /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:21.516349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4ab68ac-3e2e-4a75-b6f5-ae21cbd58619 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b919001f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:21.559587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4ab68ac-3e2e-4a75-b6f5-ae21cbd58619 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 200 len: 288 microversion: 2.1 time: 0.047140 Aug 24 02:11:21.560271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3385/4377] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:11:21 2022] GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:21.565931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-732356320", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8d400eea-bf97-4d4b-bff4-716e4328458b"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:21.653563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] validate_networks() for [('8d400eea-bf97-4d4b-bff4-716e4328458b', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:11:22.255174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:11:22.255855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:11:22.256422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:11:22.257085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:11:22.257377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:11:22.270879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.271672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.272338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.273330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.277350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.277807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.297068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Getting quotas for project 810db131a600433dadc3c66ec940b9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:11:22.302482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Getting quotas for user 69c66a3c94544dc896ceb361ac15831c and project 810db131a600433dadc3c66ec940b9a3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:11:22.315166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Going to run 2 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:11:22.317513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:11:22.348708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:22.360973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=53d20502-9eff-4f98-906c-23e7613bd8b5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:11:22.446557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4852f6f-dc27-4213-aad6-6b6be3325d23 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.885327 Aug 24 02:11:22.447404 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3386/4378] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:11:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 24 02:11:22.452405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02a395ca-f085-40da-938a-823b21ef86c8 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b9183baf0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:22.621867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02a395ca-f085-40da-938a-823b21ef86c8 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.173103 Aug 24 02:11:22.631295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3387/4379] 10.222.0.49 () {58 vars in 1167 bytes} [Wed Aug 24 02:11:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:22.631295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:22.631295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] [instance: 9f51889a-a5ac-4eed-905a-e61e715714f2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:22.637749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.638231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.638668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.639511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.639818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.640283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.659051 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] HTTP exception thrown: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Request method failure captured: Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 HTTP/1.1 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhejv0R9dCIrQeq0PU3t4T6chzPe2dL6uI2L5Jh-e7U48GzIbibeURVshoVhfvRrSbV4AS9NzKwVWDjRMxFYHa9KUOjG6kioXRdvoE1izMMb8P8rAUW-AlJlOg4RfwG4f4N5NcV0IdV8HnG1vG1OIv84ddAWqf92eyeyrsq5aKmjF8 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8d7b8be3aa804069a0a9c7dc149dec3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8d7b8be3aa804069a0a9c7dc149dec3d Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersTestMultiNic-1128787686 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: c67fbb100ca04eebbd3dd6bb40802561 Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersTestMultiNic-1128787686-project Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9f51889a-a5ac-4eed-905a-e61e715714f2'} Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:22.660624 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] Returning 404 to user: Instance 9f51889a-a5ac-4eed-905a-e61e715714f2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0697b9f-d5fa-4a4a-aed9-26d7c0641ab2 tempest-ServersTestMultiNic-1128787686 tempest-ServersTestMultiNic-1128787686-project] 10.222.0.49 "GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2" status: 404 len: 111 microversion: 2.1 time: 0.038260 Aug 24 02:11:22.664326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3388/4380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:22 2022] GET /compute/v2.1/servers/9f51889a-a5ac-4eed-905a-e61e715714f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:22.667767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fdfcf1e-4912-4522-88ac-f3597683c280 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b92052a60>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:22.824736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fdfcf1e-4912-4522-88ac-f3597683c280 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 202 len: 0 microversion: 2.1 time: 0.156191 Aug 24 02:11:22.825671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3389/4381] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 24 02:11:22 2022] DELETE /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:11:22.833656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:22.834802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:22.858190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.859602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.859602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.860016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:22.860333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:22.860868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:22.879726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:23.507765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:23.532206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0675401-f96a-4c0c-a26e-7740d5584a11 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1493 microversion: 2.1 time: 0.704994 Aug 24 02:11:23.533926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3390/4382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:22 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1493 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:23.567440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:23.584589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:23.585625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Searching by: {'deleted': False, 'project_id': '810db131a600433dadc3c66ec940b9a3'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:11:23.620822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:23.625457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:23.626229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:23.627285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:23.627950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:23.630552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:23.688591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:11:23.801428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9f956ad-2f4b-4841-8ec2-ec8aad2d3be7 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.249440 Aug 24 02:11:23.806698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3391/4383] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 02:11:23 2022] GET /compute/v2.1/servers => generated 1333 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:23.820867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1035c9c-b53e-45ed-a4b3-3a0e143e8542 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b912def70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:24.075392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1035c9c-b53e-45ed-a4b3-3a0e143e8542 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.263450 Aug 24 02:11:24.076481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3392/4384] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 02:11:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:24.081699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8945e4a5-75b9-4b7f-ad06-4237e0bfc5b1 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b91519b80>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:24.146018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8945e4a5-75b9-4b7f-ad06-4237e0bfc5b1 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 200 len: 287 microversion: 2.1 time: 0.068431 Aug 24 02:11:24.147726 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3393/4385] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:11:24 2022] GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:24.154265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce7ff74d-0318-4205-abbd-2a1dc37cdd35 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:24.157834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce7ff74d-0318-4205-abbd-2a1dc37cdd35 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:24.540009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce7ff74d-0318-4205-abbd-2a1dc37cdd35 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:24.554902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce7ff74d-0318-4205-abbd-2a1dc37cdd35 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1217 microversion: 2.1 time: 0.404537 Aug 24 02:11:24.562752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3394/4386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:24 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1217 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:24.574445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1064de7-b665-48bc-9ccb-3707015facb3 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b924ba5e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:24.784324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1064de7-b665-48bc-9ccb-3707015facb3 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.220008 Aug 24 02:11:24.785091 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3395/4387] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 02:11:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:24.963037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715b8c4f-61cc-43bb-b8a6-0c7a428c1526", "name": "network-vif-deleted", "tag": "b24cf6ef-5eb0-486b-8f67-400a66e7407e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:24.985588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:24.986472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:24.987144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:25.000637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] Creating event network-vif-deleted:b24cf6ef-5eb0-486b-8f67-400a66e7407e for instance 715b8c4f-61cc-43bb-b8a6-0c7a428c1526 on n-h2-854121-3 Aug 24 02:11:25.009199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fbeafc42-4410-492e-b929-655e7bac68c5 req-6c2bd94e-c1dd-451b-980b-fe8a3e2fba34 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222410 Aug 24 02:11:25.015080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3396/4388] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:25.021679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:25.022743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:25.029610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:25.031892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:25.032655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:25.034186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:25.034898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:25.036117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:25.189015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:25.201839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50eeb788-ddac-455c-bf2d-2173ee533b48 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1493 microversion: 2.1 time: 0.184401 Aug 24 02:11:25.203046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3397/4389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:25 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1493 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:25.219787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4392af7c-2afc-4993-bb69-16ce0414f11a tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b924bac10>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:25.726627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4392af7c-2afc-4993-bb69-16ce0414f11a tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.521970 Aug 24 02:11:25.727217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3398/4390] 10.222.0.49 () {58 vars in 1188 bytes} [Wed Aug 24 02:11:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:25.891173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ef11833-26ad-4128-8704-fb020023d7e6", "name": "network-vif-deleted", "tag": "d7dc6da9-6661-450f-a724-c4a38eb24561"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:25.910447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:25.916453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:25.927069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:25.940053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] Creating event network-vif-deleted:d7dc6da9-6661-450f-a724-c4a38eb24561 for instance 7ef11833-26ad-4128-8704-fb020023d7e6 on n-h1-854121-3 Aug 24 02:11:25.958538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-decdb9fb-c181-42b8-9082-7a97f4d4e01c req-07614100-2b9c-4e7e-a891-3a77882338ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229693 Aug 24 02:11:25.959398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3399/4391] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:25.968197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25926a79-6a1f-42ea-b78c-821e30e0d6fa tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b924513a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:26.029939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-25926a79-6a1f-42ea-b78c-821e30e0d6fa tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] HTTP exception thrown: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25926a79-6a1f-42ea-b78c-821e30e0d6fa tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Request method failure captured: Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 HTTP/1.1 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjBC7F-6RTuhCsXgcJGAtAEsPUugo-6Uwgd4-_hLJ-Fi_saAxoGPfIPRkcRKvRZrZJKUB9CSYvCDyMeiY1HJmbUuiLrdta7jQJOnx-JkB0wc4fW1r1gu1Yj-GfV74jjgdodU8LKNTCFpqcRHD7QgJcL6TukXdY4UTFZdqtY05Yx_HU Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2afe574987614060b01f7f060ace15c8 Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: exception: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2666cd3d-6f22-48a0-b7ed-a51584bf95f7'} Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. (HTTP 404) (Request-ID: req-cb07ba7e-18f2-4059-a448-2f929e1c9fa7) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:11:26.042585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25926a79-6a1f-42ea-b78c-821e30e0d6fa tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Returning 404 to user: Snapshot 2666cd3d-6f22-48a0-b7ed-a51584bf95f7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:26.047062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25926a79-6a1f-42ea-b78c-821e30e0d6fa tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7" status: 404 len: 111 microversion: 2.1 time: 0.086324 Aug 24 02:11:26.054284 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3400/4392] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:11:25 2022] GET /compute/v2.1/os-snapshots/2666cd3d-6f22-48a0-b7ed-a51584bf95f7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:26.068128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:26.068934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:26.083577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:26.084079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:26.089891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:26.091563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:26.092063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:26.092512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:26.291755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:26.306251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30d823be-bf0f-436b-92e3-2e8fde141475 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1269 microversion: 2.1 time: 0.250765 Aug 24 02:11:26.308828 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3401/4393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:26 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1269 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:26.320642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afbeacf2-0682-472d-821d-9a56e9e26f88 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] Calling method '.version_select at 0x7f6b92a004c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:26.433367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afbeacf2-0682-472d-821d-9a56e9e26f88 tempest-VolumesTestJSON-1396849858 tempest-VolumesTestJSON-1396849858-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.123360 Aug 24 02:11:26.433948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3402/4394] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 02:11:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:26.439011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f81e7351-4455-495a-adf2-488705ae79b9 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b918698b0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:26.589751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f81e7351-4455-495a-adf2-488705ae79b9 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 202 len: 0 microversion: 2.1 time: 0.154371 Aug 24 02:11:26.591042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3403/4395] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:11:26 2022] DELETE /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:11:26.597635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:26.598458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:26.637736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:26.638535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:26.640913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:26.643360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:26.645347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:26.645954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.293776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:27.309044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a6cd0ca-5e28-4253-b0ce-d538f5b375bd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1499 microversion: 2.1 time: 0.712654 Aug 24 02:11:27.310126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3404/4396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:26 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1499 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:27.320384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64e97ace-db4b-411d-bec8-adae2ec17eb1 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b912de430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:27.438014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64e97ace-db4b-411d-bec8-adae2ec17eb1 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 200 len: 344 microversion: 2.1 time: 0.126607 Aug 24 02:11:27.439302 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3405/4397] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:27 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:27.446362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:27.447924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:27.459274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.460487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.461145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.462771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.463394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.464803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.569923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:27.581958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7435546a-26d2-4d73-a182-f390dbd76003 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1275 microversion: 2.1 time: 0.140913 Aug 24 02:11:27.582560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3406/4398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:27 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:27.588369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:27.589171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:27.596775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.597585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.598196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.599137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.600570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.601428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.639120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:27.817845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-480c91ee-1ac9-4f50-8b1a-0dae8cb3093e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "DELETE /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 204 len: 0 microversion: 2.1 time: 0.233403 Aug 24 02:11:27.820769 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3407/4399] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:27 2022] DELETE /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:27.827047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:27.827764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:27.842248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.842754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.849372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:27.850233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:27.850924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:27.851372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:28.828215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:28.842400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a0564d1-9373-43da-b30d-28f13f360771 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 1.019046 Aug 24 02:11:28.845772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3408/4400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:27 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:28.856473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:28.872159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:28.892939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:28.893739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:28.895888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:28.898056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:28.903555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:28.904340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:28.961192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ce40b31-288d-4718-83a5-ab9e5bdf9cbe tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/ips" status: 200 len: 149 microversion: 2.1 time: 0.113888 Aug 24 02:11:28.962046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3409/4401] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:11:28 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/ips => generated 149 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:28.975235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a55f129-7761-4dc5-b08f-b8b9d58225c6 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b91f94670>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:29.060671 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a55f129-7761-4dc5-b08f-b8b9d58225c6 tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 200 len: 344 microversion: 2.1 time: 0.094352 Aug 24 02:11:29.061951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3410/4402] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:28 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:29.067556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:29.069557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:29.087736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:29.090340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:29.090981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:29.099192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:29.099689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:29.100135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:29.614014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:29.645285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a25ef2ad-9057-4058-99db-3d716439690a tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1275 microversion: 2.1 time: 0.581042 Aug 24 02:11:29.645820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3411/4403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:29 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1275 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:29.864222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:29.864898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:29.874086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:29.880076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:29.880552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:29.887726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:29.888260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:29.888746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:30.627303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:30.649890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95b6ac8d-27b6-411b-8370-3b39eccf2756 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 0.781883 Aug 24 02:11:30.652892 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3412/4404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:29 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:30.673406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4abb80d6-755e-4c8e-a702-ef20d2e8d7ae tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b92451dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:30.853362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4abb80d6-755e-4c8e-a702-ef20d2e8d7ae tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 200 len: 344 microversion: 2.1 time: 0.191251 Aug 24 02:11:30.854246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3413/4405] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:30 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:30.860560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:30.861368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:30.891660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:30.899216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:30.903119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:30.905435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:30.906824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:30.909043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:31.680487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:31.706480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a7e8f77-04b4-4e7d-8ecc-91c1f2669023 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.850830 Aug 24 02:11:31.721838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3414/4406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:30 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:31.730763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:31.749096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:31.781926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:31.793471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:31.795365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:31.797509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:31.800568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:31.806505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:33.191619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:33.216190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11e4236c-c599-46cc-bea1-8aa7ca09a4cd tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 200 len: 1505 microversion: 2.1 time: 1.489988 Aug 24 02:11:33.217066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3415/4407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:31 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 1505 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:33.249826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d90ef3e9-d312-4e5c-8a4b-737da74df35e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b9249ed30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:33.326257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d90ef3e9-d312-4e5c-8a4b-737da74df35e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] HTTP exception thrown: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d90ef3e9-d312-4e5c-8a4b-737da74df35e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Request method failure captured: Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 HTTP/1.1 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjBC7F-6RTuhCsXgcJGAtAEsPUugo-6Uwgd4-_hLJ-Fi_saAxoGPfIPRkcRKvRZrZJKUB9CSYvCDyMeiY1HJmbUuiLrdta7jQJOnx-JkB0wc4fW1r1gu1Yj-GfV74jjgdodU8LKNTCFpqcRHD7QgJcL6TukXdY4UTFZdqtY05Yx_HU Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2afe574987614060b01f7f060ace15c8 Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2144b5bc-68d8-4008-a22a-213bd6acab03'} Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. (HTTP 404) (Request-ID: req-f5f563ec-ce06-4f75-a197-6459f8b66ef2) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:11:33.328531 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:33.333162 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:33.339179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d90ef3e9-d312-4e5c-8a4b-737da74df35e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Returning 404 to user: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:33.340306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d90ef3e9-d312-4e5c-8a4b-737da74df35e tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 404 len: 109 microversion: 2.1 time: 0.119344 Aug 24 02:11:33.341571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3416/4408] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:33 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:33.353009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:33.360339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:33.382550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:33.383355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:33.384138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:33.385242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:33.385990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:33.386671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:33.661001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:34.469230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:34.483976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93c92683-1e10-48d1-a5c9-e5c98d3f8fdb tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 1.141005 Aug 24 02:11:34.487126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3417/4409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:33 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:34.502480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ba9944a-0e80-462a-b64f-11da0d14d0b6"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:34.517782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:34.531792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:34.534558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:34.536017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:34.538211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:34.539861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:34.541274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:34.555748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:34.618041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:35.142928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35a0a17e-8791-4390-a2d5-ce88b4915863 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "POST /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.652972 Aug 24 02:11:35.146901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3418/4410] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:11:34 2022] POST /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:35.165767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900e8375-4a6a-420c-b92d-ace512602619", "name": "network-vif-deleted", "tag": "2ffe3697-174c-4a1e-993c-32baa8969297"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:35.198727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.200842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.201366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.248971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] Creating event network-vif-deleted:2ffe3697-174c-4a1e-993c-32baa8969297 for instance 900e8375-4a6a-420c-b92d-ace512602619 on n-h1-854121-3 Aug 24 02:11:35.264249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e9fe5843-2038-4242-a9e3-05228569fe2a req-08304182-fa68-48e0-9f80-38e7837f6d80 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114273 Aug 24 02:11:35.266438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3419/4411] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:35.279370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d387b48d-7b6b-4b35-bfbe-09d7738fff4c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b91953f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:35.340779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d387b48d-7b6b-4b35-bfbe-09d7738fff4c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] HTTP exception thrown: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d387b48d-7b6b-4b35-bfbe-09d7738fff4c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Request method failure captured: Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 HTTP/1.1 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjBC7F-6RTuhCsXgcJGAtAEsPUugo-6Uwgd4-_hLJ-Fi_saAxoGPfIPRkcRKvRZrZJKUB9CSYvCDyMeiY1HJmbUuiLrdta7jQJOnx-JkB0wc4fW1r1gu1Yj-GfV74jjgdodU8LKNTCFpqcRHD7QgJcL6TukXdY4UTFZdqtY05Yx_HU Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2afe574987614060b01f7f060ace15c8 Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2144b5bc-68d8-4008-a22a-213bd6acab03'} Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. (HTTP 404) (Request-ID: req-64c59130-898a-4c05-8902-0ecc782244ab) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:11:35.343580 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.347768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.351082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d387b48d-7b6b-4b35-bfbe-09d7738fff4c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Returning 404 to user: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:35.351952 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d387b48d-7b6b-4b35-bfbe-09d7738fff4c tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 404 len: 109 microversion: 2.1 time: 0.084152 Aug 24 02:11:35.360369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3420/4412] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:11:35 2022] DELETE /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:35.379658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:35.381599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 900e8375-4a6a-420c-b92d-ace512602619] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:35.400659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.404703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.406133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.406885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.407353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.408473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.443659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] HTTP exception thrown: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Request method failure captured: Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 HTTP/1.1 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhR9SQMfwQD_J4OvoQh1mBpHRE7YvFLr3t-JULjruNzzPDuvYumr0lpp5uHNqMBc1lmo6CfZAgUec3DnHpzy4AuoNqCtkskIIZZ5x_iW5CzR2JezZsKujrpIqBFsTuH3uYzN0XbyA9f08MaldulGKxtOR_nFFvaioNA9iIAS8J1JiU Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b2ea2738dc514d189bf2f7d3f4b674c6 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b2ea2738dc514d189bf2f7d3f4b674c6 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueTestJSON-1123571061-project Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 10799223b6654cecb8746dfb68c73455 Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueTestJSON-1123571061-project Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '900e8375-4a6a-420c-b92d-ace512602619'} Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.445842 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. Aug 24 02:11:35.450044 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.453348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Returning 404 to user: Instance 900e8375-4a6a-420c-b92d-ace512602619 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:35.454654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8339a045-10c9-4cf2-8e37-b1ac56b52e7e tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619" status: 404 len: 111 microversion: 2.1 time: 0.092100 Aug 24 02:11:35.458567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3421/4413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:35 2022] GET /compute/v2.1/servers/900e8375-4a6a-420c-b92d-ace512602619 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:35.463672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43f6e673-c4ea-4b41-a488-81d447ae0f66", "tag": "eec58b56-d553-4e65-bbcc-a8092d54fba8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:35.487880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.488446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.488811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.519553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] Creating event network-changed:eec58b56-d553-4e65-bbcc-a8092d54fba8 for instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 on n-h1-854121-3 Aug 24 02:11:35.527779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9e002cd6-28c3-4c99-96e2-d9d72e891966 req-4c5d36d7-8598-4bbf-ab0e-2d4834eb52fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067919 Aug 24 02:11:35.528393 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3422/4414] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:35.542517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b658cd3b-4c80-45c9-9377-0c0bf4f2da5a tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Calling method '.version_select at 0x7f6b91953f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:35.622055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b658cd3b-4c80-45c9-9377-0c0bf4f2da5a tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] HTTP exception thrown: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b658cd3b-4c80-45c9-9377-0c0bf4f2da5a tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Request method failure captured: Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 HTTP/1.1 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjBC7F-6RTuhCsXgcJGAtAEsPUugo-6Uwgd4-_hLJ-Fi_saAxoGPfIPRkcRKvRZrZJKUB9CSYvCDyMeiY1HJmbUuiLrdta7jQJOnx-JkB0wc4fW1r1gu1Yj-GfV74jjgdodU8LKNTCFpqcRHD7QgJcL6TukXdY4UTFZdqtY05Yx_HU Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d2dcee8926b4645ab760ff965501aa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7d2dcee8926b4645ab760ff965501aa7 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1684163687 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2afe574987614060b01f7f060ace15c8 Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1684163687-project Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2144b5bc-68d8-4008-a22a-213bd6acab03'} Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. (HTTP 404) (Request-ID: req-ec5b3864-e4b6-4617-ab96-f861465cf905) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:11:35.624112 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b658cd3b-4c80-45c9-9377-0c0bf4f2da5a tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] Returning 404 to user: Volume 2144b5bc-68d8-4008-a22a-213bd6acab03 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:35.627815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b658cd3b-4c80-45c9-9377-0c0bf4f2da5a tempest-VolumesSnapshotsTestJSON-1684163687 tempest-VolumesSnapshotsTestJSON-1684163687-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03" status: 404 len: 109 microversion: 2.1 time: 0.096030 Aug 24 02:11:35.635871 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3423/4415] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:11:35 2022] GET /compute/v2.1/os-volumes/2144b5bc-68d8-4008-a22a-213bd6acab03 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:35.647200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:35.647840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:35.660305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.665866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.666469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.667214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:35.667684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:35.668114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:35.743633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:36.011106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c1e04c2-8821-4054-8c5e-eea6546a5c79 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 204 len: 0 microversion: 2.1 time: 0.373575 Aug 24 02:11:36.013959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3424/4416] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:35 2022] DELETE /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:36.026976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:36.027691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:36.039196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:36.039814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:36.040258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:36.040991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:36.041445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:36.041871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:36.755138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:36.767433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c697b9a-ead4-4556-a68a-962f958aab54 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.750877 Aug 24 02:11:36.770030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3425/4417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:36 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:36.775955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:36.776968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:36.788137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:36.793502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:36.794518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:36.800202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:36.801063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:36.801784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:37.340212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:37.354379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09c8f1a4-8a6f-43d7-bcc6-f0274029c2d7 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1492 microversion: 2.1 time: 0.582170 Aug 24 02:11:37.359215 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3426/4418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:36 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1492 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:37.364223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d20502-9eff-4f98-906c-23e7613bd8b5", "tag": "cfd43c41-b191-4a0d-bfd6-2e198c92526b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:37.396433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:37.403198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:37.405234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:37.443088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] Creating event network-changed:cfd43c41-b191-4a0d-bfd6-2e198c92526b for instance 53d20502-9eff-4f98-906c-23e7613bd8b5 on n-h2-854121-3 Aug 24 02:11:37.465712 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8534817b-e68a-4239-b941-5cf233c3fb43 req-dd693e33-5efb-4832-96f3-2e6d5404869c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105109 Aug 24 02:11:37.468740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3427/4419] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:11:37.792177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:37.793090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:37.805245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:37.816148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:37.825488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:37.826432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:37.827190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:37.827860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:38.230864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:38.241550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec73bd33-49ab-463c-b18c-9e67b3487712 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.453673 Aug 24 02:11:38.261003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3428/4420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:37 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:38.382201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:38.382995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:38.396923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:38.398228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:38.399285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:38.400274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:38.401964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:38.402581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:38.977169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:38.990967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2af2699d-7032-48c9-a880-f5ec33718aa0 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1492 microversion: 2.1 time: 0.612770 Aug 24 02:11:39.006091 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3429/4421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:38 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1492 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:39.266090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:39.267484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:39.283989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:39.286042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:39.292926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:39.292926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:39.292926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:39.296167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:39.757402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:39.768886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-923dee1d-2793-4f05-9fc3-4d9929b6feca tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.506612 Aug 24 02:11:39.769965 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3430/4422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:39 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:40.018227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:40.019508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:40.032124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:40.033801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:40.036450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:40.038942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:40.039648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:40.040294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:41.083623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:41.102649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-691d5335-ad70-4430-9978-a7dc35c3999d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1492 microversion: 2.1 time: 1.084689 Aug 24 02:11:41.113831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3431/4423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:40 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1492 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:41.140297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:41.142508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:41.166669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:41.169427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:41.169921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:41.184767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:41.187010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:41.191458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:41.889487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:41.909102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac793f3f-8e62-4f5d-b74c-f3ac5f2db73e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.785382 Aug 24 02:11:41.912874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3432/4424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:41 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:42.128157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:42.128800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:42.151605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:42.155336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:42.155946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:42.159083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:42.162852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:42.163442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:42.455935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:42.464444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07ad3ae1-7a63-4da2-b0f8-4b3543c36e5d tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1450 microversion: 2.1 time: 0.340680 Aug 24 02:11:42.465105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3433/4425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:42 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1450 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:42.848897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9", "name": "network-vif-deleted", "tag": "5333027d-661f-480e-b52e-85bbac69d2d0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:42.875320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:42.877589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:42.889815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:42.953814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] Creating event network-vif-deleted:5333027d-661f-480e-b52e-85bbac69d2d0 for instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 on n-h2-854121-3 Aug 24 02:11:42.963540 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e3e8301c-0978-43dc-a645-92f8c3fe792a req-a67bb20f-0686-4b96-bd3a-1cc4722340af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119498 Aug 24 02:11:42.973903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3434/4426] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:11:42.992454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:42.997302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:43.017801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:43.026515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:43.026990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:43.027757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:43.035450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:43.036022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:43.509452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:43.536676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36e64158-d558-4a86-b918-7b1a4ee2d540 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.560722 Aug 24 02:11:43.541601 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3435/4427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:42 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:43.557735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:43.562206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:43.592816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:43.593583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:43.596150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:43.598500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:43.599568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:43.600601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:43.685338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:43.692057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:43.695258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:43.701342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lazy-loading 'fault' on Instance uuid 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:11:43.856506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10799223b6654cecb8746dfb68c73455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ea2738dc514d189bf2f7d3f4b674c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:43.868204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33997442-78c5-4e26-885c-9748b6154094 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 200 len: 1304 microversion: 2.1 time: 0.323020 Aug 24 02:11:43.871824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3436/4428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:43 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 1304 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:44.565579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:44.567438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:44.592019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:44.597034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:44.599610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:44.603230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:44.604168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:44.608154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:44.615809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:45.307502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:45.332123 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb3fd926-e761-4af4-91b6-0f46fcbc986c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.765601 Aug 24 02:11:45.332788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3437/4429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:44 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:45.374593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:45.379480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] [instance: 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:45.403909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:45.405814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:45.407853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:45.412701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:45.413460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:45.416282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:45.455959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] HTTP exception thrown: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Request method failure captured: Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 HTTP/1.1 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYhR9SQMfwQD_J4OvoQh1mBpHRE7YvFLr3t-JULjruNzzPDuvYumr0lpp5uHNqMBc1lmo6CfZAgUec3DnHpzy4AuoNqCtkskIIZZ5x_iW5CzR2JezZsKujrpIqBFsTuH3uYzN0XbyA9f08MaldulGKxtOR_nFFvaioNA9iIAS8J1JiU Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b2ea2738dc514d189bf2f7d3f4b674c6 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b2ea2738dc514d189bf2f7d3f4b674c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b2ea2738dc514d189bf2f7d3f4b674c6 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueTestJSON-1123571061 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueTestJSON-1123571061-project Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 10799223b6654cecb8746dfb68c73455 Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueTestJSON-1123571061-project Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9'} Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:11:45.461349 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. Aug 24 02:11:45.465900 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:11:45.467487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] Returning 404 to user: Instance 3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:11:45.468686 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4024b195-aefe-4e42-af1c-123a52cb2930 tempest-ServerRescueTestJSON-1123571061 tempest-ServerRescueTestJSON-1123571061-project] 10.222.0.49 "GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9" status: 404 len: 111 microversion: 2.1 time: 0.127060 Aug 24 02:11:45.471244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3438/4430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:45 2022] GET /compute/v2.1/servers/3018eb2c-bd51-4ce5-9ad4-d8d31cf871d9 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:11:46.358470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:46.359149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:46.378205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:46.380113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:46.384923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:46.391145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:46.394558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:46.397773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:47.610089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:47.625670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8736c7d9-167f-4f5d-a845-2fcdd001916e tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 1.271776 Aug 24 02:11:47.629066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3439/4431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:46 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:48.444033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f6e673-c4ea-4b41-a488-81d447ae0f66", "name": "network-vif-plugged", "status": "completed", "tag": "eec58b56-d553-4e65-bbcc-a8092d54fba8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:48.469729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:48.470239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:48.470678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:48.507135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] Creating event network-vif-plugged:eec58b56-d553-4e65-bbcc-a8092d54fba8 for instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 on n-h1-854121-3 Aug 24 02:11:48.519106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f13faac1-bafc-4d60-818e-1067ecab166e req-090d7e39-d9ba-46a1-a676-605b0c394d30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579038 Aug 24 02:11:48.519998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3440/4432] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:11:48.652113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:48.653255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:48.666973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:11:48.679711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:48.681240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:48.684004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:48.685609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:48.687674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:48.688999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:49.059285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:49.069513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b778c366-51c4-4711-b466-f73de12bb25c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.425771 Aug 24 02:11:49.072511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3441/4433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:48 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:50.095177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:50.095797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:50.108130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:50.109841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:50.111173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:50.113522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:50.114609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:50.119364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:50.536261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:50.562933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20bdcb45-858e-40b1-859e-a42015d68147 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1317 microversion: 2.1 time: 0.469199 Aug 24 02:11:50.565530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3442/4434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:50 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:50.629978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d20502-9eff-4f98-906c-23e7613bd8b5", "name": "network-vif-plugged", "status": "completed", "tag": "cfd43c41-b191-4a0d-bfd6-2e198c92526b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:50.667265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:50.677214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:50.677733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:50.733430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] Creating event network-vif-plugged:cfd43c41-b191-4a0d-bfd6-2e198c92526b for instance 53d20502-9eff-4f98-906c-23e7613bd8b5 on n-h2-854121-3 Aug 24 02:11:50.764063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a9d49b29-fe24-452c-a511-7eeef7e1feae req-9c01a8f3-b959-432f-9f50-00aa2f80d0e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133779 Aug 24 02:11:50.765261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3443/4435] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:11:51.587974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:51.589878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:51.597622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:51.599238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:51.599916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:51.601114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:51.607149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:51.607998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:51.869441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:51.880092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35c3c274-5d46-49e6-8300-d53ca93b2ada tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1505 microversion: 2.1 time: 0.297547 Aug 24 02:11:51.880992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3444/4436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:51 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:51.919252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:51.920496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:51.944625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:51.947906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:51.950319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:51.952024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:51.956833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:51.958257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:52.355443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:52.370237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe2ddbc9-f1d2-459d-b205-e3ffdee2b8b5 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5" status: 200 len: 1317 microversion: 2.1 time: 0.458966 Aug 24 02:11:52.371456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3445/4437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:51 2022] GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:53.395146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:53.396055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:53.408472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:53.413928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:53.417842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:53.419109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:53.438775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:53.439601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:53.937151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:53.954628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbbffa03-3220-458b-8af1-18e40c467291 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5" status: 200 len: 1317 microversion: 2.1 time: 0.564672 Aug 24 02:11:53.961437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3446/4438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:53 2022] GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:11:54.984770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:54.985579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:55.000229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:55.001335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:55.001722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:55.013318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:55.013826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:55.014267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:55.486417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:55.498313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c07e25cf-1b72-470e-b2e7-3371e7e8e789 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5" status: 200 len: 1505 microversion: 2.1 time: 0.515939 Aug 24 02:11:55.512836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3447/4439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:11:54 2022] GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:11:55.551680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:55.561424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:55.571940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:55.572944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:55.575564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:55.582091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:55.584552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:55.587444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:55.640227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:55.814452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e83bdf9-2af6-4afd-9b97-5f38eee7a9ac tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "DELETE /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5" status: 204 len: 0 microversion: 2.1 time: 0.290856 Aug 24 02:11:55.815812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3448/4440] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:55 2022] DELETE /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:56.547083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-829333340", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "77b0af9d-3e1d-4cec-89af-f761e5bc545c"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:56.662476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] validate_networks() for [('77b0af9d-3e1d-4cec-89af-f761e5bc545c', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:11:58.004373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:11:58.005912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:11:58.006752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:11:58.007370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:11:58.009770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:11:58.034147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:58.035818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:58.038871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:58.040166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:58.041832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:58.043179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:58.098738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Getting quotas for project 835f2730d74640d0b56b42d941ef68c9. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:11:58.122739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Getting quotas for user 2a741253e62d4ce3a01f84b2490d9295 and project 835f2730d74640d0b56b42d941ef68c9. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:11:58.178528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:11:58.193242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:11:58.377508 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc7cb414-4c9b-45f7-84d8-1d58cd5558be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.560050 Aug 24 02:11:58.388385 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3449/4441] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:11:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:11:58.396572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:58.403116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:58.435378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:58.438322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:58.440057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:58.444847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:58.446505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:58.447114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:58.685176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'services' on Instance uuid 883f5bee-8c01-4701-9a3a-469c58e12b65 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:11:58.939796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b30eb9a-e1c8-4593-9d37-e9b0c25e1396 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments/6ba9944a-0e80-462a-b64f-11da0d14d0b6" status: 202 len: 0 microversion: 2.1 time: 0.553951 Aug 24 02:11:58.948957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3450/4442] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:11:58 2022] DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments/6ba9944a-0e80-462a-b64f-11da0d14d0b6 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:11:58.976455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:58.978732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:59.013241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:59.013930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:59.014179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:59.014905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:59.019300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:59.020348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:11:59.190656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:11:59.476364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90aa7219-aa26-4d8d-bd60-1cd2988ae76b tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "DELETE /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 204 len: 0 microversion: 2.1 time: 0.521444 Aug 24 02:11:59.482010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3451/4443] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:11:58 2022] DELETE /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:11:59.505287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:11:59.511506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:11:59.809746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:59.895740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:59.897653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:11:59.901965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7ed1c49-a59e-4861-a32b-131229a23d08 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1258 microversion: 2.21 time: 0.416854 Aug 24 02:11:59.907532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3452/4444] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:11:59 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1258 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:11:59.936536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d20502-9eff-4f98-906c-23e7613bd8b5", "name": "network-vif-deleted", "tag": "cfd43c41-b191-4a0d-bfd6-2e198c92526b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:11:59.988995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:11:59.989487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:11:59.989916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.030917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] Creating event network-vif-deleted:cfd43c41-b191-4a0d-bfd6-2e198c92526b for instance 53d20502-9eff-4f98-906c-23e7613bd8b5 on n-h2-854121-3 Aug 24 02:12:00.040368 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7ddf9eb1-f15f-4541-b111-adc508cefea1 req-ad2d64f7-245a-45f9-ab07-406395e4510d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126253 Aug 24 02:12:00.041002 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3453/4445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:00.062740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:00.065409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:00.080773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.084264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.086952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.089814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.090594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.091823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.099897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:00.215949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-766d494e-5798-4a8b-bd93-d247bce4ba3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157946 Aug 24 02:12:00.220028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3454/4446] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:00 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:00.233099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:00.241429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 53d20502-9eff-4f98-906c-23e7613bd8b5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:00.274532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.275790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.280644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.282236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.283590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.285249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.340801 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] HTTP exception thrown: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Request method failure captured: Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 HTTP/1.1 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYir3MqHLWx2kfTU0qF0BgERSdLPZLUzgNoCpuz75kc2L8xcxKWTGnCabIS85oLlF_EdaO5XPdkWHgCPeDNolfzmBSWQCzi1YghvzWhhi85ePOXXgyc3-_Y3EouHQgXLfydZiHpXaapcqWCcj2nzRyoAyc8BWE0MxomovOBk9pWdY24 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 810db131a600433dadc3c66ec940b9a3 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_810db131a600433dadc3c66ec940b9a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 810db131a600433dadc3c66ec940b9a3 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateTestJSON-1014499889-project Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 69c66a3c94544dc896ceb361ac15831c Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateTestJSON-1014499889-project Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '53d20502-9eff-4f98-906c-23e7613bd8b5'} Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:00.343366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. Aug 24 02:12:00.348215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:00.354035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Returning 404 to user: Instance 53d20502-9eff-4f98-906c-23e7613bd8b5 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:00.358294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f71baf08-5cba-42ef-92b9-010dbc7dba28 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5" status: 404 len: 111 microversion: 2.1 time: 0.135413 Aug 24 02:12:00.360891 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3455/4447] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:00 2022] GET /compute/v2.1/servers/53d20502-9eff-4f98-906c-23e7613bd8b5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:00.373963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:00.375213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:00.415746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.420704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.420704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:00.423178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:00.423988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:00.426293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:02.030041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:02.049062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbd05236-195c-4712-b981-66e8bf75cd74 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1511 microversion: 2.1 time: 1.683456 Aug 24 02:12:02.063110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3456/4448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:00 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1511 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:02.093181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:02.095948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:02.122609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:02.130718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:02.133722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:02.134590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:02.135127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:02.135567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:02.427948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:02.445895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:02.451969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:02.456487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c53a627-21a0-48d3-9334-507c25540a77 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1316 microversion: 2.21 time: 0.390566 Aug 24 02:12:02.460073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3457/4449] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:02 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:02.475249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:02.484187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:02.512648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:02.516837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:02.519955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:02.520961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:02.522286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:02.524578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:02.634657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2a46807-7091-4565-9a8a-b8894dcc71fb tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170404 Aug 24 02:12:02.639833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3458/4450] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:02 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:03.652926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2115361746", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:03.805650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:12:03.806597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:12:03.807334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:12:03.808039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:12:03.808751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:12:03.820266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:03.821551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:03.822201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:03.823318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:03.824573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:03.832058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:03.869851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Getting quotas for project b99e409a350449b19fb1aded78066a61. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:12:03.900735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Getting quotas for user 11e93bf87ff9446f80960befecbad111 and project b99e409a350449b19fb1aded78066a61. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:12:03.922641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:12:03.925705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:12:04.086949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-679e3d92-b636-433f-9c7d-be92afc36433 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.444545 Aug 24 02:12:04.087788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3459/4451] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:12:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:12:04.102147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:04.102791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:04.140742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.142259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.143018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.143780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.144288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.144748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.241302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.242846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.243479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.245380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lazy-loading 'fault' on Instance uuid 43f6e673-c4ea-4b41-a488-81d447ae0f66 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:12:04.369836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c66a3c94544dc896ceb361ac15831c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810db131a600433dadc3c66ec940b9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.379427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90652882-e065-44eb-bfb5-8e5764635e02 tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 200 len: 1307 microversion: 2.1 time: 0.290774 Aug 24 02:12:04.388110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3460/4452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:04 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:04.405006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:04.405671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:04.422665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.423166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.423602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.424314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.424780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.430197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.737158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.747211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.749031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.750967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ac7a9ee-5c2b-4ad4-9cec-1b41e13f1d6f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.361583 Aug 24 02:12:04.752016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3461/4453] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:04 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:04.757396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:04.759822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:04.767506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.768342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.768991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.769876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.770486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.771094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.809553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13c8fdf1-53fa-4d3e-bd23-99429afb7a3b tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055919 Aug 24 02:12:04.810706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3462/4454] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:04 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:04.816354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43f6e673-c4ea-4b41-a488-81d447ae0f66", "name": "network-vif-deleted", "tag": "eec58b56-d553-4e65-bbcc-a8092d54fba8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:04.827264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:04.828005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:04.829500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:04.841908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] Creating event network-vif-deleted:eec58b56-d553-4e65-bbcc-a8092d54fba8 for instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 on n-h1-854121-3 Aug 24 02:12:04.848766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a5f6d46f-6993-402a-9aad-9eb0a2d56f13 req-4defba2b-3ac7-4f18-b90c-5e1142e6816d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036513 Aug 24 02:12:04.849695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3463/4455] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:04.855453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:04.856835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:04.973398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.981863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.987487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:04.990321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b556c038-d00d-40dc-b5c7-a7076ccb2fe8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e" status: 200 len: 1278 microversion: 2.47 time: 0.139199 Aug 24 02:12:04.991925 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3464/4456] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:04 2022] GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:05.374265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1422678133", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "41a95d30-1c96-460d-904f-58e8b6582707"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:05.502635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] validate_networks() for [('41a95d30-1c96-460d-904f-58e8b6582707', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:12:06.461482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:12:06.462037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:12:06.462435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:12:06.462868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:12:06.463539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:12:06.481478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:06.482232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:06.482844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:06.483938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:06.484664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:06.486347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:06.553406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Getting quotas for project 914f3d56e5f1454195ddbdd4d0a1ce06. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:12:06.558453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:06.571267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Getting quotas for user 36508aab2e14409b93a6c729e74a891c and project 914f3d56e5f1454195ddbdd4d0a1ce06. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:12:06.600020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:12:06.615661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:12:06.724855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731666 Aug 24 02:12:06.725527 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3465/4457] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:12:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:12:06.741664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1706174757", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:06.869872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:12:06.870233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:12:06.870717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:12:06.871268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:12:06.871807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:12:06.914557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:06.915064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:06.915512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:06.916260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:06.918389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:06.925551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:06.968201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Getting quotas for project b99e409a350449b19fb1aded78066a61. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:12:07.010651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Getting quotas for user 11e93bf87ff9446f80960befecbad111 and project b99e409a350449b19fb1aded78066a61. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:12:07.046492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:12:07.053422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:12:07.169286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-801fd374-10e6-42ef-b654-b74629258050 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.439024 Aug 24 02:12:07.170054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3466/4458] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:12:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:12:07.188010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:07.198519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] [instance: 43f6e673-c4ea-4b41-a488-81d447ae0f66] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:07.218879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:07.220052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:07.220510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:07.221948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:07.234959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:07.237528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:07.286601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] HTTP exception thrown: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Request method failure captured: Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 HTTP/1.1 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYir3MqHLWx2kfTU0qF0BgERSdLPZLUzgNoCpuz75kc2L8xcxKWTGnCabIS85oLlF_EdaO5XPdkWHgCPeDNolfzmBSWQCzi1YghvzWhhi85ePOXXgyc3-_Y3EouHQgXLfydZiHpXaapcqWCcj2nzRyoAyc8BWE0MxomovOBk9pWdY24 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 810db131a600433dadc3c66ec940b9a3 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/810db131a600433dadc3c66ec940b9a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_810db131a600433dadc3c66ec940b9a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 810db131a600433dadc3c66ec940b9a3 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1014499889 Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-MultipleCreateTestJSON-1014499889-project Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 69c66a3c94544dc896ceb361ac15831c Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-MultipleCreateTestJSON-1014499889-project Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '43f6e673-c4ea-4b41-a488-81d447ae0f66'} Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:07.295583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:07.300435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] Returning 404 to user: Instance 43f6e673-c4ea-4b41-a488-81d447ae0f66 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:07.306843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2f06567-8dde-4d7a-82b5-51d7ef809c2c tempest-MultipleCreateTestJSON-1014499889 tempest-MultipleCreateTestJSON-1014499889-project] 10.222.0.49 "GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66" status: 404 len: 111 microversion: 2.1 time: 0.126036 Aug 24 02:12:07.316602 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3467/4459] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:07 2022] GET /compute/v2.1/servers/43f6e673-c4ea-4b41-a488-81d447ae0f66 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:07.324290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:07.326223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:07.353123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:07.356102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:07.358600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:07.360858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:07.361515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:07.363480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.054586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.064653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.072627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.075040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-757e5bfd-8161-43d4-937c-aa1f11a90ba3 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.755060 Aug 24 02:12:08.078910 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3468/4460] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:07 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:08.090668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:08.098122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:08.113939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.116092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.117725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.118697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.120375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.122265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.195680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf6ea8ee-1ee9-4d50-85ae-a2d6db1076d6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113863 Aug 24 02:12:08.201362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3469/4461] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:08 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:08.215018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:08.215794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:08.235560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.236429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.237103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.239221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.243599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.245779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.396146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.408618 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c62fc40-734f-4066-97f0-5d2b046d2c8e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1221 microversion: 2.1 time: 0.203038 Aug 24 02:12:08.409589 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3470/4462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:08 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1221 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:08.426308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0356dbd5-a882-431d-a302-93256d4007ad", "tag": "7aa63e5f-bb95-4be1-bb38-d393ff463bc0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:08.448746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.449240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.452811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.486448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] Creating event network-changed:7aa63e5f-bb95-4be1-bb38-d393ff463bc0 for instance 0356dbd5-a882-431d-a302-93256d4007ad on n-h2-854121-3 Aug 24 02:12:08.499452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-46c784b4-82db-4422-a959-ad188ea30c68 req-c655984b-f050-4363-a28b-770e87a6d35e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088439 Aug 24 02:12:08.503615 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3471/4463] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:08.515631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:08.524002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:08.539908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.540418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.540909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.541635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.542102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.542535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.642339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccb2d964-ee15-46f4-a275-70bf2193e903 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "PUT /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 992 microversion: 2.47 time: 0.137015 Aug 24 02:12:08.642958 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3472/4464] 10.222.0.49 () {62 vars in 1297 bytes} [Wed Aug 24 02:12:08 2022] PUT /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 992 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:12:08.661393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:08.662356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:08.672657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.673423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.674033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.674904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:08.675518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:08.676103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:08.868933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.881564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.887069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:08.888544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99e00a2d-8166-4a3e-994e-2adb4484e860 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1282 microversion: 2.47 time: 0.231479 Aug 24 02:12:08.889339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3473/4465] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:08 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:12:09.100396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:09.101067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:09.117357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.117754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.127562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.128381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.128915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.129363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.397637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:09.412526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:09.414300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:09.415662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13aca2b2-5e05-4ee5-ac47-7e4afa63b188 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.320119 Aug 24 02:12:09.416895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3474/4466] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:09 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:09.421756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:09.424928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:09.440567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.443368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.444008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.447151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.447823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.449029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.515674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e771357d-d5e4-40e0-82b7-e2da2959cd58 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097539 Aug 24 02:12:09.521318 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3475/4467] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:09 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:09.527644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:09.528562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:09.535631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.536379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.537047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.538092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:09.538857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:09.540167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:09.598446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:09.901839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:09.919676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60befdeb-2487-4c29-b3ea-3b990e64b4b4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1221 microversion: 2.1 time: 0.396336 Aug 24 02:12:09.949357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3476/4468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:09 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1221 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:09.979962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:09.980583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:10.010485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:10.015632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:10.020411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:10.025481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:10.026190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:10.028086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:10.702338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:10.724796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:10.730352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:10.733340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d77149aa-85e8-488d-8642-04bd6047da58 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1274 microversion: 2.47 time: 0.781143 Aug 24 02:12:10.741878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3477/4469] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:09 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1274 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:10.748920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:10.749532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:10.765392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:10.766526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:10.766972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:10.767677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:10.776592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:10.777339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:11.274325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:11.340003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:11.367154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:11.369068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7f02b98-9305-47d2-b52f-e6c5e3cabfa2 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.626039 Aug 24 02:12:11.369918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3478/4470] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:10 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:11.393333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:11.396035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:11.412195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:11.417392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:11.419757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:11.420710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:11.422668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:11.423233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:11.526557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07a3b716-44b4-445a-a049-4f2954f84cf2 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155249 Aug 24 02:12:11.528467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3479/4471] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:11 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:11.534163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:11.535037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:11.554938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:11.555764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:11.556449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:11.558002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:11.558948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:11.560100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:12.072637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:12.102497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad1cb2c0-5193-4124-b1e3-0d8af446c41a tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1269 microversion: 2.1 time: 0.572408 Aug 24 02:12:12.103635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3480/4472] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:11 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1269 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:12.151450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:12.155988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:12.180498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:12.183708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:12.184182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:12.190790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:12.191463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:12.195872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:12.458541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:12.476887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:12.482971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:12.486023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-730dc050-02b1-47bd-bb43-7fb9833bb87f tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1336 microversion: 2.47 time: 0.371569 Aug 24 02:12:12.509106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3481/4473] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:12 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1336 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:12.522900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:12.523615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:12.575367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:12.576137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:12.578097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:12.580741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:12.583305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:12.586107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:13.336500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:13.353919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:13.361403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:13.367716 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7464b6cd-531d-4687-bc7e-6e5b6fe7de0d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.854846 Aug 24 02:12:13.371179 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3482/4474] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:12 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:13.391260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:13.402289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:13.432886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:13.433634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:13.436119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:13.439870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:13.440562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:13.442037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:13.574714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d55f5eac-0143-4bd0-af7f-7cd08effdfde tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199707 Aug 24 02:12:13.575772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3483/4475] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:12:13 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:12:13.595832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:13.603713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:13.643124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:13.643791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:13.646167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:13.647264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:13.647959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:13.653400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.115062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:14.126465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7c2835a-f7fa-4a11-8bcd-1159e8540622 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.548603 Aug 24 02:12:14.128844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3484/4476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:13 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:14.143422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:14.144399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:14.168965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.169479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.176284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.177086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.177570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.180175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.377175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:14.399009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:14.400661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:14.401900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fca8134-fc1a-4b15-bc00-3cfa55c0c830 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1336 microversion: 2.47 time: 0.270986 Aug 24 02:12:14.402487 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3485/4477] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:14 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1336 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:14.411562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:14.412076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:14.429444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.429971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.430403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.431134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.431601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.432047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.524600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:12:14.743214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3108417-58a9-4871-8df9-8083b187ee54 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 204 len: 0 microversion: 2.1 time: 0.339342 Aug 24 02:12:14.745350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3486/4478] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:14 2022] DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:12:14.761521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:14.763315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:14.794905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.799517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.799996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:14.805811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:14.807677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:14.809662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:15.390478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:15.402657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:15.410836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:15.412131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc82d90d-6a4d-4146-bec5-f608f14c4ba6 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.664011 Aug 24 02:12:15.412836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3487/4479] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:14 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:15.417643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:15.422734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:15.439622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:15.443484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:15.444168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:15.445285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:15.447764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:15.448570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:15.898607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:15.941708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e44c0f3-afc3-463e-948c-094ad0b94808 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1682 microversion: 2.1 time: 0.521174 Aug 24 02:12:15.943507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3488/4480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:15 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:15.989900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0356dbd5-a882-431d-a302-93256d4007ad", "name": "network-vif-plugged", "status": "completed", "tag": "7aa63e5f-bb95-4be1-bb38-d393ff463bc0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:16.038367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.038854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.039445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.084557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] Creating event network-vif-plugged:7aa63e5f-bb95-4be1-bb38-d393ff463bc0 for instance 0356dbd5-a882-431d-a302-93256d4007ad on n-h2-854121-3 Aug 24 02:12:16.098873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e752d8f0-079e-4b22-904a-51e7ab7159e5 req-b3eb9ab3-17b0-4b6a-94bb-3db10f2bec62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132586 Aug 24 02:12:16.101058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3489/4481] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:16.109236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:16.115169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:16.127045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.127791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.128751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.130074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.131247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.132310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.684290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:16.695489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e30cee05-3e12-40cb-8e1c-1729b4aba517 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.592491 Aug 24 02:12:16.711451 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3490/4482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:16 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:16.718932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:16.720166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:16.727344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.728039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.728788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.729952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.730602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.731364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.849119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:16.882635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:16.902702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:16.907310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbd241fe-56a1-4c1d-92cb-d81ce7c796cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1357 microversion: 2.47 time: 0.193353 Aug 24 02:12:16.907949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3491/4483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:16 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:16.916527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3840faaa-9b26-44b2-81c8-c46e9eedaaca", "tag": "96bb95ce-fbcb-413d-9756-534175c8589e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:16.962451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:16.966218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:16.968498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:16.970126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:16.981199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:17.008145 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] Creating event network-changed:96bb95ce-fbcb-413d-9756-534175c8589e for instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca on n-h2-854121-3 Aug 24 02:12:17.013907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-068caf90-d1c9-430a-a2ac-7de5fc04f4a3 req-4297c4cd-b77f-433e-8d06-2dabceb4e19d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103483 Aug 24 02:12:17.019370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3492/4484] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:17.035092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:17.036256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:17.047776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=28 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:17.057648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.059330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.059774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.061656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.062116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.065638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.478742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:17.504430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:17.506042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:17.507550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-115f7bc8-130a-4759-98a6-c6fc11e1c7be tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1358 microversion: 2.21 time: 0.486511 Aug 24 02:12:17.521705 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3493/4485] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:17 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1358 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:17.528461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:17.532353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:17.540319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.541121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.541785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.543567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.544519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.545150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.710093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:12:17.710765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:12:17.710969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:12:17.712755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:12:17.713271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:12:17.791952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:17.802307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.803937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.805062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.806786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.807999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.808734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.849704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9d9c042-f768-4a48-987a-bafe12545c05 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "POST /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89/action" status: 202 len: 1079 microversion: 2.47 time: 0.326863 Aug 24 02:12:17.850656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3494/4486] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:12:17 2022] POST /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89/action => generated 1079 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 02:12:17.857097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:17.858083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:17.865645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.866311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.866922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:17.867990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:17.868597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:17.869194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.134402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.145237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2bb65f4-6049-4733-8054-a4f0950b1d83 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1682 microversion: 2.1 time: 0.292561 Aug 24 02:12:18.146746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3495/4487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:17 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:18.153887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:18.154710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:18.161138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.161896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.162486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.163372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.163978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.164564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.400191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.408371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a92cc81-d4e1-44c3-8773-2c08a6c853b1 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.260384 Aug 24 02:12:18.409456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3496/4488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:18 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:18.413875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:18.414486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:18.426504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.427272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.427722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.428428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.428922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.429691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.508206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.520921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.522506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.523792 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c0a3c04-7804-4748-870e-918c812487a4 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.113512 Aug 24 02:12:18.524759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3497/4489] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:18 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:18.550132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:18.550132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:18.551835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.552339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.552886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.553494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.553965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.554370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.764677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.777020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.778886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:18.780286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1efadc52-2013-40ca-9f90-fe5d672ada9a tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1550 microversion: 2.21 time: 0.239671 Aug 24 02:12:18.781576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3498/4490] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:18 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1550 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:18.803106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:18.803610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:18.808687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:18.810517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.811220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.811648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.812545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.813185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.813797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.842854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:12:18.945312 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e22d568-a906-477f-8f9e-36b2c43107fd tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 204 len: 0 microversion: 2.21 time: 0.145060 Aug 24 02:12:18.946685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3499/4491] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:12:18 2022] DELETE /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 02:12:18.957108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:18.958149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:18.965427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.966064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.967145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:18.967590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:18.968155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:18.969393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.217851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:19.249013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:19.256781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:19.258046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db02b55c-ed1b-4322-82b2-e53553269a3d tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1556 microversion: 2.21 time: 0.307451 Aug 24 02:12:19.258635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3500/4492] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:18 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1556 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:19.271056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883f5bee-8c01-4701-9a3a-469c58e12b65", "name": "network-vif-deleted", "tag": "41362601-3267-4941-8f8e-9c701c0f4535"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:19.296016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.296511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.297013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.323128 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] Creating event network-vif-deleted:41362601-3267-4941-8f8e-9c701c0f4535 for instance 883f5bee-8c01-4701-9a3a-469c58e12b65 on n-h1-854121-3 Aug 24 02:12:19.339386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fe6ece0f-40bf-4f29-ad06-3afd8ce3b8eb req-277880ff-d97a-4ba9-92d7-3bc3ac76e465 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077441 Aug 24 02:12:19.342046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3501/4493] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:19.350391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:19.351100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:19.367559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.368071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.368518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.369288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.369750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.370179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.447977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.448478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.449227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.451565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lazy-loading 'fault' on Instance uuid 883f5bee-8c01-4701-9a3a-469c58e12b65 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:12:19.552842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d0e3e1f15764a1ab1c97b02cf71a903', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf0544f17254646a4a598e097692f96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:19.560767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76e4bc2c-90b7-48ef-8583-a7b18ea2c860 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 200 len: 1332 microversion: 2.1 time: 0.217505 Aug 24 02:12:19.561355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3502/4494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:19 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 1332 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:19.567922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:19.568540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:19.575077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.575669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.576019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.576854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.577368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.577813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.789449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:19.802503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92a62cfc-dc75-4219-b948-710158d21153 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.238356 Aug 24 02:12:19.803753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3503/4495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:19 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:19.821991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:19.823366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:19.836070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.836558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.837021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:19.853729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:19.854456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:19.854914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.037493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.051936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.056771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.062212 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a18ef53f-ba31-49ae-a867-bcf2eb8e83cf tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.253019 Aug 24 02:12:20.062904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3504/4496] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:19 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:20.283630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:20.284367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:20.292354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.292877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.293320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.307737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.308237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.308682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.555068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.572313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.585997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:20.588935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96521887-84e2-4711-b9d5-242b2c8188d5 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1556 microversion: 2.21 time: 0.307745 Aug 24 02:12:20.596886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3505/4497] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:20 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1556 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:12:20.603232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:20.604063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:20.612094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.613050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.613722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.614702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.615334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.615921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.621218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:20.636658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 HTTP/1.1 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '883f5bee-8c01-4701-9a3a-469c58e12b65'} Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:20.638686 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90545d6b-3338-4283-aeef-85d0b4e6b9bf tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 404 len: 111 microversion: 2.1 time: 0.042295 Aug 24 02:12:20.647962 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3506/4498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:20 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:20.654550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe61ed70-cf25-4549-be86-8592288f6fa8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '.version_select at 0x7f6b926f8e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:20.702651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe61ed70-cf25-4549-be86-8592288f6fa8 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505522950" status: 202 len: 0 microversion: 2.1 time: 0.053425 Aug 24 02:12:20.704896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3507/4499] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505522950 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:12:20.833798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:20.834518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:20.852159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.854049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.858229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:20.860795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:20.865006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:20.866415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:21.351271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.372744 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9005a3e-2c00-41a6-a52b-267bdde7fcdf tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.552672 Aug 24 02:12:21.376331 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3508/4500] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:20 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:21.387554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:21.388678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:21.406019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:21.406959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:21.407763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:21.409319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:21.410623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:21.411389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:21.609727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.636424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.641361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.647382 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3671676-a243-4556-b1f2-abaafdde153e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.263421 Aug 24 02:12:21.647974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3509/4501] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:21 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:21.663439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:21.668507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:21.688262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:21.690244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:21.691685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:21.694942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:21.696975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:21.697700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:21.972968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.989327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.990925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:21.993364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e54ed5a-a396-4751-8821-ab1392ce457e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1556 microversion: 2.21 time: 0.340106 Aug 24 02:12:22.007438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3510/4502] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:21 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1556 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:22.397581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:22.398565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:22.411024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:22.412665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:22.413342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:22.414301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:22.415028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:22.415664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:23.490655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:23.504743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90dfd347-9921-4ad4-8cc6-df4f4731feba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 1.110055 Aug 24 02:12:23.507258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3511/4503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:22 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:23.519378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:23.520308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:23.537139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:23.537927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:23.538873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:23.539931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:23.542696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:23.543451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:23.772880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:23.786237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:23.788073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:23.791013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e5ac33e-9e2a-40f4-ae3e-2085cd6ba453 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.282543 Aug 24 02:12:23.793380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3512/4504] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:23 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:23.799215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:23.799825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:23.830388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:23.830903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:23.831732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:23.832613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:23.833424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:23.834021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:24.566048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:24.584550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:24.603444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:24.605372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b394ebf0-7b7c-4e9c-8f0a-7146326ef13e tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1556 microversion: 2.21 time: 0.809969 Aug 24 02:12:24.606625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3513/4505] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:23 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1556 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:24.627417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:24.630097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:24.660621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:24.664097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:24.666255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:24.667286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:24.669110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:24.671146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.125005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.134847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e84d50a8-2a2f-4549-a5ef-147d95f420e4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.526814 Aug 24 02:12:25.137592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3514/4506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:24 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:25.144584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:25.147849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:25.169812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.170568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.173479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.173479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.173479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.173479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.337938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.353584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.362263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.367168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-824091f1-2316-4a50-8899-a418421c3cb0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.225660 Aug 24 02:12:25.382777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3515/4507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:25 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:25.399979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0356dbd5-a882-431d-a302-93256d4007ad", "name": "network-vif-deleted", "tag": "7aa63e5f-bb95-4be1-bb38-d393ff463bc0"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:25.430995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.433487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.434303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.460859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] Creating event network-vif-deleted:7aa63e5f-bb95-4be1-bb38-d393ff463bc0 for instance 0356dbd5-a882-431d-a302-93256d4007ad on n-h2-854121-3 Aug 24 02:12:25.477513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-01795502-da30-430a-87a5-67eb867eb9e4 req-50df33e7-92ca-4ff1-8173-dcc725f0d7c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089297 Aug 24 02:12:25.478857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3516/4508] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:25.631602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:25.635371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:25.661048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.662613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.663389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.666738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.668593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.670438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.782949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:25.783679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:25.784339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:25.785130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lazy-loading 'fault' on Instance uuid 0356dbd5-a882-431d-a302-93256d4007ad {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:12:25.944550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.955214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.960210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2a741253e62d4ce3a01f84b2490d9295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '835f2730d74640d0b56b42d941ef68c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:25.972637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4aee67e0-1d0b-4d3b-b3df-c947c7aec450 tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 200 len: 1348 microversion: 2.21 time: 0.336979 Aug 24 02:12:25.986711 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3517/4509] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:25 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 1348 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:26.165844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:26.167203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:26.189637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:26.190229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:26.192857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:26.193833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:26.194384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:26.194900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:26.731428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:26.746054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8046f7a-590b-4027-b3bf-91c85c60206b tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.586972 Aug 24 02:12:26.747195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3518/4510] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:26 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:26.756647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:26.761521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:26.776761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:26.778379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:26.780343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:26.782751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:26.783573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:26.786579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.088467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:27.102188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:27.107972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:27.112676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da088ef1-4e1b-46a9-b483-cb25ea5508c8 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.361462 Aug 24 02:12:27.115207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3519/4511] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:26 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:27.126807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:27.128996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:27.147411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.148510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.151709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.152688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.153434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.154029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.194933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] HTTP exception thrown: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Request method failure captured: Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad HTTP/1.1 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjrbf84xcvtl1BYy7UBpS7tvx2rKLEbqw7uv_UtvdA_H3tj97isWXAcD5IqCOyqxGRjz4gDITjuNsYjuOgk0krr5uAgTz_Zrz9XMcx6A33w4RNpHttYYDeVzGJZa2qyYCpP1ecjNufNbpcskbZYiEegna7PywyQNNAEmHJ0XgNK6eQ Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2a741253e62d4ce3a01f84b2490d9295 Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0356dbd5-a882-431d-a302-93256d4007ad'} Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.199401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.205006 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.210153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Returning 404 to user: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:27.211300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeb79994-389b-42b6-bdd4-ebf8ca00375f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 404 len: 111 microversion: 2.21 time: 0.094772 Aug 24 02:12:27.213170 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3520/4512] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:27 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:12:27.231460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '.version_select at 0x7f6b914a6e50>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:27.232974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:27.253958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.256944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.258379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.261806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.262521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.263123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.344187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8720cb3-5666-46ee-ab23-ff0138f59c5f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.126684 Aug 24 02:12:27.345201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3521/4513] 10.222.0.49 () {60 vars in 1337 bytes} [Wed Aug 24 02:12:27 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad/os-instance-actions => generated 611 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:12:27.350404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3840faaa-9b26-44b2-81c8-c46e9eedaaca", "name": "network-vif-plugged", "status": "completed", "tag": "96bb95ce-fbcb-413d-9756-534175c8589e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:27.362176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.362823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.363344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.383783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] Creating event network-vif-plugged:96bb95ce-fbcb-413d-9756-534175c8589e for instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca on n-h2-854121-3 Aug 24 02:12:27.389898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-186ce4de-b25c-489b-a4c8-ca92482d33de req-a651d1e4-568c-4592-acd8-f511cdffa6be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042860 Aug 24 02:12:27.391617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3522/4514] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:27.400232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:27.401544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:27.418021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.418745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.422210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.429540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.430363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.431347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.467593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] HTTP exception thrown: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Request method failure captured: Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad HTTP/1.1 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjrbf84xcvtl1BYy7UBpS7tvx2rKLEbqw7uv_UtvdA_H3tj97isWXAcD5IqCOyqxGRjz4gDITjuNsYjuOgk0krr5uAgTz_Zrz9XMcx6A33w4RNpHttYYDeVzGJZa2qyYCpP1ecjNufNbpcskbZYiEegna7PywyQNNAEmHJ0XgNK6eQ Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2a741253e62d4ce3a01f84b2490d9295 Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0356dbd5-a882-431d-a302-93256d4007ad'} Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:27.485696 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.489634 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.491862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Returning 404 to user: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:27.493242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9230c43b-f814-4299-b2e6-0f1323ef637c tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 404 len: 111 microversion: 2.21 time: 0.100336 Aug 24 02:12:27.495420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3523/4515] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:12:27 2022] DELETE /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:12:27.504619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:27.512147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] [instance: 0356dbd5-a882-431d-a302-93256d4007ad] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:27.526654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.527516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.528182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.529127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.529818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.530458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.560093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] HTTP exception thrown: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Request method failure captured: Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad HTTP/1.1 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjrbf84xcvtl1BYy7UBpS7tvx2rKLEbqw7uv_UtvdA_H3tj97isWXAcD5IqCOyqxGRjz4gDITjuNsYjuOgk0krr5uAgTz_Zrz9XMcx6A33w4RNpHttYYDeVzGJZa2qyYCpP1ecjNufNbpcskbZYiEegna7PywyQNNAEmHJ0XgNK6eQ Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.21 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_835f2730d74640d0b56b42d941ef68c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 835f2730d74640d0b56b42d941ef68c9 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-219032906 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 2a741253e62d4ce3a01f84b2490d9295 Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsV221TestJSON-219032906-project Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '0356dbd5-a882-431d-a302-93256d4007ad'} Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.568856 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. Aug 24 02:12:27.572586 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:27.574935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] Returning 404 to user: Instance 0356dbd5-a882-431d-a302-93256d4007ad could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:27.576285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f264df0a-2751-4d0b-89a6-5a6c9bc49e8f tempest-InstanceActionsV221TestJSON-219032906 tempest-InstanceActionsV221TestJSON-219032906-project] 10.222.0.49 "GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad" status: 404 len: 111 microversion: 2.21 time: 0.076689 Aug 24 02:12:27.577377 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3524/4516] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:27 2022] GET /compute/v2.1/servers/0356dbd5-a882-431d-a302-93256d4007ad => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:12:27.767840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:27.769909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:27.781736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.784566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.785742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:27.788329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:27.789525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:27.792219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:28.631848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:28.645178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e05030c6-ed81-48f8-a0c7-afdb381e42ba tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 0.881686 Aug 24 02:12:28.656748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3525/4517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:27 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:28.658572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:28.661389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:28.668705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:28.669238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:28.669688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:28.680529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:28.682937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:28.683650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:28.910879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:28.924239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:28.926188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:28.927614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe416a0c-1961-431b-89cb-5f177f446703 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.279860 Aug 24 02:12:28.928358 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3526/4518] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:28 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:29.669000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:29.669898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:29.679083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:29.685569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:29.686301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:29.687262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:29.687902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:29.688524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:29.783624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:31.065326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:31.074417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c456d2e-ec0c-4f4b-947b-ddf97ec492d7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1317 microversion: 2.1 time: 1.409176 Aug 24 02:12:31.081908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3527/4519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:29 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1317 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:31.097862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:31.098730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:31.113742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.114516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.115379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.116338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.117045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.118642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.248935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:31.264515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:31.267228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:31.273125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1a4aeea-cf8a-464d-9728-65724f4a05e2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.189672 Aug 24 02:12:31.274094 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3528/4520] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:31 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:31.289861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:31.295800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:31.330050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.331255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.348378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.349361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.350771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.351289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.387102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 HTTP/1.1 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '883f5bee-8c01-4701-9a3a-469c58e12b65'} Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:31.388902 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.394882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.399136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:31.401050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36c482f3-4390-4943-a8ca-2c789615a0ed tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 404 len: 111 microversion: 2.1 time: 0.114219 Aug 24 02:12:31.411269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3529/4521] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:31 2022] DELETE /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:31.424254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:31.425267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 883f5bee-8c01-4701-9a3a-469c58e12b65] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:31.436037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.439930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.440700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.441737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:31.442434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:31.443316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:31.481366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 HTTP/1.1 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '883f5bee-8c01-4701-9a3a-469c58e12b65'} Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:31.485513 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. Aug 24 02:12:31.489390 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:31.507679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 883f5bee-8c01-4701-9a3a-469c58e12b65 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:31.509854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2d584cb-5bb8-4f1b-88c7-c4ec7d5d8660 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65" status: 404 len: 111 microversion: 2.1 time: 0.097344 Aug 24 02:12:31.511695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3530/4522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:31 2022] GET /compute/v2.1/servers/883f5bee-8c01-4701-9a3a-469c58e12b65 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:32.107451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:32.108309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:32.121757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:32.130107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:32.131667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:32.133276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:32.135362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:32.135885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:33.654287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:33.677282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e340374-7bbe-4f5f-bca2-208b8c7551c7 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1506 microversion: 2.1 time: 1.563267 Aug 24 02:12:33.680254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3531/4523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:32 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1506 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:33.689353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:33.690523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:33.704409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:33.713379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:33.715313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:33.727186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:33.728020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:33.728704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.072212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:34.086634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:34.103184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:34.107645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b725b12-5aed-458d-aab2-8e60413367db tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.426046 Aug 24 02:12:34.109550 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3532/4524] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:33 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:34.124005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:34.125197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:34.146586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.147656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.149227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.152427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.153390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.153829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.282827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:34.287121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03d3b55b-cbaf-45aa-a1bc-752d9dd24dc4 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/os-instance-actions/req-29cdb801-9c7c-48e5-ad82-6092379cc0a4" status: 200 len: 313 microversion: 2.1 time: 0.175545 Aug 24 02:12:34.313538 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3533/4525] 10.222.0.49 () {58 vars in 1419 bytes} [Wed Aug 24 02:12:34 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/os-instance-actions/req-29cdb801-9c7c-48e5-ad82-6092379cc0a4 => generated 313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:34.318883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:34.322436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:34.351146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.351778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.353692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.354596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.358113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.362244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.556623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c99dc6c0-b3af-477e-9942-16609c39d09c tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "POST /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/action" status: 202 len: 0 microversion: 2.1 time: 0.241273 Aug 24 02:12:34.557700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3534/4526] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:12:34 2022] POST /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:12:34.588966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:34.594202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:34.617458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.620758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.621239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:34.625190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:34.625680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:34.628693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:35.234578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:35.254926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92032e16-7cf4-473b-b2c0-8dae89680fb5 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1508 microversion: 2.1 time: 0.679233 Aug 24 02:12:35.257103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3535/4527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:34 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:36.105143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-767319286", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "5dd15bfc-062d-4c96-9545-7ddfe79a90ec"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:36.220406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] validate_networks() for [('5dd15bfc-062d-4c96-9545-7ddfe79a90ec', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:12:37.357826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:12:37.359253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:12:37.359982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:12:37.360815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:12:37.361417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:12:37.383378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.386658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.387352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:37.388372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.390957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.391657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:37.416218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Getting quotas for project 961c8ccd53de4536bea85edb16547d75. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:12:37.426124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Getting quotas for user 48509a100b454a73adeae8471b407558 and project 961c8ccd53de4536bea85edb16547d75. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:12:37.444992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:12:37.451362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:12:37.529916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:37.558380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4411e50-66f4-4b18-8a70-e688c85e5539 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.296419 Aug 24 02:12:37.561212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3536/4528] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:12:37.579818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:37.587534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:37.638479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.639331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.642734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:37.644407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.650356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.651435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:37.834476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:37.843998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:37.850732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:37.856389 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac0582bc-bfbf-485c-94d7-71f3715d1295 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.290710 Aug 24 02:12:37.859242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3537/4529] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:37 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:37.866513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:37.872263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:37.893022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.893946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.894396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:37.898499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:37.899668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:37.901251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.488773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:38.507445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-451e95e3-1e51-4ca1-a02a-3a807e6c4a31 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1506 microversion: 2.1 time: 0.644022 Aug 24 02:12:38.511003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3538/4530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:37 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1506 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:38.556352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:38.565141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:38.597968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.598464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:38.598905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.599608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.600090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:38.600515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.820252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:38.835435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c7e50b7-2942-48e5-b547-522bc5f7d3ca tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1219 microversion: 2.1 time: 0.322025 Aug 24 02:12:38.850775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3539/4531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:38 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1219 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:38.857899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '.version_select at 0x7f6b914a85e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:38.859222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:38.866609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.867947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:38.868609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.869604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.870233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:38.870826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.958361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9da06ee1-707b-4474-831a-8a25e0a730ef tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.103995 Aug 24 02:12:38.960933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3540/4532] 10.222.0.49 () {58 vars in 1296 bytes} [Wed Aug 24 02:12:38 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca/os-instance-actions => generated 611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:38.974469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:38.976185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:38.994785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.996254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:38.996370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:38.998150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:38.999878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:39.001916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:39.169530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:39.181782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:39.185706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:39.188068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a680376-e92e-4007-b7f4-f84f11acc2c2 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.225817 Aug 24 02:12:39.193297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3541/4533] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:38 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:39.208736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:39.209295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:39.216395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:39.217347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:39.218666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:39.220910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:39.224256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:39.224941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:39.297377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:12:39.460877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-425909aa-8cc6-467f-bd79-83213bf86fbc tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 204 len: 0 microversion: 2.1 time: 0.266050 Aug 24 02:12:39.461597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3542/4534] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:39 2022] DELETE /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:12:39.473909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:39.478372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:39.487881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:39.488381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:39.488839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:39.491934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:39.492411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:39.492905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:39.576797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:40.027644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:40.042701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efc65d7d-d203-46a7-ba5b-917e38ec9dd6 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1512 microversion: 2.1 time: 0.576478 Aug 24 02:12:40.044248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3543/4535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:39 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:40.052887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.062219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.082689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.086053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.086902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.089380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.090914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.098802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.147919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 HTTP/1.1 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c8d8e63f-0e90-41a9-8afa-b4252cce8606'} Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:40.159612 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.164429 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.166434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:40.169076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6af7a6ed-4246-478c-9598-c261194a90c6 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 404 len: 111 microversion: 2.1 time: 0.123079 Aug 24 02:12:40.170857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3544/4536] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:40 2022] DELETE /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:40.180051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.180844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.229347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.233973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.234867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.235867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.237589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.240583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.442926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:40.459117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3b9ef8e-d5e7-45dd-87d3-9dcf718171a5 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1273 microversion: 2.1 time: 0.286340 Aug 24 02:12:40.467574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3545/4537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:40 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:40.489705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.494156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: c8d8e63f-0e90-41a9-8afa-b4252cce8606] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.515017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.517307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.520376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.521366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.523460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.524075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.576416 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 HTTP/1.1 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c8d8e63f-0e90-41a9-8afa-b4252cce8606'} Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.578194 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance c8d8e63f-0e90-41a9-8afa-b4252cce8606 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:40.583130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-597953e4-1b50-4366-ab4c-e2db2e8431c1 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606" status: 404 len: 111 microversion: 2.1 time: 0.107151 Aug 24 02:12:40.593756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3546/4538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:40 2022] GET /compute/v2.1/servers/c8d8e63f-0e90-41a9-8afa-b4252cce8606 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:40.599507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.600105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.618469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.620186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.623173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.624243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.625188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.626412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.788424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:40.800858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:40.805261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:40.808837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fd261b8-7454-4763-aa73-ace0796f7c8c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.213146 Aug 24 02:12:40.828672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3547/4539] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:40 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:40.836247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.839545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.856466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.857674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.859727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.862773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.864078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.867782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.894796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 HTTP/1.1 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8'} Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:40.900245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.904059 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.910545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:40.912597 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-21221b82-a222-4b5d-ac19-9964e14f052d tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 404 len: 111 microversion: 2.1 time: 0.081697 Aug 24 02:12:40.920600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3548/4540] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:40 2022] DELETE /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:40.927072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:40.930607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:40.947023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.955118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.955939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.957687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:40.958402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:40.959475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:40.984593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 HTTP/1.1 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8'} Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:40.986462 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. Aug 24 02:12:40.991159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:40.993088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:40.994390 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91e22430-885c-4153-8b31-7cbc4b87544f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8" status: 404 len: 111 microversion: 2.1 time: 0.072391 Aug 24 02:12:40.998999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3549/4541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:40 2022] GET /compute/v2.1/servers/e0697cdc-4817-4f4a-b9b7-9f7b58cb08c8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:41.065019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:41.065932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:41.086293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:41.087135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:41.090324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:41.091380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:41.092299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:41.098409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:41.731391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:41.745111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e48b04b7-cc75-49c7-bd11-62cac43e9b9d tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1512 microversion: 2.1 time: 0.681487 Aug 24 02:12:41.749247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3550/4542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:41 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1512 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:41.786287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:41.787270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:41.805666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:41.811312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:41.816496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:41.817499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:41.819108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:41.821528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:42.385760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:42.399874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25d68c25-337d-4d1d-bdc8-f2a81f05bef9 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 0.646224 Aug 24 02:12:42.401132 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3551/4543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:41 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:42.416689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:42.417780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:42.440977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:42.443969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:42.449280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:42.450386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:42.453321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:42.454013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:42.606780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:42.616109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:42.617664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:42.618852 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d084cea-8d2a-48f2-89e6-1139311e6172 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.216526 Aug 24 02:12:42.629252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3552/4544] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:42 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:42.766105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:42.766724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:42.773262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:42.777291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:42.777912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:42.785671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:42.786378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:42.788764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:42.991551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36508aab2e14409b93a6c729e74a891c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914f3d56e5f1454195ddbdd4d0a1ce06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:43.006036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeed95b2-1f91-4070-9609-31baf431820e tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 200 len: 1470 microversion: 2.1 time: 0.240980 Aug 24 02:12:43.007878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3553/4545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:42 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:43.023245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3840faaa-9b26-44b2-81c8-c46e9eedaaca", "name": "network-vif-deleted", "tag": "96bb95ce-fbcb-413d-9756-534175c8589e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:43.045717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.048610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.052743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.077281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] Creating event network-vif-deleted:96bb95ce-fbcb-413d-9756-534175c8589e for instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca on n-h2-854121-3 Aug 24 02:12:43.096769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d1a9b8fb-094a-411c-8379-dea6c15740d3 req-45a9a573-b7d3-4a1a-8871-3b283d9e00a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087396 Aug 24 02:12:43.100633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3554/4546] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:43.108222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808e417a-5321-4783-a023-ac43a618520e", "tag": "b8e81be1-64cc-4f3d-99d3-e016bb507d83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:43.140528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.144891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.146590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.188089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] Creating event network-changed:b8e81be1-64cc-4f3d-99d3-e016bb507d83 for instance 808e417a-5321-4783-a023-ac43a618520e on n-h1-854121-3 Aug 24 02:12:43.202712 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-24f17c41-1de6-4df2-85fc-259e3073b7b3 req-8361119d-10fd-4efb-8aa2-86908b0b12de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098892 Aug 24 02:12:43.205524 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3555/4547] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:43.425972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:43.426556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:43.436479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.438156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.438774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.441339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.442288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.443135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.699711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:43.712759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bee2355-328a-4595-8740-8b5cbbe99e1f tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 0.292346 Aug 24 02:12:43.714327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3556/4548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:43 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:43.736284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:43.737762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:43.748620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.750384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.751032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.751969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:43.753486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:43.754165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:43.863699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:43.875878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:43.877665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:43.879650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd0d913c-169d-44da-b445-2c38664087b9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.163157 Aug 24 02:12:43.880832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3557/4549] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:43 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:44.030828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:44.032050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] [instance: 3840faaa-9b26-44b2-81c8-c46e9eedaaca] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:44.043014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:44.044164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:44.044834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:44.045748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:44.047201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:44.048124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:44.070948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] HTTP exception thrown: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Request method failure captured: Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca HTTP/1.1 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjzS-ihZN62XMUqx54rL0S78Mg8ymxKM_iMEJH9_GJ-06ab-wZFABNYT_3kg2YenEtz2p8x_BDF9kAM9TEebBAOUYcWzdWMKV_jYY1omUxonzWx1fYK9isqvNr6mEYqtMIbAuDFUHqej2cdx_104Slfc7U2Wnpy6qtwrzAv9ygaZyM Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 914f3d56e5f1454195ddbdd4d0a1ce06 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-InstanceActionsTestJSON-2141766957 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/914f3d56e5f1454195ddbdd4d0a1ce06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/914f3d56e5f1454195ddbdd4d0a1ce06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/914f3d56e5f1454195ddbdd4d0a1ce06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_914f3d56e5f1454195ddbdd4d0a1ce06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-InstanceActionsTestJSON-2141766957 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 914f3d56e5f1454195ddbdd4d0a1ce06 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2141766957 Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-InstanceActionsTestJSON-2141766957-project Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 36508aab2e14409b93a6c729e74a891c Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-InstanceActionsTestJSON-2141766957-project Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3840faaa-9b26-44b2-81c8-c46e9eedaaca'} Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:44.073169 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. Aug 24 02:12:44.077147 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:44.081025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] Returning 404 to user: Instance 3840faaa-9b26-44b2-81c8-c46e9eedaaca could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:44.082021 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b055e402-a4d5-45f7-a336-e1de3f0ddf81 tempest-InstanceActionsTestJSON-2141766957 tempest-InstanceActionsTestJSON-2141766957-project] 10.222.0.49 "GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca" status: 404 len: 111 microversion: 2.1 time: 0.056381 Aug 24 02:12:44.084424 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3558/4550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:44 2022] GET /compute/v2.1/servers/3840faaa-9b26-44b2-81c8-c46e9eedaaca => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:44.736455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:44.737506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:44.749505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:44.750432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:44.751105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:44.752072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:44.753309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:44.754036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.095883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:45.108972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f73f9d15-8502-48f1-bdfc-c9bf51510eb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 0.377525 Aug 24 02:12:45.110105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3559/4551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:44 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:45.115934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:45.116626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:45.126660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.127570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.129700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.130662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.132058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.132724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.269842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:45.280015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:45.283066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:45.285707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53f65fa1-3aee-44ba-aed2-31f76f981c1c tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.173022 Aug 24 02:12:45.300419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3560/4552] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:45 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:45.564107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:45.564805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:45.577771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.580081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.580687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.584426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.585731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.588209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.645481 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b HTTP/1.1 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '13a92bf2-2056-40da-9531-f7c02a166c3b'} Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:45.650607 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.655074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.658555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:45.660745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a877f11-8492-4785-9c24-7f9f1791cf19 tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 404 len: 111 microversion: 2.1 time: 0.101170 Aug 24 02:12:45.666375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3561/4553] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:45 2022] DELETE /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:12:45.677089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:45.679341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] [instance: 13a92bf2-2056-40da-9531-f7c02a166c3b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:45.691539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.692043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.692834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.693221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:45.693753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:45.694099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:45.724558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] HTTP exception thrown: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Request method failure captured: Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b HTTP/1.1 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYbJiG7ejdiTdvbSkjB9TCtwhFiRs6EHuTqXh2EnyJBtVII60u-W29b0STs1QXOyTgDf43U1wHgg5fs7vs2lwqYM2VwlpHUvrGy1OcHiOShUZlqfHHR1iK1XGbR6X04VedRqVPe0wBC-NGy0-CGyNeOfoXD-5wg-IhdtPFewwpU-IGc Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cf0544f17254646a4a598e097692f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cf0544f17254646a4a598e097692f96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cf0544f17254646a4a598e097692f96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9cf0544f17254646a4a598e097692f96 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164917167 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0d0e3e1f15764a1ab1c97b02cf71a903 Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeNegativeTest-164917167-project Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '13a92bf2-2056-40da-9531-f7c02a166c3b'} Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:12:45.727271 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] Returning 404 to user: Instance 13a92bf2-2056-40da-9531-f7c02a166c3b could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:12:45.731340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84028552-48e6-41fd-a2b3-61fb656e443f tempest-AttachVolumeNegativeTest-164917167 tempest-AttachVolumeNegativeTest-164917167-project] 10.222.0.49 "GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b" status: 404 len: 111 microversion: 2.1 time: 0.063891 Aug 24 02:12:45.738169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3562/4554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:45 2022] GET /compute/v2.1/servers/13a92bf2-2056-40da-9531-f7c02a166c3b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:12:46.129704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:46.130411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:46.146367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:46.152052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:46.154423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:46.159576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:46.161027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:46.162755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:46.522528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:46.532322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c37995f2-cca0-4793-8ae7-3528d37b0d34 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 0.406617 Aug 24 02:12:46.555346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3563/4555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:46 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:46.575007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:46.577717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:46.597102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:46.598240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:46.598592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:46.599621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:46.601588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:46.602954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:46.981502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:46.993952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:46.996065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:47.000785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be4160f0-0399-4f28-b955-4f4a6eb01a89 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1366 microversion: 2.47 time: 0.444124 Aug 24 02:12:47.001392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3564/4556] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:46 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:47.557028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:47.558429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:47.569346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:47.578979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:47.599166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:47.599683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:47.600135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:47.600893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:47.601356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:47.608933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:48.782428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:48.813105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1bb72037-b4ed-40d4-8751-a36adee93587 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 1.240185 Aug 24 02:12:48.827836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3565/4557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:47 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:48.827836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:48.827836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:48.847052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:48.847637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:48.848174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:48.849392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:48.850070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:48.850701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:48.867580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:49.042679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:49.060645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:49.063316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:49.067166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a77e114-2aaa-4210-a2e9-3c3d1ef5c3af tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1372 microversion: 2.47 time: 0.245193 Aug 24 02:12:49.067949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3566/4558] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:48 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:49.835700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:49.837993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:49.865691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:49.867106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:49.868876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:49.873685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:49.875579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:49.883037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:51.156968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:51.171452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfafddea-e76a-447d-b04f-74cf1d06a718 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 1.340561 Aug 24 02:12:51.178474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3567/4559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:49 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:12:51.195402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:51.196033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:51.205677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:51.206172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:51.206616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:51.207329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:51.207788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:51.208215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:52.102382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:52.156367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:52.172180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:52.177637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6ad1141-e2cb-47dd-beae-41544718f940 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1372 microversion: 2.47 time: 0.993894 Aug 24 02:12:52.198381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3568/4560] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:51 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1372 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:52.222624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808e417a-5321-4783-a023-ac43a618520e", "name": "network-vif-plugged", "status": "completed", "tag": "b8e81be1-64cc-4f3d-99d3-e016bb507d83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:12:52.249649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:52.252267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:52.254349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:52.295103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] Creating event network-vif-plugged:b8e81be1-64cc-4f3d-99d3-e016bb507d83 for instance 808e417a-5321-4783-a023-ac43a618520e on n-h1-854121-3 Aug 24 02:12:52.306602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-92385ea3-2a17-46b0-b158-71cab3208fa7 req-650066e6-8038-4759-b286-df8ff87490b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104687 Aug 24 02:12:52.311209 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3569/4561] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:12:52.326619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:52.328706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:52.341325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:52.344234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:52.344933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:52.345899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:52.347452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:52.348058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:53.544704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:53.555775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd265eea-e9ef-4066-b868-9058edd089ee tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1315 microversion: 2.1 time: 1.241844 Aug 24 02:12:53.560102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3570/4562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:52 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1315 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:53.573743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:53.575784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:53.593264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:53.593896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:53.595716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:53.598024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:53.598676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:53.600077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:54.152336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.163293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.166250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.167470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c03ef83-bfdb-40b1-a3bc-9fe44a903683 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1357 microversion: 2.47 time: 0.605323 Aug 24 02:12:54.189290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3571/4563] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:53 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1357 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:54.198815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:54.208826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.215154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Searching by: {'deleted': False, 'project_id': 'b99e409a350449b19fb1aded78066a61'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 02:12:54.226553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:54.229207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:54.229882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:54.230824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:54.236168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:54.236877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:54.444069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 02:12:54.666741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.684176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:54.685034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:54.687023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:54.712407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:54.714277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:55.011507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff4f9ad6-be79-4dd9-ae8c-a7de9fed6b75 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.820624 Aug 24 02:12:55.012212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3572/4564] 10.222.0.49 () {60 vars in 1187 bytes} [Wed Aug 24 02:12:54 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:55.017462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:55.018351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:55.032383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:55.057223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:55.057724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:55.058476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:55.058944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:55.059372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.151191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:56.168471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64943a4e-8e88-4721-863d-3e7ad7b8a8ad tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1502 microversion: 2.1 time: 1.152896 Aug 24 02:12:56.172346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3573/4565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:55 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1502 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:56.189949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:56.190854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:56.202776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.203461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.204062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.249243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.249818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.253817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.338853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:12:56.551622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7e69358-afaf-493f-ab1c-69a21d8325f3 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 204 len: 0 microversion: 2.47 time: 0.376533 Aug 24 02:12:56.552223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3574/4566] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:12:56 2022] DELETE /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:12:56.561892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:56.562483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:56.577349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.577852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.578298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.585182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.585182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.585182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.724034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbe88232-5621-4ba4-830d-aac0bc508a58 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "DELETE /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.170446 Aug 24 02:12:56.725062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3575/4567] 10.222.0.49 () {58 vars in 1296 bytes} [Wed Aug 24 02:12:56 2022] DELETE /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e/os-server-password => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:12:56.729774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:56.730387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:56.746278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.746864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.747357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:56.748082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:56.748607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:56.749144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.055059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:57.066037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:57.067541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:57.068768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8af905cb-cc9f-4c58-9414-c631bb1039ee tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1363 microversion: 2.47 time: 0.342722 Aug 24 02:12:57.093568 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3576/4568] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:56 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:57.102062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:57.102559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:57.114598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.120504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.121235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.123639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.124284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.126377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.197643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca5363c1-1d23-499f-b088-6fa6fb9b16f4 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.101040 Aug 24 02:12:57.199203 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3577/4569] 10.222.0.49 () {58 vars in 1293 bytes} [Wed Aug 24 02:12:57 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e/os-server-password => generated 16 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:12:57.211300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:57.211721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:57.250998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.255118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.255714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.258720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.259233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.270006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.354099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:12:57.482472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:57.531300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:12:57.563575 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4937422-af88-40a8-89dd-e9544c5ec173 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "DELETE /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 204 len: 0 microversion: 2.1 time: 0.353804 Aug 24 02:12:57.571186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3578/4570] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:12:57 2022] DELETE /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:12:57.585196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:57.586204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:57.604917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.605710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.606312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:57.607713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:57.608890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:57.609603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:58.128753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:58.154325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb4c1a03-4ecd-43f1-a779-7c0196570cb1 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1508 microversion: 2.1 time: 0.578419 Aug 24 02:12:58.158172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3579/4571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:57 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1508 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:58.179075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:58.180219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:58.197635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:58.199687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:58.200502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:58.203000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:58.204651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:58.207743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:58.338745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:58.351069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:58.352874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:58.356011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14b19cfc-1e48-4e3c-a58e-44b96dfb9746 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1363 microversion: 2.47 time: 0.194684 Aug 24 02:12:58.359297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3580/4572] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:58 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:12:59.190852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:59.204901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:59.225011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:59.225924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:59.226605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:59.245107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:59.246144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:59.246794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:59.717824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:12:59.745590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b2dbc88-d984-4a9f-88a5-5f12d13b6118 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1508 microversion: 2.1 time: 0.570077 Aug 24 02:12:59.748029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3581/4573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:12:59 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:12:59.776225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:12:59.779034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:12:59.802485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:59.806003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:59.812281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:59.817522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:59.828172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:59.829798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:59.925336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:12:59.925971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:12:59.927308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:12:59.928831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lazy-loading 'fault' on Instance uuid e6eaa55f-a3e2-4628-801f-467b3303fc89 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:12:59.994857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:00.018630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:00.020622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:00.022071 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f5fd4a7-76dc-4532-b7bd-3288bb326e6a tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 200 len: 1368 microversion: 2.47 time: 0.270922 Aug 24 02:13:00.029262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3582/4574] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:12:59 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:13:01.268413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-891cd6b7-66e3-4de1-b476-fb66396c6139 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: .version_select at 0x7f6b912fcee0>, body: {"keypair": {"name": "tempest-keypair-2097240845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADvCQwKwPBbqNs07ssVAACUzKeV3vzgqRU5qIjuHQgGdMzJJ4Ditf0oMEFx3zQ491PlQvLmMOAiBgii6FstfdKYDRIwTBosdzX/uGFUS1DV6ZG9isnxsouZ6hN3rwqJFQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:01.336414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-891cd6b7-66e3-4de1-b476-fb66396c6139 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:01.357524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-891cd6b7-66e3-4de1-b476-fb66396c6139 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:01.443113 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-891cd6b7-66e3-4de1-b476-fb66396c6139 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.053666 Aug 24 02:13:01.444772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3583/4575] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:13:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:13:01.461322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808e417a-5321-4783-a023-ac43a618520e", "name": "network-vif-deleted", "tag": "b8e81be1-64cc-4f3d-99d3-e016bb507d83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:01.492215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:01.492880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:01.493331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:01.546339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] Creating event network-vif-deleted:b8e81be1-64cc-4f3d-99d3-e016bb507d83 for instance 808e417a-5321-4783-a023-ac43a618520e on n-h1-854121-3 Aug 24 02:13:01.559522 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ee002b2d-982f-4e87-96bd-d42ab18e9910 req-9db4ac91-b15a-4e62-88c6-25f883f8c457 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112765 Aug 24 02:13:01.568945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3584/4576] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:01.582991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:01.585275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:01.609606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:01.610612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:01.612700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:01.615440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:01.616890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:01.626339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:01.761351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:01.762168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:01.762804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:01.763455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lazy-loading 'fault' on Instance uuid 808e417a-5321-4783-a023-ac43a618520e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:13:01.972010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48509a100b454a73adeae8471b407558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961c8ccd53de4536bea85edb16547d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:01.986424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7cc3bc81-5d4d-44ea-b28f-2b1eb65d7ff6 tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 200 len: 1305 microversion: 2.1 time: 0.412553 Aug 24 02:13:01.989083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3585/4577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:01 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 1305 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:02.016341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:02.017132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: e6eaa55f-a3e2-4628-801f-467b3303fc89] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:02.033050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.036315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.036805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.038392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.038861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.039293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.078260 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] HTTP exception thrown: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Request method failure captured: Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 HTTP/1.1 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjwIbrbWEmbzDN3di5TbfCWIc0LVE7V1rwklbZQv3TDbxH1IGhDIFe2kH9dgDxs_Mx8p83je29G3RXCwYZruGj1bsnmU2Anl8eNLQmZs_86z8V_vJWudJoBGcnM0wWvFu8-sUuwol11BxA-xCfOeiKU2cZHssdapAh2xoZK2E3Rxww Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b99e409a350449b19fb1aded78066a61 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b99e409a350449b19fb1aded78066a61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b99e409a350449b19fb1aded78066a61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b99e409a350449b19fb1aded78066a61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b99e409a350449b19fb1aded78066a61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b99e409a350449b19fb1aded78066a61 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerShowV247Test-2012714412-project Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 11e93bf87ff9446f80960befecbad111 Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerShowV247Test-2012714412-project Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e6eaa55f-a3e2-4628-801f-467b3303fc89'} Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:02.082168 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:02.086354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Returning 404 to user: Instance e6eaa55f-a3e2-4628-801f-467b3303fc89 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:13:02.086851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1f4e8d1-9396-4825-ad1a-abc162f41b14 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89" status: 404 len: 111 microversion: 2.47 time: 0.094342 Aug 24 02:13:02.091422 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3586/4578] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:13:01 2022] GET /compute/v2.1/servers/e6eaa55f-a3e2-4628-801f-467b3303fc89 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:13:02.098600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:02.099642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:02.108932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.113249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.114066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.115025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.115708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.116346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.185482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:13:02.401918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35e96bb7-1f55-41cb-b011-f8ab58667fa0 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e" status: 204 len: 0 microversion: 2.47 time: 0.308048 Aug 24 02:13:02.402585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3587/4579] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:13:02 2022] DELETE /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:13:02.422287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:02.424136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:02.441539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.442057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.442484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.446697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:02.447602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:02.449874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:02.624388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:02.639980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:02.647859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:02.652402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62af2331-c6b0-4880-8de9-e5d035a85a9e tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e" status: 200 len: 1363 microversion: 2.47 time: 0.241442 Aug 24 02:13:02.653391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3588/4580] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:13:02 2022] GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:13:03.011480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:03.013750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] [instance: 808e417a-5321-4783-a023-ac43a618520e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:03.026771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:03.031009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:03.031687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:03.032703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:03.034706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:03.036921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:03.060276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] HTTP exception thrown: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Request method failure captured: Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e HTTP/1.1 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkSEKVsOup0EOmj_mC60U7aQNUKYY_rqw9auPIYggZLj08B2gF4xBaLt6jM1YA1YibEf7gq1Q5DnrK_o9mzDKWYvUrMSmoWx-8cl8eYbyr5EG7zmYrQTbIk2KJrRW0ADsHEnQ016Rpbd84wYz-fzzmFtPzzomPMx8iBXUmTM60403I Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 961c8ccd53de4536bea85edb16547d75 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerPasswordTestJSON-107486748 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/961c8ccd53de4536bea85edb16547d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/961c8ccd53de4536bea85edb16547d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/961c8ccd53de4536bea85edb16547d75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_961c8ccd53de4536bea85edb16547d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerPasswordTestJSON-107486748 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 961c8ccd53de4536bea85edb16547d75 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerPasswordTestJSON-107486748 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerPasswordTestJSON-107486748-project Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 48509a100b454a73adeae8471b407558 Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerPasswordTestJSON-107486748-project Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '808e417a-5321-4783-a023-ac43a618520e'} Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:03.077810 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. Aug 24 02:13:03.082679 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:03.086190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] Returning 404 to user: Instance 808e417a-5321-4783-a023-ac43a618520e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:13:03.088405 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d296dc54-ce72-4ab4-a81a-90d35271320b tempest-ServerPasswordTestJSON-107486748 tempest-ServerPasswordTestJSON-107486748-project] 10.222.0.49 "GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e" status: 404 len: 111 microversion: 2.1 time: 0.080862 Aug 24 02:13:03.093126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3589/4581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:03 2022] GET /compute/v2.1/servers/808e417a-5321-4783-a023-ac43a618520e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:13:03.680479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:03.681773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:03.692021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:03.695494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:03.697155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:03.700097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:03.709521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:03.709985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:04.266113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:04.278141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:04.301768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11e93bf87ff9446f80960befecbad111', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e409a350449b19fb1aded78066a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:04.305461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca987cb5-5ef0-4b61-902a-d09a8eb995f9 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e" status: 200 len: 1363 microversion: 2.47 time: 0.628793 Aug 24 02:13:04.319150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3590/4582] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:13:03 2022] GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e => generated 1363 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:13:05.343519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:05.345297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] [instance: 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:05.362950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:05.375299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:05.375819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:05.376271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:05.377044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:05.377511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:05.377944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:05.425192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] HTTP exception thrown: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Request method failure captured: Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e HTTP/1.1 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYjwIbrbWEmbzDN3di5TbfCWIc0LVE7V1rwklbZQv3TDbxH1IGhDIFe2kH9dgDxs_Mx8p83je29G3RXCwYZruGj1bsnmU2Anl8eNLQmZs_86z8V_vJWudJoBGcnM0wWvFu8-sUuwol11BxA-xCfOeiKU2cZHssdapAh2xoZK2E3Rxww Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.47 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: b99e409a350449b19fb1aded78066a61 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b99e409a350449b19fb1aded78066a61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b99e409a350449b19fb1aded78066a61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b99e409a350449b19fb1aded78066a61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b99e409a350449b19fb1aded78066a61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: b99e409a350449b19fb1aded78066a61 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerShowV247Test-2012714412 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerShowV247Test-2012714412-project Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 11e93bf87ff9446f80960befecbad111 Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerShowV247Test-2012714412-project Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1f3267e4-ab66-4c9e-8740-1a5e49ffd77e'} Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:13:05.427853 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] Returning 404 to user: Instance 1f3267e4-ab66-4c9e-8740-1a5e49ffd77e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05060830-6ee4-43f4-83c2-579d65b8f550 tempest-ServerShowV247Test-2012714412 tempest-ServerShowV247Test-2012714412-project] 10.222.0.49 "GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e" status: 404 len: 111 microversion: 2.47 time: 0.090637 Aug 24 02:13:05.432098 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3591/4583] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:13:05 2022] GET /compute/v2.1/servers/1f3267e4-ab66-4c9e-8740-1a5e49ffd77e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:13:06.526114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1725611139", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62fe4463-9689-4fd8-807d-9686124a81d4"}], "security_groups": [{"name": "tempest-securitygroup--466000333"}], "key_name": "tempest-keypair-2097240845", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:07.021124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] validate_networks() for [('62fe4463-9689-4fd8-807d-9686124a81d4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:09.986075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:09.987519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:09.988490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:09.989326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:09.989952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:10.032339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:10.032339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:10.032824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:10.034481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:10.036025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:10.040111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:10.090733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:10.105836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:10.142712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:10.146333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:10.328656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5110afb6-2bbd-483b-ab43-ba6f797d1365 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.807408 Aug 24 02:13:10.335465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3592/4584] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 3816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:10.363755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-296d6306-fe2e-4c89-a5c7-9f2805b83ef2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:10.365487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-296d6306-fe2e-4c89-a5c7-9f2805b83ef2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:11.022448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-296d6306-fe2e-4c89-a5c7-9f2805b83ef2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:11.030557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-296d6306-fe2e-4c89-a5c7-9f2805b83ef2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1239 microversion: 2.1 time: 0.685971 Aug 24 02:13:11.031144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3593/4585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:10 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1239 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:12.052333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:12.053283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:12.065519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:12.072933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:12.073568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:12.074471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:12.075123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:12.075727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:12.457892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:12.471461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9eb2cb05-d624-4b14-81a8-5b43c300454c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1291 microversion: 2.1 time: 0.423115 Aug 24 02:13:12.478414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3594/4586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:12 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1291 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:13.501582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:13.502494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:13.510375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:13.515421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:13.516441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:13.517512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:13.519006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:13.520161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:13.926744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:13.957174 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eba380f7-0675-42bc-88f0-40dfc79028cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1297 microversion: 2.1 time: 0.456139 Aug 24 02:13:13.959346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3595/4587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:13 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1297 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:14.982794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:14.983430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:15.001758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:15.004755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:15.005542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:15.006526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:15.009625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:15.010438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:15.397072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:15.405984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4ee805b-f4d5-4a08-aab6-213a6c10dc43 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1297 microversion: 2.1 time: 0.427949 Aug 24 02:13:15.421731 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3596/4588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:14 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1297 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:16.432574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:16.433266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:16.453146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:16.453646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:16.454083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:16.455060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:16.455518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:16.455946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:18.315415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:18.347263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df2e9870-5662-4339-9d74-1a6a14ce89f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 1.913981 Aug 24 02:13:18.347849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3597/4589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:16 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:19.372573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:19.373241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:19.403723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:19.407807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:19.410589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:19.411363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:19.415716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:19.416245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:19.458460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:20.061438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:21.027091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:21.300443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:21.320951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1689283a-0f4f-43cd-b9ba-ac1cc6c9766b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 1.949556 Aug 24 02:13:21.324878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3598/4590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:19 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:22.344424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:22.346122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:22.361366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:22.363001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:22.363669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:22.364678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:22.365432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:22.366081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:23.537261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:23.557825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8068928-bbd8-4774-a366-004e4b808098 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 1.217885 Aug 24 02:13:23.565733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3599/4591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:22 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:24.048303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:24.076901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:24.077384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:24.088284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:24.127898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] Creating event network-changed:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:13:24.142474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ee097457-e75f-449c-a78a-8035246cacea req-74359b05-f49b-41f0-8a8d-0c9355f03965 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098509 Aug 24 02:13:24.151274 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3600/4592] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:13:24.585350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:24.586057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:24.607734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:24.608234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:24.608680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:24.609449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:24.609901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:24.610325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:25.111062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:25.125676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b61f310-7f05-48f0-9f2c-de29e3182158 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 0.542550 Aug 24 02:13:25.126307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3601/4593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:24 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:26.151027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:26.151716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:26.177283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:26.178364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:26.178812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:26.179536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:26.182394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:26.184628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:28.167881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:28.196767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01a6f92e-c402-473a-a353-0ddd5709d393 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 2.049650 Aug 24 02:13:28.201396 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3602/4594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:26 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:29.224981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:29.225625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:29.235269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:29.252354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:29.252900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:29.256091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:29.259031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:29.261016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:29.264149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:30.279616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:30.289948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ecdff519-c24e-4ce0-8d66-319e531aec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 1.069673 Aug 24 02:13:30.311300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3603/4595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:29 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:30.322219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1494208390", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f0409599-1eaa-45de-bfd2-a77e5936e69d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:30.486231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:32.203964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:32.204892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:32.209738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:32.210576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:32.211122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:32.228946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:32.236109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:32.238211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:32.239199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:32.257686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:32.257888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:32.316571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:32.323649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:32.492304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:32.494715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0409599-1eaa-45de-bfd2-a77e5936e69d',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:32.738321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08ebc08a-e468-4d94-9bd0-8b13e101bf46 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.423934 Aug 24 02:13:32.742619 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3604/4596] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:33.355043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-930711810", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "97607477-ef92-4aa1-85d7-c8383aaa8ff3"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:33.468948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] validate_networks() for [('97607477-ef92-4aa1-85d7-c8383aaa8ff3', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:35.975446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:35.976917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:35.978396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:35.979920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:35.980972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:36.000938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.001700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.002361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.003329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.005522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.007707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.061147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Getting quotas for project 879b669f3adf4668916a5a73b44ccec5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:36.074501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Getting quotas for user 4d2f6b3dd0a543a5a608091c8302c6f8 and project 879b669f3adf4668916a5a73b44ccec5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:36.102523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:36.107081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:36.213182 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16232759-c9c2-4577-9d21-1ee8c27b24aa tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.469068 Aug 24 02:13:36.214329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3605/4597] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:36.225219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:36.228137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:36.261420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.273526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.275261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.276227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.276946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.277611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.693799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:36.712459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a03f7c61-3828-47cc-9541-5449bc57a5c1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 0.488631 Aug 24 02:13:36.714711 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3606/4598] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:36 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:36.725034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:36.727495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:36.744581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.745540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.748228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.749341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:36.750865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:36.753501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:36.987073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:37.002461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e30d0df7-a718-4f19-a4ab-e0579c696022 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1173 microversion: 2.1 time: 0.285495 Aug 24 02:13:37.004674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3607/4599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:36 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1173 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:37.018391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99abe66c-a7e6-42d6-8411-26c594fa4e5c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:37.026189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99abe66c-a7e6-42d6-8411-26c594fa4e5c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:37.253103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99abe66c-a7e6-42d6-8411-26c594fa4e5c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:37.261718 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99abe66c-a7e6-42d6-8411-26c594fa4e5c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1216 microversion: 2.1 time: 0.252864 Aug 24 02:13:37.266274 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3608/4600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:37 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1216 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:37.277995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-plugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:37.325736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:37.331404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:37.336382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:37.371552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] Creating event network-vif-plugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:13:37.397850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b555441a-be82-441b-84c6-805b3437ec16 req-4a863160-a66f-49ae-96dc-c9fc6c60191e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127434 Aug 24 02:13:37.401798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3609/4601] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:37.736841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:37.738706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:37.753057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:37.753556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:37.768824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:37.769750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:37.770302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:37.770664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:38.921980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:38.934176 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d657f67-be0f-45ce-a880-863d3ef10693 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 1.198892 Aug 24 02:13:38.935757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3610/4602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:37 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:38.950869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:38.959870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:38.975823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:38.980767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:38.983222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:38.985093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:38.986842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:38.989223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:39.197805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:39.213350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cb93a87-c4dd-48e5-9988-dfbf0aacf246 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1173 microversion: 2.1 time: 0.272304 Aug 24 02:13:39.240964 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3611/4603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:38 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1173 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:39.257296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:39.260512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:39.279754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:39.281291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:39.282031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:39.283500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:39.286751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:39.288312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:39.560656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:39.576303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0121e192-c1c9-4068-8830-8ee632f2eadd tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1274 microversion: 2.1 time: 0.327089 Aug 24 02:13:39.578573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3612/4604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:39 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:39.957361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:39.957999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:39.974292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:39.976236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:39.978117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:39.983288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:39.984598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:39.985641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:40.445802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:40.464694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-303cb0ec-fecc-4b4a-b562-5d28babbf937 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1364 microversion: 2.1 time: 0.510483 Aug 24 02:13:40.468208 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3613/4605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:39 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:40.495724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:40.496350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:40.520555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:40.521151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:40.523595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:40.525346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:40.525817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:40.526249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:40.679571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:40.698986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfffb288-96ec-46cf-8336-0a1490e2e9f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1173 microversion: 2.1 time: 0.225895 Aug 24 02:13:40.713218 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3614/4606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:40 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1173 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:40.722333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:40.724120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:40.740368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:40.743101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:40.744269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:40.748413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:40.749263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:40.750572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:40.889160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:40.899213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a89f1adb-34b0-4535-8992-6de1bd9c11e1 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1274 microversion: 2.1 time: 0.184606 Aug 24 02:13:40.902750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3615/4607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:40 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:41.488057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:41.489364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:41.503773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:41.504684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:41.507087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:41.508143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:41.510114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:41.510821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:41.959088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:41.974761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4859a98f-0458-401a-9d84-d474504f0668 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1551 microversion: 2.1 time: 0.490546 Aug 24 02:13:41.982933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3616/4608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:41 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1551 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:41.988229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:42.032423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:42.063348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.064149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.069904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.072075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.074208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.074947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.289998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:42.299730 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3aa512e-fbd1-4f25-adf1-13e7464cb985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1173 microversion: 2.1 time: 0.315307 Aug 24 02:13:42.306651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3617/4609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:41 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1173 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:42.321797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:42.332074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:42.349984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.352696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.353289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.355894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.359125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.362083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.426784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:42.508524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:42.520751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2102245-4d85-4194-b47e-b6dc75a195c2 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1274 microversion: 2.1 time: 0.212621 Aug 24 02:13:42.543410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3618/4610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:42 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:42.548801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:42.551544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:42.564745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.566264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.567088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.569811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:42.570439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:42.571831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:42.787978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7bf6f2a9-fbdb-4f0a-83bc-50c19920917d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.255886 Aug 24 02:13:42.789138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3619/4611] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:13:42 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:43.335618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:43.336463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:43.350445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:43.353218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:43.356709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:43.360861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:43.362343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:43.367051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:45.761584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:45.776103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9ca587c-1d03-421e-80cf-09c66aac6985 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1215 microversion: 2.1 time: 2.453436 Aug 24 02:13:45.780255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3620/4612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:43 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1215 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:45.792007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:45.793135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:45.811796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:45.813738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:45.816769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:45.817667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:45.818403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:45.821033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:46.038800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:46.423286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:46.435591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da57aafa-f3e0-41b5-8ecf-9676bdedd506 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.652998 Aug 24 02:13:46.462288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3621/4613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:45 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:46.799714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:46.800619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:46.813537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:46.815088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:46.816549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:46.819318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:46.821546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:46.822278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:47.258201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:47.404884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:47.416041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dcec415e-fe60-4008-b84e-c035b506007b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1215 microversion: 2.1 time: 0.620090 Aug 24 02:13:47.438358 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3622/4614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:46 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1215 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:47.451330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:47.467251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:47.468186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:47.468975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:47.485192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] Creating event network-changed:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:13:47.506367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e07fe718-cbd2-4da4-b0a1-c5956d5b4aef req-fdf1130b-020b-4bd3-83d1-c47b8934b183 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066370 Aug 24 02:13:47.507320 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3623/4615] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:47.525110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:47.526099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:47.534911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:47.537953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:47.538831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:47.539877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:47.540574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:47.541326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:48.293802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:48.312367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd8ac4d3-355f-47ec-9235-51fa86f1bf6a tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.802389 Aug 24 02:13:48.314361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3624/4616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:47 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:48.443272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:48.448709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:48.466181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:48.469492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:48.471119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:48.478732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:48.479334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:48.479790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:49.533849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:49.542900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eeb90be-459c-4a22-9b63-ca77cf3e6939 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 1.105015 Aug 24 02:13:49.545744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3625/4617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:48 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:13:49.575511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e57073af-fbc5-455c-ac94-42eaf1c0260c", "tag": "dd4d3930-12d8-4dad-9637-9218fd9b2110"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:49.593590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:49.594438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:49.595107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:49.632251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] Creating event network-changed:dd4d3930-12d8-4dad-9637-9218fd9b2110 for instance e57073af-fbc5-455c-ac94-42eaf1c0260c on n-h1-854121-3 Aug 24 02:13:49.644420 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-95b55174-15b9-4105-a1b2-b4b523c89521 req-7b2823a1-09df-4c6e-85ae-e160720bb0d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083184 Aug 24 02:13:49.645261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3626/4618] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:50.055281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1306693789", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:50.147814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] validate_networks() for [('d5f19509-db2c-410b-8905-9dc2ff0ddb1a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:51.354369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:51.355340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:51.355537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:51.355925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:51.357481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:51.368989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:51.369852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:51.370563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:51.371547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:51.372280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:51.373048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:51.414216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:51.421831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for user d2da781ddf9a4aa0a4c04554ff8ecd2b and project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:51.437768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:51.441113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:51.537866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-909e6a79-1bc5-40a6-97d6-242ca57d7f6f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.889854 Aug 24 02:13:51.538650 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3627/4619] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:51.553571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:51.554273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:51.571694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:51.572098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:51.572547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:51.574249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:51.575264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:51.575704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:51.958402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:51.969781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07ec8167-e806-4423-bcd1-968a9680aea7 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.430029 Aug 24 02:13:51.972914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3628/4620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:51 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:52.001963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:52.002664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:52.016986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:52.017751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:52.018405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:52.019339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:52.023172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:52.023829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:53.024874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:53.033406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c67db33f-2276-443e-afbf-4212f0a25ce2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 1.045894 Aug 24 02:13:53.044871 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3629/4621] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:51 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:53.046146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:53.061684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:53.085714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:53.087526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:53.088214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:53.089882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:53.091575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:53.093251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:53.274735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:53.286550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-750589ac-bdac-4f36-83ce-82e241909ee3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1274 microversion: 2.1 time: 0.251128 Aug 24 02:13:53.303511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3630/4622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:53 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:53.308970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ef4d40-c43a-4d94-91ba-6dff75a5af95", "tag": "25436856-bea6-4fcf-8e1d-89fd688b80b8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:53.329219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:53.351412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:53.356670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:53.357666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:53.401034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] Creating event network-changed:25436856-bea6-4fcf-8e1d-89fd688b80b8 for instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 on n-h2-854121-3 Aug 24 02:13:53.430087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d37999ca-395a-4980-845d-46b90c16afc3 req-09cd6bcb-f706-4949-876c-79c2766ceabc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121360 Aug 24 02:13:53.433979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3631/4623] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:53.456240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:53.461060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:53.491698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:53.496306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:53.497344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:53.504613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:53.506036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:53.506648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:54.072407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:54.082694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81e00ea2-c274-4c6f-bc54-c30bb58e98e6 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.643925 Aug 24 02:13:54.100095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3632/4624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:53 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:54.575373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1636796180", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "85f7e850-6464-4766-87ff-5993daec54ed"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:54.706344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] validate_networks() for [('85f7e850-6464-4766-87ff-5993daec54ed', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:55.865856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:55.866430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:55.866707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:55.867335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:55.868011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:55.893266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:55.894026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:55.894642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:55.895585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:55.896228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:55.896861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:55.931895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Getting quotas for project d7df92b941004476b8782a190e9af11e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:55.944136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Getting quotas for user 3ae05c718e8f46fc93bc6bb76fef537d and project d7df92b941004476b8782a190e9af11e. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:55.983646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:55.986534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:56.075171 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d013bd46-4e6d-4238-a7db-c6b5e0a392cc tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.973340 Aug 24 02:13:56.076450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3633/4625] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:56.093245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1509949656", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:56.179384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] validate_networks() for [('d5f19509-db2c-410b-8905-9dc2ff0ddb1a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:13:57.281745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:13:57.282417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:13:57.282783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:13:57.283379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:13:57.283803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:13:57.301165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:57.301667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:57.302161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:57.303257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:57.304111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:57.304954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:57.410311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:13:57.423023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for user d2da781ddf9a4aa0a4c04554ff8ecd2b and project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:13:57.441169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:13:57.444213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:13:57.592447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44610993-7b25-449d-9011-bc87ed1ef686 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.514412 Aug 24 02:13:57.594851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3634/4626] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:13:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:13:57.601406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:57.602593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:57.613230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:57.614211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:57.615690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:57.616665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:57.617790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:57.618884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:58.580453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:58.596403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cc20723-57ec-476d-964c-cc32806ff754 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 0.999432 Aug 24 02:13:58.597051 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3635/4627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:57 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:58.607743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:58.609546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:58.619186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:58.620276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:58.622143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:58.623205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:58.623829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:58.624436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:58.958335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:58.983020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67e22114-b543-440d-90ae-194ca9f32b69 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.375820 Aug 24 02:13:59.014984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3636/4628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:58 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:59.026280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:59.026914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:59.049130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.051865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.053008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.056994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.058278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.059388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.170560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:59.181666 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16e5e4cd-850f-416a-b23a-8d55bd86a1ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1286 microversion: 2.1 time: 0.164529 Aug 24 02:13:59.183863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3637/4629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:59 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:59.203691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d5d503-43c2-4722-be4d-110754c00312", "tag": "2cdc2691-9fd9-40f6-a282-836b503c2a83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:59.224762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.237513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.238316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.263545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] Creating event network-changed:2cdc2691-9fd9-40f6-a282-836b503c2a83 for instance 18d5d503-43c2-4722-be4d-110754c00312 on n-h1-854121-3 Aug 24 02:13:59.268955 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9e65a619-e457-4f7e-b6e6-4a3dde26bc6d req-391c69f2-b803-4e47-ac49-a109ca84f0dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083465 Aug 24 02:13:59.269857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3638/4630] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:59.281399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:59.282347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:59.296821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.300914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.301664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.302670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.303343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.311569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.538875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:13:59.554256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee1c0941-6c2d-48b9-b27b-becda7b13902 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1274 microversion: 2.1 time: 0.280659 Aug 24 02:13:59.558408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3639/4631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:59 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1274 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:13:59.576509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ef4d40-c43a-4d94-91ba-6dff75a5af95", "name": "network-vif-plugged", "status": "completed", "tag": "25436856-bea6-4fcf-8e1d-89fd688b80b8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:13:59.615718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.616380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.616842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.627097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:13:59.658679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] Creating event network-vif-plugged:25436856-bea6-4fcf-8e1d-89fd688b80b8 for instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 on n-h2-854121-3 Aug 24 02:13:59.666977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c056acf7-a2f4-4648-9513-65c875f5100b req-12c5c599-f5aa-41f1-839d-9923c2e349f3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105360 Aug 24 02:13:59.669435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3640/4632] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:13:59.680257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:13:59.686811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:13:59.704202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.706163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.714247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:13:59.719417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:13:59.720127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:13:59.721576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.053344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:00.062344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75471d08-23ef-4062-81f0-f59a739aa14e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 0.391228 Aug 24 02:14:00.063508 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3641/4633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:13:59 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:00.068544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:00.071128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:00.087717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.090491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.091230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.092309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.093017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.093688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.369319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:00.387256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-21b24f03-deaa-4e6c-8fe1-1d6a70f8e159 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1316 microversion: 2.1 time: 0.321581 Aug 24 02:14:00.390066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3642/4634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:00 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:00.397342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:00.398136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:00.424262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.424796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.425555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.429109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.430242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.430698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.512221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:00.524023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f994476-34fb-43c3-8f86-00d56ff0e0f1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1286 microversion: 2.1 time: 0.132156 Aug 24 02:14:00.540908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3643/4635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:00 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:00.581114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:00.582258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:00.592120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.592994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.593987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.594997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:00.596239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:00.596970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:00.688710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:00.697823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ec5a2cf-5e9b-4dc5-96aa-f7acb74c524e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1280 microversion: 2.1 time: 0.124232 Aug 24 02:14:00.698883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3644/4636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:00 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1280 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:01.083777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:01.084399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:01.100820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:01.102526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:01.102983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:01.105332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:01.109597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:01.112645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:01.540373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:01.563583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95d4b7b7-1ef7-46fa-9561-bea624ddb1f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 0.479287 Aug 24 02:14:01.567368 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3645/4637] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:01 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:01.591331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:01.593409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:01.610161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:01.610950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:01.611404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:01.612134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:01.616676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:01.617638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.016246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:02.024800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a999ed2-d83a-45f9-8b83-608f7629b71c tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1505 microversion: 2.1 time: 0.455399 Aug 24 02:14:02.025394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3646/4638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:01 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1505 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:02.047449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:02.048271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:02.055486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:02.056200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:02.057120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.058058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:02.058668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:02.060012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.463716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:02.472286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3cd408d-eb9d-4eb7-ab43-9d867d6a7b4e tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.431592 Aug 24 02:14:02.472899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3647/4639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:02 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:02.477549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57073af-fbc5-455c-ac94-42eaf1c0260c", "name": "network-vif-plugged", "status": "completed", "tag": "dd4d3930-12d8-4dad-9637-9218fd9b2110"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:02.494431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:02.495188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:02.495803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.515280 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] Creating event network-vif-plugged:dd4d3930-12d8-4dad-9637-9218fd9b2110 for instance e57073af-fbc5-455c-ac94-42eaf1c0260c on n-h1-854121-3 Aug 24 02:14:02.520570 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a94b1d79-c19f-4a73-bd75-eb0e94eaba82 req-1a5a2822-bb4a-4eb8-acc2-5b9f6bb2df29 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046382 Aug 24 02:14:02.522026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3648/4640] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:02.530311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:02.531457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:02.539479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:02.540205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:02.540852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.542071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:02.544142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:02.544793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:02.931575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:02.948670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4374f9ec-a28a-4c69-8027-e8bdbb775990 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.425153 Aug 24 02:14:02.952487 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3649/4641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:02 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:03.384776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Calling method '.version_select at 0x7f6b90eb8700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:03.385746 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:14:03.385746 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:14:03.387143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.387706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.388155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.427156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.428045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.428816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.475313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.475932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.476644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.484927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4572ade6-9c52-40d8-a1e3-8c4e0bf50f13 tempest-PortsAdminExtendedAttrsTestJSON-2081472147 tempest-PortsAdminExtendedAttrsTestJSON-2081472147-project-admin] 10.222.0.49 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.530276 Aug 24 02:14:03.486734 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3650/4642] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:14:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:03.495302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:03.496148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:03.505422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.506082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.506366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.507042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.507493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.508109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.540388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37bc165b-c73e-422f-93a7-876cd136a2d5 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips" status: 200 len: 109 microversion: 2.1 time: 0.051569 Aug 24 02:14:03.549720 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3651/4643] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:14:03 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips => generated 109 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:03.557605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:03.558482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:03.569294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.570124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.570873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.571743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.572383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.573199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:03.912206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:03.923565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1867c98-e9d3-476f-977c-0179648ad032 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1203 microversion: 2.1 time: 0.372331 Aug 24 02:14:03.928595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3652/4644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:03 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1203 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:03.948443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2671f0bd-e802-4310-8db6-57a323c1cda3", "tag": "94bafaf7-7d54-4e86-94b3-04a4d4763ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:03.958777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:03.964823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:03.966166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.004854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] Creating event network-changed:94bafaf7-7d54-4e86-94b3-04a4d4763ac7 for instance 2671f0bd-e802-4310-8db6-57a323c1cda3 on n-h2-854121-3 Aug 24 02:14:04.019542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-95ff6761-7819-4bfc-a40a-a72e62a8991e req-64cad4a3-9ad1-4671-9f8d-de2a93f894c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075884 Aug 24 02:14:04.020468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3653/4645] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:04.040129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:04.045059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:04.058582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.062961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.064400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.065843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.066808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.067278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.796077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:04.804594 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa868c54-ed14-40c6-967e-6224f59f94d6 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.782706 Aug 24 02:14:04.805138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3654/4646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:04 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:04.826222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:04.827120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:04.834437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.834949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.835468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.836427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.837287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.837732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.862820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65563a7f-e6ad-4826-94f0-69c8dbfa80ba tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips" status: 200 len: 109 microversion: 2.1 time: 0.043673 Aug 24 02:14:04.863788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3655/4647] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:14:04 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:04.868888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:04.869598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:04.876528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.877076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.877704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:04.878610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:04.879071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:04.879504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.242605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:05.253988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07d54ae4-7563-4f41-ae67-2b20c679e2fe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.388916 Aug 24 02:14:05.267828 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3656/4648] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:04 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:05.271417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:05.271927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:05.280246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.280766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.281214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.282717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.283795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.284379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.311445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aea268ca-a8a0-43b7-8eb2-e03e8d85abff tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips/tempest-ServerAddressesTestJSON-1107274575-network" status: 200 len: 94 microversion: 2.1 time: 0.046986 Aug 24 02:14:05.312035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3657/4649] 10.222.0.49 () {58 vars in 1401 bytes} [Wed Aug 24 02:14:05 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95/ips/tempest-ServerAddressesTestJSON-1107274575-network => generated 94 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:14:05.317107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:05.317940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:05.324697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.325219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.325848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.326560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.327016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.327442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.596441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:05.608621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-764059f7-6d94-4610-935c-b971101a3475 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1390 microversion: 2.1 time: 0.295234 Aug 24 02:14:05.615993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3658/4650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:05 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1390 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:05.616761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d5d503-43c2-4722-be4d-110754c00312", "name": "network-vif-plugged", "status": "completed", "tag": "2cdc2691-9fd9-40f6-a282-836b503c2a83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:05.629806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.630592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.631249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.644979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] Creating event network-vif-plugged:2cdc2691-9fd9-40f6-a282-836b503c2a83 for instance 18d5d503-43c2-4722-be4d-110754c00312 on n-h1-854121-3 Aug 24 02:14:05.651123 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4a19654f-4291-4439-bba0-d04f58aa6642 req-48767d99-0bcb-4458-aa3f-678faf0cfb46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037853 Aug 24 02:14:05.651725 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3659/4651] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:05.657982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:05.658525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:05.666538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.668023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.668478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.669320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.669796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.670234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.692606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:05.702772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:14:05.816329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8835661-7282-4585-bbfe-9ad3aca76811 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "DELETE /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 204 len: 0 microversion: 2.1 time: 0.163130 Aug 24 02:14:05.817474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3660/4652] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:14:05 2022] DELETE /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:14:05.827937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:05.828590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:05.835535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.836163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.836850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:05.837945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:05.838610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:05.839141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.168077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:06.176096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2df9c95c-2dd0-44a9-ad3e-6aad576e9bf4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1390 microversion: 2.1 time: 0.354213 Aug 24 02:14:06.176750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3661/4653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:05 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:06.189441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:06.189441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:06.195953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.196297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.196758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.200885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.202116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.202943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.473911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:06.483695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8deae30-b80a-4287-a51b-aa0aee4e11a3 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1511 microversion: 2.1 time: 0.305660 Aug 24 02:14:06.484505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3662/4654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:06 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:06.491261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:06.491965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:06.494010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:06.504441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.505048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.505781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.506505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.507137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.507599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.707718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:06.717977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99aa450c-d28d-43f5-8b7f-afcfd0281ace tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.230935 Aug 24 02:14:06.718863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3663/4655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:06 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:06.726315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e", "tag": "bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:06.739388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.740941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.741643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.771770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] Creating event network-changed:bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae for instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e on n-h1-854121-3 Aug 24 02:14:06.779865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7f745e3f-5460-489e-a2b5-757ad1afe67b req-0a7f12a1-a52c-4b92-a49a-be10fe1fc690 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058554 Aug 24 02:14:06.781464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3664/4656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:06.790844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:06.791887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:06.800146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.800643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.801126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:06.802302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:06.803079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:06.803702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.041015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:07.051036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1411b692-df41-4019-8b8b-fdd3ceaf2970 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1390 microversion: 2.1 time: 0.267591 Aug 24 02:14:07.051633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3665/4657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:06 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1390 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:07.056454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:07.057392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:07.066179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.066918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.067581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.068294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.068772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.069380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.246925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:07.256744 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e6fa158-d340-44f1-b485-21a3e5645c8b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.203760 Aug 24 02:14:07.257699 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3666/4658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:07 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:07.262907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:07.263476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:07.270347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.271684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.272252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.273240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.273913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.274452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.310624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:14:07.347255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:07.451368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=18 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:07.463412 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6312b092-cdf1-419e-95a0-1a801437c3d4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 204 len: 0 microversion: 2.1 time: 0.203392 Aug 24 02:14:07.468981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3667/4659] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:14:07 2022] DELETE /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:14:07.477207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:07.477926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:07.486153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.486658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.487150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.487976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.488433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.489032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.674886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:07.687639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-220ed06d-5a85-4264-ae4f-6389c7b81e91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1396 microversion: 2.1 time: 0.215228 Aug 24 02:14:07.701196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3668/4660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:07 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1396 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:07.701196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:07.701196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:07.711237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.711747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.712185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.718784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.719500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.720060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.878056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:07.887405 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2120dc6e-d49c-4e87-955f-ed352018e46f tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1511 microversion: 2.1 time: 0.197476 Aug 24 02:14:07.887930 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3669/4661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:07 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:07.892548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:07.893200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:07.922213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.922709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.923232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:07.923846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:07.924306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:07.924759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.182371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:08.205040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1481b560-1894-4039-8116-4f47e6f5e80a tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.314666 Aug 24 02:14:08.205688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3670/4662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:07 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:08.277608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:08.278149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:08.288550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:08.289089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:08.289578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.290218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:08.295916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:08.297017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.697697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:08.708654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a97c4014-ffc1-4bb6-88ac-27ccf0a10b84 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.433309 Aug 24 02:14:08.717393 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3671/4663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:08 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:08.734179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ef4d40-c43a-4d94-91ba-6dff75a5af95", "name": "network-vif-deleted", "tag": "25436856-bea6-4fcf-8e1d-89fd688b80b8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:08.750405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:08.751444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:08.752193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.765491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] Creating event network-vif-deleted:25436856-bea6-4fcf-8e1d-89fd688b80b8 for instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 on n-h2-854121-3 Aug 24 02:14:08.771107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ad8fee8f-3a27-4edc-a6f4-1f538228e979 req-95469950-d256-4422-9dd5-a74e66b889a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041109 Aug 24 02:14:08.772600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3672/4664] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:08.779820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:08.780748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:08.789588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:08.790100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:08.790556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.791255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:08.791887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:08.792625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:08.989946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:09.005618 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a08bdfd-04e0-46d9-a7d5-884c441db3ae tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1396 microversion: 2.1 time: 0.228111 Aug 24 02:14:09.007247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3673/4665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:08 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1396 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:09.020794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:09.028055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:09.041649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.042372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.045210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.046856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.048042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.048672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.094291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.094676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.095258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.095905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lazy-loading 'fault' on Instance uuid 42ef4d40-c43a-4d94-91ba-6dff75a5af95 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:09.224090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d2f6b3dd0a543a5a608091c8302c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879b669f3adf4668916a5a73b44ccec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:09.227572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:09.237734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fafa98a2-bbdc-4452-9cf2-11c198f0ab09 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 200 len: 1306 microversion: 2.1 time: 0.222138 Aug 24 02:14:09.238247 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3674/4666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:09 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 1306 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:09.257089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:09.257990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:09.297398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.297973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.298571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.303171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.303730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.304232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.617727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:09.629956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa060a78-d1af-4994-93d4-90e6f8cc8a5c tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.377970 Aug 24 02:14:09.630818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3675/4667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:09 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:09.723588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2671f0bd-e802-4310-8db6-57a323c1cda3", "name": "network-vif-plugged", "status": "completed", "tag": "94bafaf7-7d54-4e86-94b3-04a4d4763ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:09.747856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.748360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.750736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.772286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] Creating event network-vif-plugged:94bafaf7-7d54-4e86-94b3-04a4d4763ac7 for instance 2671f0bd-e802-4310-8db6-57a323c1cda3 on n-h2-854121-3 Aug 24 02:14:09.798258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3ad94a81-f90b-4121-be72-4fa2999b42af req-8aada340-0cd6-421a-a7a0-fc6743dc9e26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078700 Aug 24 02:14:09.799080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3676/4668] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:14:09.804387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:09.811240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:09.825076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.827161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.837146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:09.838925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:09.839407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:09.840050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:10.287679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:10.303159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b958466-defd-495f-b10b-354eb0ed71c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.500668 Aug 24 02:14:10.304150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3677/4669] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:09 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:10.321582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:10.322873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:10.337205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:10.337805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:10.338257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:10.338978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:10.339437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:10.339929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.040467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:11.049717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59ac653d-d87e-402c-9f05-4e8722c3327b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1396 microversion: 2.1 time: 0.742077 Aug 24 02:14:11.050298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3678/4670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:10 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1396 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:11.058851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:11.060978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] [instance: 42ef4d40-c43a-4d94-91ba-6dff75a5af95] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:11.067576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.068063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.068503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.069242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.069699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.070121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.099521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] HTTP exception thrown: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Request method failure captured: Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 HTTP/1.1 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlKiuJDVMIP-Iz2aOY-Ir-7dW6KrzatHdcsRagk1RrK0kkfYZ9tq5puK-NgLYV9I7Bw66YYRJpI9KTR2Xb5yj4GPfA-iYdHMALjH_Z2xWO6OLzT8G_SpecTw_aGh8CaDz-KDYBVFAEScsKvW6KIzhEt00qd_xSZP8oQTQcK9Ec7YMo Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 879b669f3adf4668916a5a73b44ccec5 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerAddressesTestJSON-60149705 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/879b669f3adf4668916a5a73b44ccec5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/879b669f3adf4668916a5a73b44ccec5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/879b669f3adf4668916a5a73b44ccec5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_879b669f3adf4668916a5a73b44ccec5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerAddressesTestJSON-60149705 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 879b669f3adf4668916a5a73b44ccec5 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerAddressesTestJSON-60149705 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerAddressesTestJSON-60149705-project Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 4d2f6b3dd0a543a5a608091c8302c6f8 Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerAddressesTestJSON-60149705-project Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '42ef4d40-c43a-4d94-91ba-6dff75a5af95'} Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:11.101275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] Returning 404 to user: Instance 42ef4d40-c43a-4d94-91ba-6dff75a5af95 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c8d8488-ae4a-4131-a6b8-83e3c5586093 tempest-ServerAddressesTestJSON-60149705 tempest-ServerAddressesTestJSON-60149705-project] 10.222.0.49 "GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95" status: 404 len: 111 microversion: 2.1 time: 0.047670 Aug 24 02:14:11.108052 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3679/4671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:11 2022] GET /compute/v2.1/servers/42ef4d40-c43a-4d94-91ba-6dff75a5af95 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:14:11.128684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:11.129268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:11.137604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.138102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.138545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.139259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.140304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.141055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.634264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:11.643108 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1b61976-581f-4682-b09e-bb4d8ab2fe54 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1328 microversion: 2.1 time: 0.538638 Aug 24 02:14:11.644497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3680/4672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:11 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1328 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:11.650468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:11.651352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:11.659024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.659688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.660494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:11.661399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:11.662009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:11.662608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.083880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:12.096113 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e95b9a0-5911-46de-ae4f-100a9d4fd9a4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.450133 Aug 24 02:14:12.098868 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3681/4673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:11 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:12.114935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e57073af-fbc5-455c-ac94-42eaf1c0260c", "name": "network-vif-deleted", "tag": "dd4d3930-12d8-4dad-9637-9218fd9b2110"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:12.143521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.144592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.146119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.180327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] Creating event network-vif-deleted:dd4d3930-12d8-4dad-9637-9218fd9b2110 for instance e57073af-fbc5-455c-ac94-42eaf1c0260c on n-h1-854121-3 Aug 24 02:14:12.187237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-375bd654-da3b-4d4a-92e0-4d9b91a3aa3b req-5e96216a-d0d3-427e-afd8-db32046d9aa7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084081 Aug 24 02:14:12.188496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3682/4674] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:12.195889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e", "name": "network-vif-plugged", "status": "completed", "tag": "bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:12.208403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.209512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.210147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.227850 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] Creating event network-vif-plugged:bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae for instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e on n-h1-854121-3 Aug 24 02:14:12.235043 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1d71d3b5-ac86-43c3-a703-cc8077fce258 req-01125e3d-7e60-4d2e-a2e1-04da1c9e9477 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044150 Aug 24 02:14:12.236489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3683/4675] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:12.242780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:12.243703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:12.253282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.253973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.254577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.255477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.256353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.256988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.510105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:12.519614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c00332c3-351f-40c3-a0aa-93d77545564d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1188 microversion: 2.1 time: 0.281546 Aug 24 02:14:12.525820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3684/4676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:12 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:12.668512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:12.669316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:12.690368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.692914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.694626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:12.698153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:12.700057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:12.700742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:13.007390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:13.018602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8b88fff-2ff4-4087-b87f-d845f155bdda tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1529 microversion: 2.1 time: 0.354458 Aug 24 02:14:13.021619 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3685/4677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:12 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1529 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:13.050398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:13.052127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:13.071860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:13.078344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:13.082312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:13.083242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:13.084029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:13.085220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:13.649963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:13.660531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cea67bda-f315-4bd0-9ba9-4c3d44f716ee tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1529 microversion: 2.1 time: 0.619202 Aug 24 02:14:13.661170 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3686/4678] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:13 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1529 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:13.691099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:13.691819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:13.708270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:13.708787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:13.709231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:13.709937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:13.715146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:13.715459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:14.224632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:14.237676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-daf0dd4a-343b-4db6-9f74-bb3f98a76747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1322 microversion: 2.1 time: 0.574694 Aug 24 02:14:14.238549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3687/4679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:13 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:14.261162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:14.262659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:14.282105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:14.282874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:14.284270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:14.287402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:14.288298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:14.289883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:14.419459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:14.440789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd1dec12-52e1-4cba-9ec1-f35486a1e9e3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1188 microversion: 2.1 time: 0.200939 Aug 24 02:14:14.444213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3688/4680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:14 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:15.093266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:15.094440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:15.103708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.104527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.105807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:15.106736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.107383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.107983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:15.169017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] HTTP exception thrown: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Request method failure captured: Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 HTTP/1.1 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlhxGW9074xx6SF9rl0A7S_vIDZnULmpRZoDCkiiPPSAayKC_SvKVqwRsJ8GjS3asc1xBp2GPsele_2-sp8u1sHoIlStFwpNsFseX3z_-ZiAIQhjHiUOInyK5-LpajrhGyXEdY5vsv70JiRs3m9LLcLcffYBl96sXspDdddiOVyULU Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ba7d77e5aeb04d0ea9eb34c9ae3dd98b Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ba7d77e5aeb04d0ea9eb34c9ae3dd98b Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1570221236-project Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 702f0842506e4a8c94e86df24de1ceae Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236-project Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2671f0bd-e802-4310-8db6-57a323c1cda3'} Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:15.171882 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:15.176583 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:15.180608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Returning 404 to user: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:15.184701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0c8851d-8af9-4aee-ba42-f4808cd8e5c1 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 404 len: 111 microversion: 2.1 time: 0.739241 Aug 24 02:14:15.188491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3689/4681] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:14:14 2022] DELETE /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 111 bytes in 744 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:14:15.202003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:15.204824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:15.223385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.226919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.227589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:15.231751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.232610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.233264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:15.772123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:15.784822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4eccea1-e282-45bf-aaf7-b94f84dd7451 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1529 microversion: 2.1 time: 0.588531 Aug 24 02:14:15.787382 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3690/4682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:15 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1529 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:15.805958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:15.811299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:15.823696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.825345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.826264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:15.829078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:15.829982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:15.830604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.244320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:16.258762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6210516-a6e2-4c4a-b319-412bd5fdd317 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1516 microversion: 2.1 time: 0.469775 Aug 24 02:14:16.270640 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3691/4683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:15 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1516 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:16.284585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:16.285251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:16.303890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.304920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.305535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.306422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.307049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.307646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.543882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:16.559878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26bf7074-8e3b-4bf6-8dd5-d922ffecd71f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1188 microversion: 2.1 time: 0.287768 Aug 24 02:14:16.560921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3692/4684] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:16 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:16.570856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Action: 'update', calling method: >, body: {"server": {"name": "2671f0bd-e802-4310-8db6-57a323c1cda3_new"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:16.578179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:16.598673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.601035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.601687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.602677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.603373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.604381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.643316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] HTTP exception thrown: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Request method failure captured: Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: request: PUT /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 HTTP/1.1 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 64 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlhxGW9074xx6SF9rl0A7S_vIDZnULmpRZoDCkiiPPSAayKC_SvKVqwRsJ8GjS3asc1xBp2GPsele_2-sp8u1sHoIlStFwpNsFseX3z_-ZiAIQhjHiUOInyK5-LpajrhGyXEdY5vsv70JiRs3m9LLcLcffYBl96sXspDdddiOVyULU Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ba7d77e5aeb04d0ea9eb34c9ae3dd98b Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ba7d77e5aeb04d0ea9eb34c9ae3dd98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ba7d77e5aeb04d0ea9eb34c9ae3dd98b Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236 Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1570221236-project Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 702f0842506e4a8c94e86df24de1ceae Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1570221236-project Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: {"server": {"name": "2671f0bd-e802-4310-8db6-57a323c1cda3_new"}} Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2671f0bd-e802-4310-8db6-57a323c1cda3', 'body': {'server': {'name': '2671f0bd-e802-4310-8db6-57a323c1cda3_new'}}} Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:14:16.646367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:16.651340 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:16.657385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] Returning 404 to user: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:16.662961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab29cbdc-02cf-4b54-b70f-271c347f68d7 tempest-ServersNegativeTestMultiTenantJSON-1570221236 tempest-ServersNegativeTestMultiTenantJSON-1570221236-project] 10.222.0.49 "PUT /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 404 len: 111 microversion: 2.1 time: 0.096080 Aug 24 02:14:16.677185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3693/4685] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:14:16 2022] PUT /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:14:16.689273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:16.693495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:16.702689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.703980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.704925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.706289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.706952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.707583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.745453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'flavor' on Instance uuid 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:16.796022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:16.918823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f870b9c-7778-4157-8a33-ecbcf046ba90 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action" status: 200 len: 32 microversion: 2.1 time: 0.236371 Aug 24 02:14:16.919187 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3694/4686] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:16 2022] POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:14:16.957343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:16.959265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:16.976234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.977352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.979937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:16.981521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:16.982288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:16.983073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:17.045427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:14:17.262911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca176b5d-359a-47ea-9c76-a338a1887bc1 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 204 len: 0 microversion: 2.1 time: 0.328265 Aug 24 02:14:17.263931 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3695/4687] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:14:16 2022] DELETE /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:14:17.269284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:17.269993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:17.290182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:17.292317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:17.293900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:17.294648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:17.295113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:17.295548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.005073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:18.015866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2df8d73b-5cb7-4117-a517-0154180b6d3e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.750646 Aug 24 02:14:18.027251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3696/4688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:17 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:18.032112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:18.033936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:18.053681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:18.054467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:18.055070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.055955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:18.056554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:18.057146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.465676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:18.477808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4800ece1-cef0-4a7c-bf42-bcf0154da267 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1535 microversion: 2.1 time: 0.447235 Aug 24 02:14:18.479679 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3697/4689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:18 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1535 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:18.506540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:18.506540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:18.519755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:18.528926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:18.531018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.532006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:18.532746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:18.533616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.587137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:18.587736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:18.588237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:18.588806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lazy-loading 'fault' on Instance uuid e57073af-fbc5-455c-ac94-42eaf1c0260c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:18.641223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:18.649385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-908b0c63-e7e9-4068-ad47-df8d3900bfda tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1193 microversion: 2.1 time: 0.152125 Aug 24 02:14:18.649974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3698/4690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:18 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1193 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:19.050818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:19.051442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:19.064620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.067549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.067997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.068745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.069190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.078306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.355730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:19.369006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c5e398f-ea77-4241-aad2-dabb6ab0863f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.323493 Aug 24 02:14:19.381657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3699/4691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:19 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:19.502029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:19.502645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:19.524037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.527146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.528109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.529042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.529778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.532549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.755791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:19.768326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c14b803-b331-4ef6-b31c-214ce94b5e3b tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1535 microversion: 2.1 time: 0.270579 Aug 24 02:14:19.768947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3700/4692] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:19 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1535 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:19.777553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:19.779223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:19.789515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.790543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.791167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.792068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.792853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.794331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.839727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:19.840188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:19.840624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:19.841093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lazy-loading 'fault' on Instance uuid e57073af-fbc5-455c-ac94-42eaf1c0260c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:19.913901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:19.925748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d085d43-99e4-4a7c-b8ed-3ae464bd6af1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 200 len: 1193 microversion: 2.1 time: 0.155411 Aug 24 02:14:19.926341 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3701/4693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:19 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 1193 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:20.123749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2671f0bd-e802-4310-8db6-57a323c1cda3", "name": "network-vif-deleted", "tag": "94bafaf7-7d54-4e86-94b3-04a4d4763ac7"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:20.138438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.138921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.139360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.154167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] Creating event network-vif-deleted:94bafaf7-7d54-4e86-94b3-04a4d4763ac7 for instance 2671f0bd-e802-4310-8db6-57a323c1cda3 on n-h2-854121-3 Aug 24 02:14:20.159681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5ac163f2-9824-49a6-bbc1-e52bb6640b7f req-a2a40ddc-0b5c-4660-98aa-a948923bab00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041213 Aug 24 02:14:20.162662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3702/4694] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:14:20.393643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:20.394508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:20.410000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.410904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.411581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.414354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.415062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.415758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.658205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:20.665879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb93d6c3-0168-467a-8a4f-1a6738413df8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.277620 Aug 24 02:14:20.666907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3703/4695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:20 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:20.791208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:20.792085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:20.794140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:20.801491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.805075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.805916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.807825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.808936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.810051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.862729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.863661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.864269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.864921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lazy-loading 'fault' on Instance uuid 2671f0bd-e802-4310-8db6-57a323c1cda3 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:20.944852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ae05c718e8f46fc93bc6bb76fef537d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7df92b941004476b8782a190e9af11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:20.958155 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8fcf5e7b-cff0-4aaa-a7f0-b9752fa5ed71 tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 200 len: 1318 microversion: 2.1 time: 0.168281 Aug 24 02:14:20.958764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3704/4696] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:20 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:20.966149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:20.976862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: e57073af-fbc5-455c-ac94-42eaf1c0260c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:20.990625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.991321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.991764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:20.992485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:20.992969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:20.993403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:21.025997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c HTTP/1.1 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e57073af-fbc5-455c-ac94-42eaf1c0260c'} Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:21.028411 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. Aug 24 02:14:21.032993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:21.035270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance e57073af-fbc5-455c-ac94-42eaf1c0260c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:21.037213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec15982e-fc5b-4abe-855d-4525351ab14b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c" status: 404 len: 111 microversion: 2.1 time: 0.075281 Aug 24 02:14:21.041796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3705/4697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:20 2022] GET /compute/v2.1/servers/e57073af-fbc5-455c-ac94-42eaf1c0260c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:14:21.688691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:21.689536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:21.710041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:21.713440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:21.714360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:21.717790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:21.718715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:21.719585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:21.930512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:21.950582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b221e220-7e4b-48a3-a243-c47b8b99284f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.265847 Aug 24 02:14:21.951913 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3706/4698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:21 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:21.981173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:21.982683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] [instance: 2671f0bd-e802-4310-8db6-57a323c1cda3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:21.992807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:21.993531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:21.994135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:21.998937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:21.999666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:22.000259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:22.015372 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] HTTP exception thrown: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Request method failure captured: Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 HTTP/1.1 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlHiYLNA4Wza0MRfYUKfJOx587PiwD-FCApfxIddugHN8V-hQIi65lZu-iAArlU1cSySd-15IfRrpH_EHCBRVv41Ou8QYVNdFmx0W6H7hDUPsZKmiGG9vn4yWb6imRudhBWU5bk3j8rcDJY-3PIqWCyeeq0ERJ8OkK2N596jRz6_zI Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d7df92b941004476b8782a190e9af11e Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1470811203 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d7df92b941004476b8782a190e9af11e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7df92b941004476b8782a190e9af11e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7df92b941004476b8782a190e9af11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d7df92b941004476b8782a190e9af11e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1470811203 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d7df92b941004476b8782a190e9af11e Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1470811203 Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1470811203-project Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 3ae05c718e8f46fc93bc6bb76fef537d Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1470811203-project Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2671f0bd-e802-4310-8db6-57a323c1cda3'} Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:22.017125 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. Aug 24 02:14:22.021720 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:22.023109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] Returning 404 to user: Instance 2671f0bd-e802-4310-8db6-57a323c1cda3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:22.024104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18c1fef8-149c-4cba-938a-2fa1c4aff50d tempest-ServersNegativeTestMultiTenantJSON-1470811203 tempest-ServersNegativeTestMultiTenantJSON-1470811203-project] 10.222.0.49 "GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3" status: 404 len: 111 microversion: 2.1 time: 0.048814 Aug 24 02:14:22.025458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3707/4699] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:21 2022] GET /compute/v2.1/servers/2671f0bd-e802-4310-8db6-57a323c1cda3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:14:22.973572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:22.974232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:22.994150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:22.995075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:22.995251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:22.996393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:22.996914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:22.997346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:23.327110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:23.341643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f46f742c-b87a-4d64-8be9-30b696455de2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.369274 Aug 24 02:14:23.342309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3708/4700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:22 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:24.364149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:24.366051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:24.378436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:24.380642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:24.381423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:24.383790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:24.384450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:24.386695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:24.450187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:24.695453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:24.711350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-525a1bdf-8cb1-42f1-938b-b57a67aec17c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.352436 Aug 24 02:14:24.724743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3709/4701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:24 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:25.739761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:25.740583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:25.762200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:25.765883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:25.768369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:25.771937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:25.775691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:25.776419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:26.642212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:26.657803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39239528-4a88-42d2-9c55-f26f246faba4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.921619 Aug 24 02:14:26.661461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3710/4702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:25 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:27.686047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:27.687372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:27.709015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:27.711496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:27.712702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:27.715864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:27.717378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:27.719372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:28.107879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:28.131352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1b5b5bc-7cc3-43e8-a16e-fea4eb33f639 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.450543 Aug 24 02:14:28.133665 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3711/4703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:27 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:29.161447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:29.162753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:29.178210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:29.178715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:29.179154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:29.188945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:29.189636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:29.190133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:29.797297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:29.813105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edb7adfb-3145-47cc-ac3b-63a75d4f1e60 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.658075 Aug 24 02:14:29.814038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3712/4704] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:29 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:29.828612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1383281429", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5a821273-b111-465a-aea8-5c3c1a7cec82", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:29.970991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:14:32.659962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:14:32.662776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:14:32.663464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:14:32.665516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:14:32.666907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:14:32.678421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:32.679202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:32.679810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:32.681683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:32.682639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:32.683297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:32.709412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:14:32.719717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:14:32.799619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:14:32.803301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a821273-b111-465a-aea8-5c3c1a7cec82',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:14:33.032773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06f0fd36-ed72-4860-abeb-de1d45544152 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.217581 Aug 24 02:14:33.036191 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3713/4705] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:14:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:14:33.049264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:33.051361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:33.064771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:33.065267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:33.066175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:33.067672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:33.068328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:33.068966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:33.764580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:33.782147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c3b999d-d396-4373-a42a-a72f8dd43747 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.742025 Aug 24 02:14:33.782764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3714/4706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:33 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:33.787371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:33.788046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:33.801667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:33.802161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:33.802603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:33.803321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:33.803785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:33.804209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:33.930515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:33.946319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ccb328f-a169-4bda-9403-8e20c873bf7d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1099 microversion: 2.1 time: 0.162130 Aug 24 02:14:33.947291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3715/4707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:33 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1099 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:34.809621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:34.810351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:34.820962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:34.821525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:34.821972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:34.823463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:34.824144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:34.824786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:35.070784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:35.080527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39702fb7-3f6a-4bec-a173-9d1a35c442ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.280299 Aug 24 02:14:35.099252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3716/4708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:34 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:35.104146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:35.105021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:35.111321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:35.112133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:35.112582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:35.113350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:35.115376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:35.116587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:35.712212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:35.725203 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb72d76a-ca4d-4d4f-8ce7-ef3ee88386e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1163 microversion: 2.1 time: 0.624694 Aug 24 02:14:35.726398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3717/4709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:35 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1163 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:35.885301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2032074955", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8a24ecd5-03eb-4daf-8330-9507f15ca244"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:35.980281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] validate_networks() for [('8a24ecd5-03eb-4daf-8330-9507f15ca244', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:14:36.921887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:14:36.922518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:14:36.922995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:14:36.923492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:14:36.923907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:14:36.945631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:36.946407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:36.947010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:36.947913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:36.951379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:36.952072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:36.978832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Getting quotas for project ee8fd1ca330a4a838cfc98b14ee946be. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:14:36.985403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Getting quotas for user 726e46099d2d4b71b24e6fccbca08df8 and project ee8fd1ca330a4a838cfc98b14ee946be. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:14:37.003433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:14:37.007772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:14:37.062141 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69bcad6e-5130-4336-913d-91ecbc39d713 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.334110 Aug 24 02:14:37.063221 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3718/4710] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:14:37.075675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:37.076846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:37.089878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:37.090651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:37.091285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:37.092170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:37.092892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:37.095481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:37.351841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:37.363781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7aabd53-0830-4474-b0d2-dd7a222f8b28 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.299209 Aug 24 02:14:37.364896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3719/4711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:37 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:37.372817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:37.373860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:37.382552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:37.383454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:37.384060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:37.391533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:37.392122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:37.392630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:37.515706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:37.527013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c5936b7-4c98-4035-a5a4-cc63fa12a58e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1173 microversion: 2.1 time: 0.160262 Aug 24 02:14:37.527616 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3720/4712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:37 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1173 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:37.540088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41a02803-6786-4c88-9821-b26ce04808a7 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:37.540694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41a02803-6786-4c88-9821-b26ce04808a7 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:37.687592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41a02803-6786-4c88-9821-b26ce04808a7 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:37.694960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41a02803-6786-4c88-9821-b26ce04808a7 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1225 microversion: 2.1 time: 0.159083 Aug 24 02:14:37.701503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3721/4713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:37 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:38.391331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:38.393261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:38.407089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:38.411237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:38.411736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:38.412494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:38.415526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:38.415983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:38.799258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:38.814134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c347f62a-41ce-431b-9465-cb9f2d6ecc8d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.427820 Aug 24 02:14:38.816953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3722/4714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:38 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:38.826813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:38.827374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:38.842186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:38.847939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:38.849724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:38.856327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:38.856327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:38.856327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:39.020935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:39.033886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fd754cd-8b7f-4e8b-b1b6-676a92348867 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1173 microversion: 2.1 time: 0.215782 Aug 24 02:14:39.067792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3723/4715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:38 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1173 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:39.085282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:39.087278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:39.109486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:39.109996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:39.110437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:39.111162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:39.111617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:39.124238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:39.444815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:39.464335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25469335-d056-4739-93c5-de2ff1872da6 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1285 microversion: 2.1 time: 0.388940 Aug 24 02:14:39.470222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3724/4716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:39 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1285 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:39.838673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:39.839587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:39.852143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:39.853064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:39.855463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:39.856411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:39.858328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:39.861273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:40.280295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:40.290415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8be3a256-a737-4c59-a84e-fdcad06c7802 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.457043 Aug 24 02:14:40.291014 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3725/4717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:39 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:40.300460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:40.304820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:40.318796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:40.319299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:40.319745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:40.320470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:40.320958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:40.321404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:41.257756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:41.277331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e1e354f-5d22-4fe5-9e0e-30e4c7bdb109 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1215 microversion: 2.1 time: 0.975787 Aug 24 02:14:41.278482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3726/4718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:40 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1215 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:41.285457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:41.286998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:41.296736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:41.298230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:41.298876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:41.299967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:41.300616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:41.305386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:41.451545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:41.462598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1e726da-ea6c-49f4-8cd9-54add91d4a27 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1283 microversion: 2.1 time: 0.182032 Aug 24 02:14:41.476616 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3727/4719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:41 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:41.484156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:41.485073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:41.500029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:41.500886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:41.501509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:41.502380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:41.502997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:41.503584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:41.528532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:42.159671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:42.169960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a6293ab-05e1-4fb2-99a8-62e3aa8e36d1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.691883 Aug 24 02:14:42.195687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3728/4720] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:41 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:42.299285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:42.299934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:42.314925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:42.315874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:42.316507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:42.317423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:42.318032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:42.318617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:42.682085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:42.698019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1779f7c8-8b26-4c4e-b31f-bcece8ac5a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1215 microversion: 2.1 time: 0.402659 Aug 24 02:14:42.705725 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3729/4721] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:42 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1215 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:42.724864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:42.726494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:42.743927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:42.745158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:42.745619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:42.749430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:42.750020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:42.750708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:43.655951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:43.686149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a420a73b-6dda-4938-b67a-876f815fbd2f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.977452 Aug 24 02:14:43.691621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3730/4722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:42 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:43.707088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:43.713529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:43.735968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:43.736869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:43.739223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:43.742896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:43.744366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:43.749119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:44.282392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:44.291063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d8a9fc1-05ba-4dbf-a9ac-bbc17a20cd0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.597594 Aug 24 02:14:44.301862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3731/4723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:43 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:44.320029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:44.320208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:44.337456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:44.340409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:44.340956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:44.341865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:44.343024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:44.343620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:44.905651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:44.925252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-705d8de5-8f13-43e8-b72a-9d49fbf5a24a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1215 microversion: 2.1 time: 0.620050 Aug 24 02:14:44.937825 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3732/4724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:44 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1215 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:44.945254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03496e6-0cb2-4eeb-a347-b1c25ca7be4a", "tag": "ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:44.956169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:44.957146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:44.957833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:44.970885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] Creating event network-changed:ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3 for instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a on n-h2-854121-3 Aug 24 02:14:44.977257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a9c46b4b-5032-4931-aa43-14337cca8149 req-6e3735d3-d29d-4bd7-b558-32b3661d1f78 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Aug 24 02:14:44.978693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3733/4725] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:44.985206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:44.986572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:44.994176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:44.995384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:44.996337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:44.997416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:44.998205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:44.999538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:45.392906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:45.416496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2c06ce9-2e43-4212-809a-53e9a9f8b25a tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.435646 Aug 24 02:14:45.419477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3734/4726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:44 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:45.426832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:45.428949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:45.437254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:45.438423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:45.439323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:45.440210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:45.441770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:45.442516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:45.990066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:46.000900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed163dd2-a6e1-4c69-98c1-6a7116eb27af tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.579134 Aug 24 02:14:46.005475 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3735/4727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:45 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:46.018327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90546558-bf07-4b2e-8702-260aed568c11", "tag": "3531fa49-5be2-48df-a389-f71524864c5d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:46.044621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:46.047746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:46.048494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:46.086146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] Creating event network-changed:3531fa49-5be2-48df-a389-f71524864c5d for instance 90546558-bf07-4b2e-8702-260aed568c11 on n-h2-854121-3 Aug 24 02:14:46.099166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e9e169f3-e65a-4fc7-a069-2093451e4025 req-fdf09149-9fb1-4d85-a7d0-e878a8aa3d97 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092064 Aug 24 02:14:46.102644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3736/4728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:46.121134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:46.121845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:46.134820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:46.140246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:46.140963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:46.143054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:46.143691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:46.144875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:46.499880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:46.510901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3ee063f-feab-45c5-861c-5799caa57ed4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.401330 Aug 24 02:14:46.511880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3737/4729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:46 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:46.523486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:46.524522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:46.548491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:46.551864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:46.562113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:46.563159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:46.566059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:46.567628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:46.568890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:46.965578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:47.048253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:47.063138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9be05105-c820-4957-b1b6-c248c0fd94a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.549212 Aug 24 02:14:47.063976 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3738/4730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:46 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:47.072566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:47.077204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:47.091224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:47.092223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:47.093188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:47.094436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:47.095237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:47.095942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:47.634474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:47.642768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d46ea299-05a9-494c-9bc6-8299d540774e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1522 microversion: 2.1 time: 0.577508 Aug 24 02:14:47.657634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3739/4731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:47 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1522 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:47.660370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:47.662204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:47.670583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:47.672192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:47.672652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:47.673506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:47.673862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:47.674338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:47.709907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:47.999967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:48.015705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88992fcd-5c88-4315-aa96-caa181f2da6b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.369987 Aug 24 02:14:48.016523 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3740/4732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:47 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:48.087166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:48.093948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:48.108557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:48.109254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:48.109797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:48.110647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:48.111205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:48.111931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:48.370630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:48.395513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53a2ebb4-bc37-476c-8288-bb83a6603308 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.314244 Aug 24 02:14:48.396146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3741/4733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:48 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:14:48.663316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:48.664126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:48.672294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:48.673547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:48.674167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:48.674889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:48.675343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:48.676228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:49.460188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:49.473300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e7e188f-8c90-41c4-91d4-e3904fc2b7cb tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1502 microversion: 2.1 time: 0.813649 Aug 24 02:14:49.475503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3742/4734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:48 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1502 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:49.483095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:49.484021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:49.495144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:49.496161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:49.496981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:49.498191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:49.498909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:49.499627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:50.106233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:50.122612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3366f617-dad8-489a-b370-f7f4c4ae5385 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.645682 Aug 24 02:14:50.126435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3743/4735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:49 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:50.141698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:50.144413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:50.154635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:50.155503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:50.156190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:50.157196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:50.158384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:50.159056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:50.733990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:50.747542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-635824e6-7d26-4dfd-8907-0a096d8310ec tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.619650 Aug 24 02:14:50.748138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3744/4736] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:50 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:50.758972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:50.762301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:50.774759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:50.775269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:50.775716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:50.776487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:50.776973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:50.777404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:51.250211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:51.262157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b234d80-c494-4624-a110-9b92a12fb743 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1517 microversion: 2.1 time: 0.507013 Aug 24 02:14:51.277032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3745/4737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:50 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1517 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:51.285384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:51.286317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:51.296146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:51.297023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:51.297795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:51.298933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:51.299570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:51.300170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:51.322287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:51.603406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:51.612384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2c354d3-db33-441f-8f9a-848693c6ffd3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.333732 Aug 24 02:14:51.617254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3746/4738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:51 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:51.841657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd457a6c-f3ff-4720-9ed8-1d32f6ee710b tempest-ExtensionsTest-260289800 tempest-ExtensionsTest-260289800-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:51.845038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd457a6c-f3ff-4720-9ed8-1d32f6ee710b tempest-ExtensionsTest-260289800 tempest-ExtensionsTest-260289800-project] 10.222.0.49 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.226498 Aug 24 02:14:51.845826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3747/4739] 10.222.0.49 () {58 vars in 1170 bytes} [Wed Aug 24 02:14:51 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:51.852843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:51.853461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:51.867096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:51.869118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:51.869875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:51.872552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:51.873341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:51.875044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.287885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:52.295789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb75aea6-fd54-4a79-a210-501d9b8d4a59 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.448765 Aug 24 02:14:52.296372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3748/4740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:51 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:52.301064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:52.303624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 7e651a89-761e-437a-96c1-e636e9fba327] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:52.308939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/7e651a89-761e-437a-96c1-e636e9fba327/action HTTP/1.1 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: {"rescue": {}} Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7e651a89-761e-437a-96c1-e636e9fba327', 'body': {'rescue': {}}} Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:52.314210 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 404 to user: Instance 7e651a89-761e-437a-96c1-e636e9fba327 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d83961c-e358-455e-960d-48d9089e5971 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/7e651a89-761e-437a-96c1-e636e9fba327/action" status: 404 len: 111 microversion: 2.1 time: 0.018348 Aug 24 02:14:52.319111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3749/4741] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:52 2022] POST /compute/v2.1/servers/7e651a89-761e-437a-96c1-e636e9fba327/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:14:52.326009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:52.326574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:52.337183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.337833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.338949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.339752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.340496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.341696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.486207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:52.497028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd545202-5c79-4c6d-bc7f-5e3f3007db49 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.179159 Aug 24 02:14:52.498352 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3750/4742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:52 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:52.505880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:52.506840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:52.514764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.515576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.516237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.517265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.517932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.518595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.761324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:52.775798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1747e82-41d0-466e-88a3-c2fd71c9d0a0 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.275565 Aug 24 02:14:52.777849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3751/4743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:52 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:52.784153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfe39438-47e7-4404-a009-00b34b4d26e1 tempest-ExtensionsTest-260289800 tempest-ExtensionsTest-260289800-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:52.790239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfe39438-47e7-4404-a009-00b34b4d26e1 tempest-ExtensionsTest-260289800 tempest-ExtensionsTest-260289800-project] 10.222.0.49 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007498 Aug 24 02:14:52.791330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3752/4744] 10.222.0.49 () {58 vars in 1134 bytes} [Wed Aug 24 02:14:52 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:14:52.808224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:52.808828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:52.821805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.822410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.823876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.824556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.824646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.825165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.925448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fadeffbc-77a0-488b-9a25-fddf2b3977d6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action" status: 202 len: 0 microversion: 2.1 time: 0.131652 Aug 24 02:14:52.930201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3753/4745] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:52 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:14:52.957122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:52.958396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:52.965688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.966197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.966698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:52.967464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:52.969254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:52.969848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:53.657358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:53.665397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b48a18f7-d855-4bea-b6f2-b2f0a931df3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.719109 Aug 24 02:14:53.668746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3754/4746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:52 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:53.703286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:53.703286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:53.720278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:53.720824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:53.721250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:53.721946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:53.731764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:53.732233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:54.324808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:54.341207 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d6516f4-29a1-4ee8-b2b9-0b076d419c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1502 microversion: 2.1 time: 0.670025 Aug 24 02:14:54.342420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3755/4747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:53 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1502 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:54.348368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:54.349249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:54.361505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:54.365255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:54.365919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:54.366843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:54.367494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:54.368209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:54.829244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:54.855336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4cff5e05-177d-4f91-a84c-15eee5130fb5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.505273 Aug 24 02:14:54.856002 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3756/4748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:54 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:54.875014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1991311061"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:54.878929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:54.888577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:54.889111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:54.889546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:54.890242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:54.890691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:54.891111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.189285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c7f2d9d-c164-47b9-97e0-188c691920e2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.330646 Aug 24 02:14:55.200228 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3757/4749] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:54 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 02:14:55.205878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:55.206790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:55.214034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.214560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.214957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.215663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.216114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.217481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.601912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:55.622981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e904bd3-01f9-46d8-ad21-efbe602314cf tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.429475 Aug 24 02:14:55.636373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3758/4750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:55 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:55.641592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90546558-bf07-4b2e-8702-260aed568c11", "name": "network-vif-plugged", "status": "completed", "tag": "3531fa49-5be2-48df-a389-f71524864c5d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:55.662906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.663651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.664255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.680102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] Creating event network-vif-plugged:3531fa49-5be2-48df-a389-f71524864c5d for instance 90546558-bf07-4b2e-8702-260aed568c11 on n-h2-854121-3 Aug 24 02:14:55.686151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ca891783-df55-4185-ad9a-fe8c25a0bb25 req-87ac4d9c-a8e4-4cb3-8d05-e98ec3a3e692 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048225 Aug 24 02:14:55.686976 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3759/4751] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:14:55.693631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:55.696940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:55.703814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.704515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.705416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.706320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.706944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.707384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.733780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'flavor' on Instance uuid 18d5d503-43c2-4722-be4d-110754c00312 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:14:55.747606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Cannot 'rescue' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state paused Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action HTTP/1.1 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 14 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: {"rescue": {}} Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'rescue' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state paused Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '18d5d503-43c2-4722-be4d-110754c00312', 'body': {'rescue': {}}} Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18d5d503-43c2-4722-be4d-110754c00312 in vm_state paused. Cannot rescue while the instance is in this state. Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state paused Aug 24 02:14:55.749328 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state paused Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 409 to user: Cannot 'rescue' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state paused {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a155e9d2-55a2-40b3-b3db-6f7f77b3e0c0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action" status: 409 len: 144 microversion: 2.1 time: 0.065330 Aug 24 02:14:55.755303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3760/4752] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:55 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:14:55.765963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:14:55.766512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:55.779334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.779848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.781118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.782157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.782977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.783642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.927394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd181ae5-7968-4eae-8d5b-41cf867a394a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action" status: 202 len: 0 microversion: 2.1 time: 0.168217 Aug 24 02:14:55.929562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3761/4753] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:14:55 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:14:55.936085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:55.937276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:55.950552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.951341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.952620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:55.954150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:55.955064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:55.955697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:56.523743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:56.538342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be72ea1a-3e6d-458a-98f4-18aaf129549e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.607257 Aug 24 02:14:56.539510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3762/4754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:55 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:56.558214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:56.559667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:56.569904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:56.570495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:56.571217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:56.572311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:56.573503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:56.574489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:56.609723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:14:57.340318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:57.350116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc7086b1-80e7-4c1b-b90c-f5927ce59472 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1517 microversion: 2.1 time: 0.809028 Aug 24 02:14:57.365484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3763/4755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:56 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1517 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:57.376870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:57.377667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:57.391266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:57.391990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:57.393189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:57.394076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:57.394695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:57.395274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:57.798348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:57.807536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b02b58d-f6b0-4b7e-a14b-546c6ef7c5bb tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1325 microversion: 2.1 time: 0.440002 Aug 24 02:14:57.814603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3764/4756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:57 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1325 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:57.836461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:57.839445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:57.852640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:57.853453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:57.856242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:57.857345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:57.861455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:57.862182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:58.190165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:58.200009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3bcd2c1-be21-472d-aaab-7fbcf6cc6412 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.372033 Aug 24 02:14:58.201251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3765/4757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:57 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:58.835056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:58.835775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:58.857663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:58.858470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:58.860571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:58.861736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:58.862480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:58.865346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:59.317784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:14:59.337337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3ef3a31-700e-4f13-a639-37b3b6a6e8d9 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1523 microversion: 2.1 time: 0.504789 Aug 24 02:14:59.340330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3766/4758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:58 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:14:59.376152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:14:59.376829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:14:59.404246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:59.407755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:59.409240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:14:59.411018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:14:59.413111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:14:59.413761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.125941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:00.141904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bca3fc8c-6d2d-4c6b-b078-8a31cd04e1f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.799156 Aug 24 02:15:00.144040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3767/4759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:14:59 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:00.166724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:00.168221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:00.180728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.181426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.181948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.182742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.183202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.183627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.247077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] HTTP exception thrown: Instance is not a member of specified network Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Request method failure captured: Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11/ips/invalid HTTP/1.1 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmLwGJuH7-03DyAnnR-T3IYNB_C6bP9j9f-oxNcORR_y_Z7YMkAasGPBwUs6AQZpK9YhUJ9yIDksiU6r_uDdIONrYeFOJOVIsayO2RNdBA5qSep6XnNMOftoY-Jm0GXg6gxMPeyvNLWQJTJGYHieT-hO5tPsFHRKvORRE8R7iGKKDc Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 726e46099d2d4b71b24e6fccbca08df8 Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance is not a member of specified network Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '90546558-bf07-4b2e-8702-260aed568c11', 'id': 'invalid'} Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 24 02:15:00.256975 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.263496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:15:00.266328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa26ed91-95c9-43bb-afa3-f8e56c06368c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.102109 Aug 24 02:15:00.267139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3768/4760] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 02:15:00 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11/ips/invalid => generated 91 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:15:00.286446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:00.289276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:00.302698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.317241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.317787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.318633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.319059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.319684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.374970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'flavor' on Instance uuid 18d5d503-43c2-4722-be4d-110754c00312 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:15:00.551459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c40b4320-9bd9-457c-aa87-8dc24597b744 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action" status: 200 len: 32 microversion: 2.1 time: 0.281861 Aug 24 02:15:00.556541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3769/4761] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:15:00 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:15:00.568162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:00.570304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Failed to fetch instance by id 999 {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 24 02:15:00.570846 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] HTTP exception thrown: Instance 999 could not be found. Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Request method failure captured: Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmLwGJuH7-03DyAnnR-T3IYNB_C6bP9j9f-oxNcORR_y_Z7YMkAasGPBwUs6AQZpK9YhUJ9yIDksiU6r_uDdIONrYeFOJOVIsayO2RNdBA5qSep6XnNMOftoY-Jm0GXg6gxMPeyvNLWQJTJGYHieT-hO5tPsFHRKvORRE8R7iGKKDc Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 726e46099d2d4b71b24e6fccbca08df8 Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 999 could not be found. Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '999'} Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 24 02:15:00.581080 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:00.585612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:15:00.586775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0fe4070-8ed0-47b6-8cee-f4d02718f86f tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.026190 Aug 24 02:15:00.587870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3770/4762] 10.222.0.49 () {58 vars in 1149 bytes} [Wed Aug 24 02:15:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:15:00.601333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:00.607763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:00.632786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.633360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.633760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:00.634503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:00.636530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:00.637006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:01.232654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:01.250000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aecd8390-452e-4604-82cd-ab6362eb1461 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.659478 Aug 24 02:15:01.257907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3771/4763] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:00 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:01.278040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:01.279726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:01.301130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:01.304243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:01.305047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:01.309913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:01.310643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:01.313561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:01.390641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:15:01.578136 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8831b40-73c9-47ab-a415-cd11167a0f98 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "DELETE /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 204 len: 0 microversion: 2.1 time: 0.316313 Aug 24 02:15:01.578718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3772/4764] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:15:01 2022] DELETE /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:15:01.591201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:01.592394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:01.607179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:01.608267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:01.609527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:01.610907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:01.612888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:01.613455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:01.996987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:02.012612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bdca1372-3757-4f03-b6db-30cf1e32736d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.431679 Aug 24 02:15:02.014719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3773/4765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:01 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:02.027826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:02.030784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:02.043398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:02.047453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:02.048981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:02.050619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:02.051474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:02.052158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:02.890598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:02.903796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e4594b2-b10c-47f1-a583-4c42299715d3 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1529 microversion: 2.1 time: 0.887809 Aug 24 02:15:02.910119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3774/4766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:02 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1529 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:02.923191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:02.925797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:02.943943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:02.956281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:02.957154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:02.958090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:02.958728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:02.959333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:03.473081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:03.487178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59f4e0e8-1599-4d7b-b572-579cc80a9b1e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.575459 Aug 24 02:15:03.500752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3775/4767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:02 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:03.506750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:03.508438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:03.526001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:03.526588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:03.527953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:03.528939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:03.529637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:03.530606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:03.957383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:03.974190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5f24911-2f12-4e1c-8412-ed609cf14786 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.482296 Aug 24 02:15:03.975046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3776/4768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:03 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:03.979877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03496e6-0cb2-4eeb-a347-b1c25ca7be4a", "name": "network-vif-plugged", "status": "completed", "tag": "ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:03.997566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:03.998222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:03.998828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:04.017890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] Creating event network-vif-plugged:ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3 for instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a on n-h2-854121-3 Aug 24 02:15:04.030447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ded5527e-626b-4dea-aaf5-8a7df77e6b62 req-6cd6a190-46bb-4eb3-be8f-36aa5f8ce53d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052899 Aug 24 02:15:04.032201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3777/4769] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:04.045628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:04.047170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:04.058312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:04.060504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:04.061709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:04.062718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:04.065510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:04.066275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:04.114611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:04.662786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:04.678067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-535c412f-d6c4-4cb8-a3b2-d1933eacde6c tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1529 microversion: 2.1 time: 0.644051 Aug 24 02:15:04.695088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3778/4770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:04 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1529 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:04.711076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:04.712558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:04.730451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:04.731026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:04.732199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:04.733100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:04.733821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:04.734771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:05.310559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:05.325201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87cdd5ab-a84f-4956-860b-1859a02150f1 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.628836 Aug 24 02:15:05.330605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3779/4771] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:04 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:05.357548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90546558-bf07-4b2e-8702-260aed568c11", "name": "network-vif-deleted", "tag": "3531fa49-5be2-48df-a389-f71524864c5d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:05.419255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:05.419992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:05.420692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:05.483173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] Creating event network-vif-deleted:3531fa49-5be2-48df-a389-f71524864c5d for instance 90546558-bf07-4b2e-8702-260aed568c11 on n-h2-854121-3 Aug 24 02:15:05.503496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-28466d31-0304-4078-9184-90ed3600a339 req-a38259c2-a88a-45ab-8c1a-1580b7133cef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165752 Aug 24 02:15:05.507418 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3780/4772] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:05.531027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:05.531992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:05.561717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:05.562952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:05.566080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:05.570632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:05.571519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:05.590119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:06.179294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:06.201058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f30e4a2a-1179-4ece-bed0-e0c109e9366e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1203 microversion: 2.1 time: 0.690870 Aug 24 02:15:06.205154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3781/4773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:05 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1203 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:06.214090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:06.215065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:06.239408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:06.247113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:06.248340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:06.249454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:06.253229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:06.254120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:06.370445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:06.373346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:06.374184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:06.374740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lazy-loading 'fault' on Instance uuid 90546558-bf07-4b2e-8702-260aed568c11 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:15:06.839096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '726e46099d2d4b71b24e6fccbca08df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8fd1ca330a4a838cfc98b14ee946be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:06.851423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d0c59c1-f76e-41f5-b876-a7452ab92267 tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 200 len: 1315 microversion: 2.1 time: 0.643800 Aug 24 02:15:06.851987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3782/4774] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:06 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:06.871185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-plugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:06.891228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:06.893591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:06.894303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:06.932681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] Creating event network-vif-plugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:15:06.963529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2bf8c0c3-c780-4eb5-a36f-2145507de44c req-a7ba7fb6-38fc-46bc-9a94-e02bb2883fb2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105697 Aug 24 02:15:06.967840 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3783/4775] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:06.997664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:07.016006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:07.031299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:07.047500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:07.047972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:07.048746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:07.055309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:07.057464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:07.679261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:07.702013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3567cf25-c891-4670-88af-181c037b5328 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.728689 Aug 24 02:15:07.714038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3784/4776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:06 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:07.724963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:07.726313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:07.734165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:07.735190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:07.735820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:07.736711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:07.737353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:07.737949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:08.365737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:08.378425 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fba905f4-a839-4f4b-ae72-5c54dc331d5c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1390 microversion: 2.1 time: 0.662978 Aug 24 02:15:08.398859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3785/4777] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:07 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1390 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:08.412250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:08.418694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] [instance: 90546558-bf07-4b2e-8702-260aed568c11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:08.444873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:08.445386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:08.451569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:08.458778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:08.459315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:08.459773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:08.528172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] HTTP exception thrown: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Request method failure captured: Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 HTTP/1.1 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmLwGJuH7-03DyAnnR-T3IYNB_C6bP9j9f-oxNcORR_y_Z7YMkAasGPBwUs6AQZpK9YhUJ9yIDksiU6r_uDdIONrYeFOJOVIsayO2RNdBA5qSep6XnNMOftoY-Jm0GXg6gxMPeyvNLWQJTJGYHieT-hO5tPsFHRKvORRE8R7iGKKDc Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ee8fd1ca330a4a838cfc98b14ee946be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ee8fd1ca330a4a838cfc98b14ee946be Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1300474249 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 726e46099d2d4b71b24e6fccbca08df8 Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1300474249-project Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '90546558-bf07-4b2e-8702-260aed568c11'} Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:08.542288 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. Aug 24 02:15:08.547854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:08.552797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] Returning 404 to user: Instance 90546558-bf07-4b2e-8702-260aed568c11 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:15:08.555735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0322ad61-d797-45e8-b566-c8f2f83fa95e tempest-ServerAddressesNegativeTestJSON-1300474249 tempest-ServerAddressesNegativeTestJSON-1300474249-project] 10.222.0.49 "GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11" status: 404 len: 111 microversion: 2.1 time: 0.154458 Aug 24 02:15:08.557618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3786/4778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:08 2022] GET /compute/v2.1/servers/90546558-bf07-4b2e-8702-260aed568c11 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:15:08.588024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:08.596595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:08.619039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:08.621714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:08.622224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:08.625099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:08.629904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:08.630614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:08.633513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:09.388074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:09.404318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7954acd6-e544-4e86-954b-c22ee27d30c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1390 microversion: 2.1 time: 0.829833 Aug 24 02:15:09.405059 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3787/4779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:08 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1390 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:09.420187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:09.421706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:09.440789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:09.441510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:09.445028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:09.446062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:09.446715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:09.450538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:10.023060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:10.036019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc80cedf-dc26-4ca8-9a82-0e696a6d481a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.629436 Aug 24 02:15:10.044676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3788/4780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:09 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:10.303887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a833ca43-6be7-4f2d-82ae-263b60d69c75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: .version_select at 0x7f6b90d88a60>, body: {"keypair": {"name": "tempest-keypair-894869779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtn9IfPRQDKtcjiJ5BgSsUowsBhHNXAqWqZduEou1zoV5T5F47RAGO1AFCbSHIEVExEitf7/po/NV1z4Q9bmfzqJ9pRoRxARiqD2enw8vz/qp30Wkquk4GZBCW82Dm5dg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:10.351251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a833ca43-6be7-4f2d-82ae-263b60d69c75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:10.374675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a833ca43-6be7-4f2d-82ae-263b60d69c75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for user cd03ebf2c9274253a3e3bbb58ff122ef and project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:10.440629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a833ca43-6be7-4f2d-82ae-263b60d69c75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.391718 Aug 24 02:15:10.441988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3789/4781] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 02:15:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 395 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 02:15:10.451274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:10.452178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:10.513666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:10.520012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:10.524058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:10.530435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:10.531114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:10.537343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:11.605792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:11.645440 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bb9d0fc-549f-4652-818c-5c07e5bb98ba tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1390 microversion: 2.1 time: 1.195297 Aug 24 02:15:11.660553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3790/4782] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:10 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1390 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:11.684760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:11.693786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:11.718005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:11.718417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:11.718906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:11.720314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:11.720869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:11.728898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:12.949941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:12.990997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0564fec7-f6c7-4458-b075-dacc4ba69491 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 1.326253 Aug 24 02:15:12.996243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3791/4783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:11 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:13.045727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:13.053298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:13.074584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:13.086820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:13.087409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:13.088274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:13.088870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:13.089378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:13.164122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:15:13.430225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b67cf85c-c684-432a-ae0b-2fcde8a23a14 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 204 len: 0 microversion: 2.1 time: 0.432138 Aug 24 02:15:13.430981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3792/4784] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:15:12 2022] DELETE /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:15:13.440253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:13.449349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:13.470755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:13.473345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:13.481500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:13.482648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:13.483371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:13.484038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:14.442609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:14.458301 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1e61c1b-848a-41aa-be68-062f7bd549bf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1396 microversion: 2.1 time: 1.022088 Aug 24 02:15:14.459245 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3793/4785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:13 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1396 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:14.465689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:14.468638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:14.492350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:14.496932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:14.497599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:14.499198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:14.505245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:14.506030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:15.534725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:15.569006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8dee837-92b9-44dd-8afb-bb9ff1d80bf9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 1.108603 Aug 24 02:15:15.574552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3794/4786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:14 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:15.586269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:15.594034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:15.615288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:15.624525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:15.625008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:15.625756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:15.626213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:15.626644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:16.204141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:16.216398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d46b89c-84dd-4a29-94cb-77ea07cb517b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1396 microversion: 2.1 time: 0.638941 Aug 24 02:15:16.230681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3795/4787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:15 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1396 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:16.596440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:16.598207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:16.612568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:16.613300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:16.613955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:16.616023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:16.619256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:16.620542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:16.685403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:17.970968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:17.979948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0920f3ec-d2e8-4b0b-a87e-5d22e12c0872 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 1.388239 Aug 24 02:15:17.983875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3796/4788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:16 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:17.997602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:17.998215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:18.006766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:18.007280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:18.007723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:18.011365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:18.014630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:18.015283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:18.220392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:18.251115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8739b7a-aa42-4f0c-a77a-a5af9c80001f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1188 microversion: 2.1 time: 0.265625 Aug 24 02:15:18.251259 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3797/4789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:17 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1188 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:18.255786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03496e6-0cb2-4eeb-a347-b1c25ca7be4a", "name": "network-vif-deleted", "tag": "ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:18.307183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:18.308544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:18.309202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:18.344649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] Creating event network-vif-deleted:ba9fd1c5-6ac6-4877-b308-a8bd3fe727e3 for instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a on n-h2-854121-3 Aug 24 02:15:18.350403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fe02aca0-1e85-4115-b81b-f9249b9b7fc1 req-e785d99a-89ac-4f04-b462-28eff1fe8b74 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097946 Aug 24 02:15:18.352935 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3798/4790] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:19.003087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:19.003832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:19.036889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:19.037603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:19.038064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:19.038835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:19.045281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:19.045748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.269507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:20.282723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20b1021d-0f7d-4856-9f5f-419b6e914dae tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1503 microversion: 2.1 time: 1.284835 Aug 24 02:15:20.299399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3799/4791] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:18 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1503 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:20.320568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:20.333064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:20.358167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.359077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.366603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.367738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.368579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.369301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.429122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:20.638532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:20.654651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1b49cf0-89bc-424e-8d0b-ce6604aa924e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1188 microversion: 2.1 time: 0.353821 Aug 24 02:15:20.655262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3800/4792] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:20 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1188 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:20.680232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "308e0004-3527-434d-baec-e7a6a171416c"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:20.694807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:20.729635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.733489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.734188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.735887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.737938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.740660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.820422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Cannot 'attach_volume' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state rescued Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/os-volume_attachments HTTP/1.1 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 74 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: {"volumeAttachment": {"volumeId": "308e0004-3527-434d-baec-e7a6a171416c"}} Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'attach_volume' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state rescued Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '18d5d503-43c2-4722-be4d-110754c00312', 'body': {'volumeAttachment': {'volumeId': '308e0004-3527-434d-baec-e7a6a171416c'}}} Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 18d5d503-43c2-4722-be4d-110754c00312 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 02:15:20.826450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state rescued Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state rescued Aug 24 02:15:20.831157 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:20.838221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 409 to user: Cannot 'attach_volume' instance 18d5d503-43c2-4722-be4d-110754c00312 while it is in vm_state rescued {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:15:20.843531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-566cec5b-aff8-45be-80ab-2699c144aca4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.182646 Aug 24 02:15:20.844531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3801/4793] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:15:20 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/os-volume_attachments => generated 152 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:15:20.862176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:20.864588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:20.878729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.879450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.880208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:20.881878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:20.883155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:20.883817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:21.075929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7976741-986f-40ec-af83-0a21207f23bd tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action" status: 202 len: 0 microversion: 2.1 time: 0.215811 Aug 24 02:15:21.076838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3802/4794] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:15:20 2022] POST /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:15:21.096702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:21.101400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:21.135999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:21.135999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:21.135999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:21.137259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:21.137942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:21.138590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:22.408021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:22.424872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63ac5766-c0ab-412b-bee9-43e9f8ef4797 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1511 microversion: 2.1 time: 1.340348 Aug 24 02:15:22.425843 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3803/4795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:21 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1511 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:22.435224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:22.435850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:22.454279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:22.455364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:22.455819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:22.457646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:22.460384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:22.460915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:22.584030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:22.596487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0367f968-7ddc-49d0-8035-8a58bd1b4cfe tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1188 microversion: 2.1 time: 0.169460 Aug 24 02:15:22.597104 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3804/4796] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:22 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1188 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:22.614718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-793286695", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77dcbd3e-3d75-4775-8a4e-f6a7216de9e2"}], "security_groups": [{"name": "tempest-securitygroup--1071146123"}], "key_name": "tempest-keypair-894869779", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:23.272968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] validate_networks() for [('77dcbd3e-3d75-4775-8a4e-f6a7216de9e2', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:15:25.199819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:15:25.200479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:15:25.200746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:15:25.201176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:15:25.201818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:15:25.227427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:25.228667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:25.230709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:25.231741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:25.232778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:25.236627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:25.325106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:25.342206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for user cd03ebf2c9274253a3e3bbb58ff122ef and project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:25.398035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:15:25.402995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:15:25.543458 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a4b809b-8650-4674-b024-6b94986defa4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.941039 Aug 24 02:15:25.549919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3805/4797] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:15:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:15:25.549919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:25.550297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:25.562491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:25.569185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:25.569694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:25.570468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:25.570950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:25.571419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:26.096615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:26.113523 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f1ee5e8-a36a-438b-ba46-7ca14e4f68a2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1511 microversion: 2.1 time: 0.562620 Aug 24 02:15:26.114528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3806/4798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:25 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:26.128948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:26.142948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:26.171223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:26.171741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:26.172196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:26.182284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:26.182784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:26.183233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:26.497188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:26.512500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84d61377-c2ff-4593-9f78-302d5b250901 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1188 microversion: 2.1 time: 0.396670 Aug 24 02:15:26.514267 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3807/4799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:26 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1188 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:26.521965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:26.522927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:26.779433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:26.812994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:26.814945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:26.816126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f84735f-7685-418b-b89e-6bde5b4ae556 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1280 microversion: 2.20 time: 0.300694 Aug 24 02:15:26.816697 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3808/4800] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:26 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:27.139143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:27.139731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:27.155828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.160736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.161434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:27.165451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.166319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.169820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:27.496018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:27.515557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e548284b-cf16-49bc-b8f6-5122d0110671 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1517 microversion: 2.1 time: 0.383633 Aug 24 02:15:27.529716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3809/4801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:27 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:27.539753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:27.541162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:27.555349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.562721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.563281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:27.566432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.567904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.568667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:27.729156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:27.764890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca9cc18b-1fea-4e6e-9376-f9e3c2cd1233 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 200 len: 1188 microversion: 2.1 time: 0.223543 Aug 24 02:15:27.766046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3810/4802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:27 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 1188 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:27.841971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:27.842940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:27.854202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.858260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.859698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:27.860773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:27.861402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:27.862042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:28.146393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:28.170272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:28.173502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:28.180371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40369df1-2a25-4f1a-8aac-2613b31d358e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1332 microversion: 2.20 time: 0.343123 Aug 24 02:15:28.183552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3811/4803] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:27 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1332 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:15:28.564362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1178739076", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": "none"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:28.671047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:15:28.672609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:15:28.673512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:15:28.674163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:15:28.675020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:15:28.698870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:28.699642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:28.700327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:28.701513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:28.703858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:28.704978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:28.753804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Getting quotas for project 5909e1a826034d698c3acb33fac1d8be. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:28.770354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Getting quotas for user 7f648aca2b1a4c5bb56d93ed39dd0368 and project 5909e1a826034d698c3acb33fac1d8be. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:28.836156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:15:28.850307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:15:29.007538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c5f463d-01bc-4338-877c-4bb643a19d50 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.816712 Aug 24 02:15:29.012237 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3812/4804] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:15:29.036955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:29.038838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f03496e6-0cb2-4eeb-a347-b1c25ca7be4a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:29.048508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:29.085645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:29.088446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:29.091455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:29.093749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:29.095700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:29.097686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:29.121548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a HTTP/1.1 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f03496e6-0cb2-4eeb-a347-b1c25ca7be4a'} Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:15:29.123664 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:15:29.132368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance f03496e6-0cb2-4eeb-a347-b1c25ca7be4a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:15:29.137623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4ca4b2b-7273-40e6-92d7-96fa62061e1d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a" status: 404 len: 111 microversion: 2.1 time: 0.121664 Aug 24 02:15:29.143140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3813/4805] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:29 2022] GET /compute/v2.1/servers/f03496e6-0cb2-4eeb-a347-b1c25ca7be4a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:15:29.165455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:29.173111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:29.630263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.654962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.656574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.657804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a37250cd-5346-4a64-bb7b-e1ef7c1b2b68 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1278 microversion: 2.54 time: 0.513398 Aug 24 02:15:29.681952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3814/4806] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:29 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1278 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:29.686974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:29.687615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:29.720213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:29.720477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:29.729993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:29.733959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:29.734699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:29.735312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:29.962641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.978274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.994489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:29.995872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-368d6508-533a-49cf-acf4-bc477a79fc0f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1338 microversion: 2.20 time: 0.312920 Aug 24 02:15:30.000905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3815/4807] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:29 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1338 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:30.683789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:30.684508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:30.711850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:30.712935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:30.713407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:30.714140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:30.714602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:30.715031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:30.952343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:30.957958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:30.981557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:30.988992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:30.995402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0703c0f-4016-430f-b009-f785df3fa99f tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1330 microversion: 2.54 time: 0.313093 Aug 24 02:15:30.997228 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3816/4808] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:30 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1330 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:31.032812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:31.033742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:31.050867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:31.054058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:31.060179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:31.064655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:31.066908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:31.068168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:31.775262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:31.804918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:31.809334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:31.811254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-903e738c-e72c-459d-aff4-a57f0a93d4f2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1338 microversion: 2.20 time: 0.783783 Aug 24 02:15:31.816851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3817/4809] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:31 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1338 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:31.833104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccbcd40b-6072-41bb-8e1b-13801ed18758 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: .version_select at 0x7f6b90d880d0>, body: {"keypair": {"name": "tempest-keypair-1184368489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA51X+KN6Rd59RGcyTkwFpg18bQIflHj83QE8CZeyERaWeAyuYG0RLzGhOWcQTIBGPYZ9ZlCgT7SPb8da67/yQK51qdld2gB45zuPk7aAHutqAooPZDUoMIagJTOHqw0nA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:31.892841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ccbcd40b-6072-41bb-8e1b-13801ed18758 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for project a9360466b32d4c5083a55f35afe881d1. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:31.911388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ccbcd40b-6072-41bb-8e1b-13801ed18758 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for user d2da781ddf9a4aa0a4c04554ff8ecd2b and project a9360466b32d4c5083a55f35afe881d1. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:31.988621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccbcd40b-6072-41bb-8e1b-13801ed18758 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168944 Aug 24 02:15:31.989956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3818/4810] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:15:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:32.027462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:32.028158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:32.053411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:32.055561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:32.056078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:32.056851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:32.057322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:32.057755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:32.288882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:32.304051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:32.306519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:32.318270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22b5e770-d19a-44f6-b1cd-c8a411efafa3 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1336 microversion: 2.54 time: 0.298433 Aug 24 02:15:32.319573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3819/4811] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:32 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1336 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:15:32.841080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:32.841997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:32.869436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:32.869948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:32.870397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:32.871112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:32.871574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:32.872007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:33.706831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:33.732818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:33.734361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:33.735524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b20246b-e5cc-4751-bd10-5471dc062250 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.898546 Aug 24 02:15:33.736097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3820/4812] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:32 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:15:33.774866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:33.775516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:33.800512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:33.801566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:33.801566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:33.802185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:33.802763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:33.803065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:34.070069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:34.082758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:34.084283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:34.097825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e2f608c-f2f6-487a-b5ca-6ee75d8f16b4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1336 microversion: 2.54 time: 0.360584 Aug 24 02:15:34.098698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3821/4813] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:33 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1336 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:34.763754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:34.764291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:34.771992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:34.781583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:34.785003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:34.788278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:34.802751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:34.804353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:35.815779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:35.843079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:35.844663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:35.853465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d885da5-fe69-4f5c-a72d-41f77e0eca8d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 1.086307 Aug 24 02:15:35.854262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3822/4814] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:34 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:15:35.894352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:35.897939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:35.924600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:35.926374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:35.928104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:35.931298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:35.932649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:35.937229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:36.509804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:36.553026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:36.564133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:36.567684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6a67489-97b7-4918-98ed-27fefc965774 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1336 microversion: 2.54 time: 0.691288 Aug 24 02:15:36.589768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3823/4815] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:35 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1336 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:36.600601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:36.646197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:36.647957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:36.648422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:36.692052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] Creating event network-changed:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h2-854121-3 Aug 24 02:15:36.713140 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-88a900ba-4eab-42d6-a612-222b333f249b req-632cfc18-7c8b-4fd0-8e68-7c68e9b33333 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121920 Aug 24 02:15:36.720634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3824/4816] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:36.877681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:36.884812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:36.927196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:36.929913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:36.932308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:36.933762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:36.937302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:36.938682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:37.380968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:37.398840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:37.404495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:37.409204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc9b0209-4e5a-4e72-a20b-0bebdd71baab tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.534977 Aug 24 02:15:37.410855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3825/4817] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:36 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:37.431612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:37.438491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:37.453164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:37.456269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:37.456932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:37.459657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:37.460320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:37.461140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:38.402628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:38.419280 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cd05e12-2dfe-4185-92ce-46d92ad139c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.996354 Aug 24 02:15:38.432915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3826/4818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:37 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:38.448943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:38.452967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:38.479204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:38.481789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:38.483328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:38.486377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:38.488045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:38.490440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:38.682635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:38.694010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:38.695534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:38.701511 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c48e5135-9de9-470c-9445-0836e00f1fb7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1357 microversion: 2.54 time: 0.267058 Aug 24 02:15:38.702129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3827/4819] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:38 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:38.707182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:38.707798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:38.735720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:38.737487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:38.738405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:38.739054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:38.739962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:38.740597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:38.741060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:39.330089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:39.346957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:39.351908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:39.357867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3afa317-3c15-4f0d-a960-853edd629cae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.654631 Aug 24 02:15:39.371487 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3828/4820] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:38 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:39.375433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b59186a-7ba3-4fa5-ae83-5c7f22d9d066 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Action: 'create', calling method: .version_select at 0x7f6b913eedc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1683140185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoBsRbFOFl5JyEXHYSSKGczeD2OeLMKDn1jjgXO2noKT7GPouwD3bKrb4FISXJN1LityNs0T2KaQAovxnSj1BC1rHR9NwG0HgPEn6qBtO0pSxcwWbxoMv1jBhr9EuW2hQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:39.400580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1b59186a-7ba3-4fa5-ae83-5c7f22d9d066 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Getting quotas for project 5909e1a826034d698c3acb33fac1d8be. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:39.407057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-1b59186a-7ba3-4fa5-ae83-5c7f22d9d066 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Getting quotas for user 7f648aca2b1a4c5bb56d93ed39dd0368 and project 5909e1a826034d698c3acb33fac1d8be. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:39.463808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b59186a-7ba3-4fa5-ae83-5c7f22d9d066 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.103404 Aug 24 02:15:39.466379 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3829/4821] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 02:15:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 02:15:39.475462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1700520772", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5f19509-db2c-410b-8905-9dc2ff0ddb1a"}], "security_groups": [{"name": "tempest-securitygroup--680361527"}], "key_name": "tempest-keypair-1184368489", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:39.799003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] validate_networks() for [('d5f19509-db2c-410b-8905-9dc2ff0ddb1a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:15:41.165502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:15:41.166102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:15:41.166404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:15:41.166985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:15:41.167546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:15:41.185168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:41.185778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:41.186652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:41.187763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:41.188639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:41.189270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:41.256773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:15:41.277701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Getting quotas for user d2da781ddf9a4aa0a4c04554ff8ecd2b and project a9360466b32d4c5083a55f35afe881d1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:15:41.315600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:15:41.318069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:15:41.382828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09b2bf2f-80ac-4f19-98db-2cd7d9ddb40e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.914110 Aug 24 02:15:41.384041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3830/4822] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:15:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:15:41.388911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:41.393708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:41.400883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:41.401625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:41.402279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:41.403000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:41.403462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:41.403894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:41.995154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:42.005930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-560fa534-507a-445e-855f-ea37f2901795 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.620579 Aug 24 02:15:42.006522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3831/4823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:41 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:42.031721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1683140185", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:42.038582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:42.055401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.056148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.056805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:42.058567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.062797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.063245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:42.287940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:15:42.289466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:15:42.290865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:15:42.291544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:15:42.292185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:15:42.524426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:42.534599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.535564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.537021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:42.539388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.540710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.541352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:42.593776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abdbb53e-8a22-4b6a-94e2-a05d19485efa tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "POST /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3/action" status: 202 len: 1140 microversion: 2.54 time: 0.583772 Aug 24 02:15:42.595395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3832/4824] 10.222.0.49 () {62 vars in 1320 bytes} [Wed Aug 24 02:15:42 2022] POST /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3/action => generated 1140 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 24 02:15:42.626621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:42.627316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:42.650089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.652407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.652942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:42.654781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:42.660045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:42.660650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:43.370098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:43.389029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:43.395467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:43.397002 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f06ff3f8-9b82-457d-901a-dddce3ef8197 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.800291 Aug 24 02:15:43.401710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3833/4825] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:42 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:43.417597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:43.418603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:43.431168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:43.431928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:43.432680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:43.433627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:43.434398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:43.434999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:43.459455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:43.604778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:43.624676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-703b1d22-bec3-4303-970d-2846e67410d4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1298 microversion: 2.1 time: 0.219797 Aug 24 02:15:43.640430 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3834/4826] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:43 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1298 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:43.646248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1884135922"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:43.674511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:43.694780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:43.696638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:43.697162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:43.698735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:43.699215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:43.699653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:44.629774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0af5185a-46d7-4302-8acf-fda1e57fa3c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.998921 Aug 24 02:15:44.630564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3835/4827] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:15:43 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 02:15:44.690899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:44.695492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:44.711148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:44.712566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:44.713432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:44.724035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:44.724035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:44.724035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:45.021003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.035552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.037620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.038885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5679f67f-cdd2-482a-b2e5-53f1e17858ac tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.407194 Aug 24 02:15:45.041769 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3836/4828] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:44 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:45.062404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-unplugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:45.080944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:45.081437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:45.093678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:45.147092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] Creating event network-vif-unplugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:15:45.158415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1a772eee-da66-4d6e-b29d-d058f4710084 req-6a9f27fc-d11e-42bd-b077-ee832c78dd54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115115 Aug 24 02:15:45.159351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3837/4829] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:45.167944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:45.168639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:45.194172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:45.195526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:45.196829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:45.197964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:45.198619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:45.199528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:45.630048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.640252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.641785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:45.642913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f63dbec-70a4-40ce-b640-4061491959c3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.482473 Aug 24 02:15:45.659049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3838/4830] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:45 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:45.676523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:45.697161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:45.722868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:45.736366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:45.740247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:45.743777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:45.745018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:45.747592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:46.791609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:46.810102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9d5e430-622b-4059-8ab6-838d9660ba0d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 1.143661 Aug 24 02:15:46.824182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3839/4831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:45 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:46.829380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:46.830572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:46.842348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:46.842855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:46.843300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:46.844023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:46.844487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:46.844960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:46.969377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:46.982482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:46.985008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:46.986424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adf5d33c-027a-4a9e-91e5-9909538d1fef tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.161103 Aug 24 02:15:46.987688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3840/4832] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:46 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:46.997063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:46.998208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:47.007033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:47.010093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.010847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.011516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:47.012582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.013350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.014440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:47.450345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:47.466136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:47.469315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:47.472608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebe41553-b229-46e7-bd80-f7ed913ade94 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.483640 Aug 24 02:15:47.485488 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3841/4833] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:46 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:47.495052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:47.512151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.513055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.513841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:47.529752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] Creating event network-changed:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:15:47.537224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9e9440ee-d84f-4ae5-a84f-95d21d19c670 req-34225c8e-34a7-4892-8a99-6911b215ef2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049781 Aug 24 02:15:47.538791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3842/4834] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:47.546823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "name": "network-vif-plugged", "status": "completed", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:47.559826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.560953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.561598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:47.577289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] Creating event network-vif-plugged:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h2-854121-3 Aug 24 02:15:47.585108 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6a1e51a2-7c4c-4446-9935-96da376a0b20 req-e6d036f3-3415-412d-b8f6-7ee187f5bb4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044365 Aug 24 02:15:47.586554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3843/4835] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:47.833533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:47.835366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:47.872522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.874426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.874929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:47.875711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:47.876220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:47.877016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:48.313881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.323726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49e79a04-0917-42c3-91d9-f20700d1bf78 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.495545 Aug 24 02:15:48.325206 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3844/4836] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:47 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:48.330429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:48.331254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:48.352897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:48.353406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:48.353867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:48.354885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:48.355356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:48.355793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:48.577315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.589761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.595692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.596647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-790d8c4c-5e83-42f9-8e5e-4b58c19abc84 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.270220 Aug 24 02:15:48.598521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3845/4837] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:48 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:48.617724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:48.618856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:48.627174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:48.628071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:48.629157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:48.630689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:48.631640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:48.632301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:48.936496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.949879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.953380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:48.955433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c78f3d64-3c73-4a4a-9433-b891620abc77 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 0.351182 Aug 24 02:15:48.970896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3846/4838] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:48 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:49.349855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:49.350565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:49.360062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:49.361371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:49.362644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:49.364180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:49.365452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:49.366641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:49.763400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:49.775170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63162f6e-a7ad-4054-adf4-24d5c4c49410 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.429217 Aug 24 02:15:49.775897 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3847/4839] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:49 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:49.784200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:49.784642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:49.822303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:49.822739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:49.823189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:49.828327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:49.831504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:49.833337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:50.029007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:50.049038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:50.055420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:50.058706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8fa68da-cd2c-47c2-948f-d13920757c74 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.280003 Aug 24 02:15:50.061552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3848/4840] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:49 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:50.081090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:50.083110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:50.119617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:50.128184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:50.128916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:50.134676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:50.136451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:50.138642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:51.204479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:51.212093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:51.232961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:51.238450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:51.246177 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1867bfa9-66cd-48ec-8b16-220031fea700 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1406 microversion: 2.20 time: 1.182761 Aug 24 02:15:51.248373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3849/4841] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:50 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1406 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:51.263793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:51.264434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:51.278161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:51.278673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:51.279126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:51.279880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:51.280350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:51.280874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:51.311278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=30 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:51.828236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:51.841880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-664560b1-2d9a-45dd-8d9c-2f3d3080320b tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.591995 Aug 24 02:15:51.864024 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3850/4842] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:51 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:51.870232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:51.871300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:51.879660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:51.880675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:51.881332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:51.882802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:51.883734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:51.884609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:52.050883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.057823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:15:52.068356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.069813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.077272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb1b7fd0-9fee-44dc-b218-f1cf5d4db5d4 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.210776 Aug 24 02:15:52.079623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3851/4843] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:51 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:52.275014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:52.281280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:52.304481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:52.306224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:52.307252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:52.308461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:52.308964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:52.309407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:52.796739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.816295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.820853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:52.824692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee411310-d5d4-4ea5-990d-c0581894f008 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1597 microversion: 2.20 time: 0.556708 Aug 24 02:15:52.827528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3852/4844] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:52 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1597 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:15:52.855082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:52.857217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:52.868841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:52.871120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:52.872083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:52.873891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:52.874639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:52.875648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.084635 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efecbf1a-300c-49b7-9d12-fd1a4f909e96 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.235857 Aug 24 02:15:53.085379 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3853/4845] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 02:15:52 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-interface => generated 285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:15:53.091023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:53.092039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:53.112562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:53.113699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:53.114392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.115353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:53.117319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:53.118586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.520901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:53.540610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afa02ce6-0ad0-4ed9-af1e-6ebf1621f75e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.452987 Aug 24 02:15:53.543333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3854/4846] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:53 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:15:53.561086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-plugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:53.573005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:53.573620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:53.574255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.593735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] Creating event network-vif-plugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:15:53.599807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-85a47f83-4776-4372-8adc-eed11cf8ff36 req-0a500168-5fcd-47cc-8c27-c65751594d85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054814 Aug 24 02:15:53.601478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3855/4847] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:53.608662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:53.609693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:53.618584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:53.619634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:53.620541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.622063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:53.622775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:53.623437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:53.748133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:53.766443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:53.769395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:53.772873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95636724-9002-4877-aba1-17cc2e11a94d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.169091 Aug 24 02:15:53.775106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3856/4848] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:53 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:54.566955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:54.570647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:54.588782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:54.592670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:54.594556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:54.597251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:54.606869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:54.606869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:55.772492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:55.783219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5aa6a41-8c9a-4855-ba10-2bf3e83ade52 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 1.224070 Aug 24 02:15:55.788965 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3857/4849] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:54 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:55.797243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:55.805956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:55.816413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:55.817014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:55.817484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:55.818232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:55.819043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:55.819192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:56.201253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:56.217170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:56.224334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:56.226125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1180ae61-3157-46b5-91e1-46a544694bd8 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.435329 Aug 24 02:15:56.233042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3858/4850] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:55 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:56.238150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "name": "network-vif-plugged", "status": "completed", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:56.263769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:56.264325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:56.264898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:56.303426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] Creating event network-vif-plugged:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:15:56.316139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-132adde0-88d2-42a3-b784-a2f3ae251fd6 req-c5947e95-9915-4689-b608-1d6cf2dc1cc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081660 Aug 24 02:15:56.319676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3859/4851] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:56.813646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:56.814357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:56.832249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:56.836959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:56.837690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:56.838513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:56.838999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:56.839432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:57.527518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:57.543314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a204adee-413e-4aba-bb10-e08e700d6617 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.732707 Aug 24 02:15:57.544254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3860/4852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:56 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:57.557301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:15:57.584575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:57.589266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:57.590257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:57.619504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] Creating event network-changed:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h2-854121-3 Aug 24 02:15:57.635907 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e93fde42-9d40-49d8-9e61-7432391eecae req-fa410843-573a-4b52-997d-762a91279e10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090029 Aug 24 02:15:57.636530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3861/4853] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:15:57.649291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:57.651330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:57.687128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:57.687639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:57.688081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:57.688825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:57.701439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:57.702190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:58.002659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:58.013174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:58.022869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:58.025219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd49e0cf-a3f1-4c65-bdb0-3330d9501662 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.387362 Aug 24 02:15:58.030257 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3862/4854] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:57 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:15:58.565559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:58.566224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:58.586595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:58.587300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:58.587772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:58.588528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:58.589026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:58.589459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:59.165380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:59.178578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e9e80e7-f7ca-4186-bfcc-eabbd56de238 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1371 microversion: 2.1 time: 0.615927 Aug 24 02:15:59.179158 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3863/4855] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:15:58 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1371 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:15:59.196356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:15:59.197759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:15:59.204541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:59.205632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:59.206318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:59.207562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:15:59.208395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:15:59.209024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:15:59.374665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:59.385436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:59.393402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:15:59.394987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-309fc384-0fcf-44a4-8d66-bf7d28a086d9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1409 microversion: 2.54 time: 0.213226 Aug 24 02:15:59.396915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3864/4856] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:15:59 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1409 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:16:00.201784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:00.202631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:00.218380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:00.218894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:00.219344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:00.234313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:00.234828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:00.235282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:01.079527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:01.090146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7833c9b1-a22c-4bfb-a98c-6f05b48fedb8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1565 microversion: 2.1 time: 0.893736 Aug 24 02:16:01.093412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3865/4857] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:00 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1565 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:01.106805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:01.114392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:01.141118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:01.141882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:01.142537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:01.143488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:01.145043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:01.146759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:02.151716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:02.179477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:02.184769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:02.188041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-21aa09b1-f743-4d4d-85c5-6a00952068f7 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1415 microversion: 2.54 time: 1.091342 Aug 24 02:16:02.192464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3866/4858] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:01 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1415 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:16:02.232096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:02.233303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:02.255280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:02.256261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:02.259311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:02.260074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:02.260554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:02.261019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:02.501958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24a05d8d-297d-481a-8bd9-b5a0eff1ba7d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.283106 Aug 24 02:16:02.503744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3867/4859] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:16:02 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:16:03.224483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:03.225989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:03.239551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:03.240335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:03.240975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:03.244487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:03.245177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:03.245858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:03.419667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:03.431699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:03.453041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:03.455795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-833c7cd5-0c93-4efd-b2ec-011eb8938448 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1415 microversion: 2.54 time: 0.235725 Aug 24 02:16:03.463622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3868/4860] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:03 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1415 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:16:04.487123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:04.488465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:04.501011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:04.504619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:04.506427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:04.518933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:04.524220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:04.528468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:04.788194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:04.814481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:04.821245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:04.824501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a925cfdf-3fcf-425c-b3e4-f0793bcef499 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1400 microversion: 2.54 time: 0.342051 Aug 24 02:16:04.835225 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3869/4861] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:04 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1400 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:16:04.853516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c39eff12-d3f3-4960-b300-dd1d76c89697 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '.version_select at 0x7f6b91406f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:04.877920 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c39eff12-d3f3-4960-b300-dd1d76c89697 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1683140185" status: 204 len: 0 microversion: 2.54 time: 0.029307 Aug 24 02:16:04.885373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3870/4862] 10.222.0.49 () {60 vars in 1319 bytes} [Wed Aug 24 02:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1683140185 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:16:04.891937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:04.892739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:04.901281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:04.902296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:04.903017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:04.904110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:04.904851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:04.905552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:04.941290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:16:04.993725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:05.098639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcb6d78b-2af1-4089-9b6d-11cc5110c85c tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "DELETE /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 204 len: 0 microversion: 2.54 time: 0.210927 Aug 24 02:16:05.105034 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3871/4863] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:16:04 2022] DELETE /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:16:05.117257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:05.120559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:05.140800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:05.141483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:05.143739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:05.146793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:05.148760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:05.149912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:05.438687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:05.460026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:05.465038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:05.467513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b264351e-3172-4137-8cf8-4ad80062684d tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1406 microversion: 2.54 time: 0.359880 Aug 24 02:16:05.490136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3872/4864] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:05 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:16:05.743841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:05.773056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:05.774220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:05.776194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:05.796115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] Creating event network-changed:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:16:05.803979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fe3038bc-1c85-4f64-b8c6-74ceed98772d req-bd73a115-dac5-4481-ba35-9b8810b31144 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066558 Aug 24 02:16:05.806353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3873/4865] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:16:06.513756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:06.516244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:06.573528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:06.573795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:06.583599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:06.588034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:06.596033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:06.600034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:06.897321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:06.935546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:06.941658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:06.949874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4f86068-9225-41ec-a2aa-bb634b42b260 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1406 microversion: 2.54 time: 0.448479 Aug 24 02:16:06.950942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3874/4866] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:06 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:16:07.976093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:07.976861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:07.997533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:07.999930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:08.000472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:08.002642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:08.003686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:08.005011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:08.137531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:08.137531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:08.143994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:08.148857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lazy-loading 'fault' on Instance uuid 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:16:08.375579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:08.392254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:08.400469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7f648aca2b1a4c5bb56d93ed39dd0368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909e1a826034d698c3acb33fac1d8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:08.404648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99cdb150-19a0-406f-9a57-624bd4d64fb9 tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 200 len: 1411 microversion: 2.54 time: 0.432985 Aug 24 02:16:08.406318 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3875/4867] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:07 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 1411 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:16:09.433091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:09.434624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] [instance: 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:09.451575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:09.452413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:09.456686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:09.467606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:09.474573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:09.475428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:09.517268 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] HTTP exception thrown: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Request method failure captured: Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 HTTP/1.1 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYm_ylgoM18G3uVGQrxWJeopU3VC2kZ5YQBzs454dzdBp2kpq-5V4HRHD0E43ROfyZrnpN4eEmdCMq45E_GDOfJWp3lTtnhuoUy1F_so7E95qxJYKndZwDZCjXJdkBfqW-Bab7hSWnOOoc7Twdl5nYF3BxnZCB77bvV0Em82ZjiEMFE Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.54 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5909e1a826034d698c3acb33fac1d8be Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerShowV254Test-381156807 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5909e1a826034d698c3acb33fac1d8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5909e1a826034d698c3acb33fac1d8be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5909e1a826034d698c3acb33fac1d8be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5909e1a826034d698c3acb33fac1d8be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerShowV254Test-381156807 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5909e1a826034d698c3acb33fac1d8be Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerShowV254Test-381156807 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerShowV254Test-381156807-project Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7f648aca2b1a4c5bb56d93ed39dd0368 Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerShowV254Test-381156807-project Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '67b1ab11-b6ca-4566-8eeb-8ab218ede1f3'} Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:16:09.524272 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] Returning 404 to user: Instance 67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1f3418a-85bb-4e72-84c3-ced00e65f40e tempest-ServerShowV254Test-381156807 tempest-ServerShowV254Test-381156807-project] 10.222.0.49 "GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3" status: 404 len: 111 microversion: 2.54 time: 0.098542 Aug 24 02:16:09.532095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3876/4868] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:16:09 2022] GET /compute/v2.1/servers/67b1ab11-b6ca-4566-8eeb-8ab218ede1f3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:16:14.945261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-204224114", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "545a1592-3a1e-4f67-8a85-53e318421187", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:15.267250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:16:17.930174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:16:17.931143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:16:17.931669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:16:17.932393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:16:17.933131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:16:17.944381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:17.974196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:17.996284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:17.997037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:17.998051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:18.000762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:18.001400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:18.088959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:16:18.109691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:16:18.150901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:16:18.158865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='545a1592-3a1e-4f67-8a85-53e318421187',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:16:18.345648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-616469b9-847e-4e2c-8f18-10bee8c1a46e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.405550 Aug 24 02:16:18.347960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3877/4869] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:16:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:16:18.382874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b5a14b1-590d-490f-b3e6-c72d21ad308b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:18.384045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b5a14b1-590d-490f-b3e6-c72d21ad308b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:18.615209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b5a14b1-590d-490f-b3e6-c72d21ad308b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:18.627582 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b5a14b1-590d-490f-b3e6-c72d21ad308b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1056 microversion: 2.1 time: 0.273596 Aug 24 02:16:18.629441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3878/4870] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:18 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1056 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:19.653113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1a1d02a-2097-4baa-9d98-9938cc6f4159 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:19.653827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1a1d02a-2097-4baa-9d98-9938cc6f4159 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:19.815969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1a1d02a-2097-4baa-9d98-9938cc6f4159 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:19.832463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1a1d02a-2097-4baa-9d98-9938cc6f4159 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1056 microversion: 2.1 time: 0.186276 Aug 24 02:16:19.833055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3879/4871] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:19 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1056 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:20.861282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:20.863158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:20.877195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:20.877700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:20.878198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:20.878970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:20.879509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:20.880130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:21.261907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:21.276904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58ffa16d-50b6-4dde-9a03-aed1a925bd73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1108 microversion: 2.1 time: 0.420352 Aug 24 02:16:21.279484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3880/4872] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:20 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1108 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:22.304441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:22.305523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:22.324403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:22.325023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:22.325491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:22.326214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:22.326684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:22.327120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:22.663563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:22.682555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8b4b00d-9d16-43fb-92ef-a814e4e6881e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1126 microversion: 2.1 time: 0.386167 Aug 24 02:16:22.683382 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3881/4873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:22 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1126 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:23.704035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:23.705088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:23.718765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:23.719278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:23.719731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:23.720462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:23.720963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:23.721401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:24.083134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:24.092666 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c9afa16-4e98-4381-b586-04b1cbfb487a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.392489 Aug 24 02:16:24.093925 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3882/4874] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:23 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:25.118280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:25.118980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:25.132652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:25.133173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:25.133610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:25.134316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:25.134770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:25.135192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:25.567309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:25.578087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1b43e8c-fea2-49a1-bb31-1759afa42ba4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.462610 Aug 24 02:16:25.578783 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3883/4875] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:25 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:25.594297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:25.595295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:25.609151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:25.612439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:25.612961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:25.614724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:25.615203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:25.617077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:26.489466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:26.501005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a1a8ad6-3529-43a9-a84f-802a115c4caf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.919067 Aug 24 02:16:26.502942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3884/4876] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:25 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:26.828282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0145bde-5e8d-4766-a000-9a23cf2cf691", "tag": "27577230-6f3b-4974-be62-dca63d4ba1e5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:26.840894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:26.841860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:26.842619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:26.872482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] Creating event network-changed:27577230-6f3b-4974-be62-dca63d4ba1e5 for instance c0145bde-5e8d-4766-a000-9a23cf2cf691 on n-h1-854121-3 Aug 24 02:16:26.878631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2d79e415-bbe6-44c3-8f95-3e5db10db9f8 req-0232e180-a822-4c8c-9283-bc89c59c1f9e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369668 Aug 24 02:16:26.879540 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3885/4877] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:16:26.886232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-979143194"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:26.889496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:26.896191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:26.897132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:26.897691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:26.898400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:26.898857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:26.899276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:27.397994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46aea62e-c9d4-4bb9-8bab-e6337e8173a6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.502700 Aug 24 02:16:27.399295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3886/4878] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:16:26 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 24 02:16:27.410502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:27.412376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:27.422392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:27.423196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:27.423840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:27.424802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:27.425440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:27.427957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:28.036898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:28.132377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:28.151404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37853962-ee64-40ff-80f9-5d5de282fa0c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.750588 Aug 24 02:16:28.152347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3887/4879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:27 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:28.169509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:28.170576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:28.193243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:28.197631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:28.199209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:28.199998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:28.200482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:28.200967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:29.032418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:29.067556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e61f41e-5f55-438c-8fef-3069a99dafae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.909140 Aug 24 02:16:29.087482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3888/4880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:28 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:29.174335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:29.174982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:29.188067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:29.188524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:29.188976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:29.208125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:29.210867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:29.213286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:29.575163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:29.586061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83b6bfe9-10be-4827-88c6-372179d9fa3e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.415627 Aug 24 02:16:29.586797 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3889/4881] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:29 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:29.612035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-unplugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:29.653572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:29.654274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:29.656690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:29.672901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:29.698098 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] Creating event network-vif-unplugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:16:29.708151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fc7e8380-3ef7-4385-b29d-7c91d0fe3750 req-ae5c79c1-df02-4a21-8c1e-ec971822f322 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108037 Aug 24 02:16:29.712636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3890/4882] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:16:30.089868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:30.110208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:30.111073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:30.127398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:30.129272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:30.130643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:30.133406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:30.133907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:30.135565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:30.854040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:30.871767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5524816-b8bf-42d6-95c4-136c2130e426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.783887 Aug 24 02:16:30.872596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3891/4883] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:30 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:30.895663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:30.897416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:30.938443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:30.938960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:30.942897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:30.944912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:30.945412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:30.946937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:31.563127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:31.578573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f331603-c92f-4dd7-b89a-9554f943e6c0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.704290 Aug 24 02:16:31.595166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3892/4884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:30 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:31.899447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:31.900073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:31.912314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:31.915417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:31.916989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:31.917911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:31.921402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:31.924480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:32.539226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:32.581149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4479b5e6-39d0-4729-be35-a9c9c204f2b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1687 microversion: 2.1 time: 0.684313 Aug 24 02:16:32.588181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3893/4885] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:31 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1687 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:32.623802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:32.628531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:32.647841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:32.648328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:32.648797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:32.656185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:32.657559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:32.658722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:33.472140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:33.480202 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aba8c3f2-17cd-4757-87e2-177a2ec133c2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.873369 Aug 24 02:16:33.501253 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3894/4886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:32 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:33.615769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:33.617476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:33.646860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:33.648038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:33.648491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:33.666715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:33.670287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:33.676764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:34.054799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:34.065187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51455884-481f-468b-8ea1-47c418522b4a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1687 microversion: 2.1 time: 0.454232 Aug 24 02:16:34.077761 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3895/4887] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:33 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1687 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:34.507739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:34.508432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:34.523985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:34.531877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:34.533403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:34.538834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:34.539579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:34.541199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:35.012913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:35.029338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b1e4f17-0985-4ef7-9733-c556d14883da tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.525623 Aug 24 02:16:35.043998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3896/4888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:34 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:35.093054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:35.094305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:35.102078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:35.103558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:35.104273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:35.105303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:35.106177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:35.107413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:35.548048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:35.561871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea8eda41-82f2-473a-a3f1-972ea920d40a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1687 microversion: 2.1 time: 0.473725 Aug 24 02:16:35.571119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3897/4889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:35 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1687 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:36.060503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:36.062656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:36.071772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:36.073078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:36.073807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:36.075367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:36.076080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:36.076765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:36.418086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:36.430975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a081b52-2ecb-4bb0-8f8e-811c721b1f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.375854 Aug 24 02:16:36.437741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3898/4890] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:36 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:36.626518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:36.627278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:36.636373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:36.637258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:36.638011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:36.639326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:36.646229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:36.648360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:37.751725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:37.781627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-853e9147-377d-4101-aea2-4b086716561f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 1.158783 Aug 24 02:16:37.783929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3899/4891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:36 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:37.804132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-plugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:16:37.842229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:37.843031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:37.843831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:37.877449 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] Creating event network-vif-plugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:16:37.893311 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-519a6272-9142-4491-8cfc-a77a34e1878d req-fa9676bf-608d-42df-a272-1bc2f5f58006 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106588 Aug 24 02:16:37.894984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3900/4892] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:16:37.917086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:37.919350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:37.940123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:37.941113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:37.941715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:37.942876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:37.952212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:37.953215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:38.530329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:38.547655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeb4ec3f-7277-4ca9-a9e4-43a4eadc6433 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.648635 Aug 24 02:16:38.557269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3901/4893] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:37 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:38.806551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:38.807978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:38.822938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:38.823991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:38.825059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:38.834095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:38.835375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:38.836259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:39.855672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:39.872479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dcf5f515-f1e6-4f39-8fc7-54ca8dd16cc1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 1.072259 Aug 24 02:16:39.876287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3902/4894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:38 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:39.889140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:39.891160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:39.907833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:39.909292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:39.910660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:39.913140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:39.913993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:39.919872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:40.902213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:40.910281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3222d8ac-d3eb-40ea-910f-c194b2aeaef3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 1.032391 Aug 24 02:16:40.928750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3903/4895] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:39 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:40.936867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:40.936867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:40.951811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:40.952430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:40.953010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:40.960945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:40.961624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:40.962299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:41.341031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:41.354143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f15f2628-4466-40ab-b209-3075acf33a86 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.429133 Aug 24 02:16:41.355472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3904/4896] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:40 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:41.944875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:41.945499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:41.961899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:41.962409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:41.962870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:41.964172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:41.964825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:41.965415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:42.367535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:42.380694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9ef2ebc-69a0-4ed9-aa3b-814a93ffa46d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.440259 Aug 24 02:16:42.399409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3905/4897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:41 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:42.424177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:42.426124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:42.450596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:42.451483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:42.452207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:42.453421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:42.454059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:42.454655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:42.740640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:42.756239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0757dc4d-469b-43fb-ab83-b22adfa3d01b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.350421 Aug 24 02:16:42.758053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3906/4898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:42 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:43.418891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:43.421160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:43.448257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:43.448841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:43.449391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:43.450020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:43.450486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:43.450921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:44.375336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:44.389307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a79768f4-6eb9-472a-993d-3f8e7a827836 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.981646 Aug 24 02:16:44.407816 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3907/4899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:43 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:44.437385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:44.439001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:44.467468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:44.469657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:44.470375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:44.472990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:44.475529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:44.477379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:44.563938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:45.264585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:45.283741 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3aad6db8-de82-4d7b-b138-7b364a0dab5d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.868569 Aug 24 02:16:45.285726 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3908/4900] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:45.412683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:45.413563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:45.423395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:45.429418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:45.430761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:45.432165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:45.433767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:45.438940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:46.068211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:46.078439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18c4fdd5-9b4d-469a-bffe-e64a001694a8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.670003 Aug 24 02:16:46.079021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3909/4901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:45 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:46.309787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:46.310803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:46.324361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:46.335068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:46.336449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:46.337414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:46.340571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:46.341298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:46.802056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:46.818213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-766eaad5-3d6f-4b18-b397-73451e7395b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.512355 Aug 24 02:16:46.840223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3910/4902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:46 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:47.100258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:47.109053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:47.140087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:47.146067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:47.150624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:47.156881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:47.158206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:47.163398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:47.722367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:47.734470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cc67fc0-531a-4855-b132-839df8faa3d7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.638664 Aug 24 02:16:47.751813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3911/4903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:47 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:47.852852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:47.855293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:47.862405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:47.863262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:47.864049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:47.865218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:47.866017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:47.866769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:48.241755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:48.258562 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69915f1e-c036-4a7b-a5d6-f96e989b96ea tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.412727 Aug 24 02:16:48.259722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3912/4904] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:47 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:48.764982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:48.766050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:48.780306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:48.815369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:48.815888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:48.816344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:48.824938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:48.825450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:48.825907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:49.811240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:49.837272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc70cbb1-72ff-4abe-88e1-11cb84034509 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 1.080949 Aug 24 02:16:49.837968 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3913/4905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:48 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:49.876288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:49.876984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:49.891013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:49.891820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:49.892431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:49.893351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:49.893994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:49.895156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:50.376672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:50.405430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49365f5a-1111-41e5-a7de-08badaf04854 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.547330 Aug 24 02:16:50.406664 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3914/4906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:49 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:50.862690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:50.863363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:50.871984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:50.872485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:50.872967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:50.877629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:50.885519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:50.886236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:51.251717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:51.265473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99513068-143d-4a27-908f-2c38053fd277 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1168 microversion: 2.1 time: 0.406807 Aug 24 02:16:51.267242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3915/4907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:50 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1168 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:51.429342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:51.430021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:51.446764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:51.447479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:51.448117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:51.449254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:51.449882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:51.450946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:51.931623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:51.943315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02e8596f-f4cf-4934-aaf6-ea0598e75f47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.519368 Aug 24 02:16:51.948548 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3916/4908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:51 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:52.286897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:52.291402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:52.299380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:52.305369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:52.307903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:52.308898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:52.309541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:52.310156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:52.682560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:52.693096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5534c98f-8720-40c5-bd45-bbd54d3e5c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.409894 Aug 24 02:16:52.706814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3917/4909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:52 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:52.983377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:52.984096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:53.014290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:53.014792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:53.015241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:53.015959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:53.031951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:53.032878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:53.382419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:53.392735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6071fb68-9d3b-4581-85e6-334ee4ba65b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.417736 Aug 24 02:16:53.398770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3918/4910] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:52 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:53.724381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:53.726937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:53.748097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:53.754293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:53.754844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:53.755675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:53.760260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:53.761409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:54.148370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:54.163711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7205b0e-86ff-4d48-939d-041438116143 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.439999 Aug 24 02:16:54.188293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3919/4911] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:53 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:54.425233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:54.430303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:54.451746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:54.452520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:54.456415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:54.457230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:54.457711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:54.458155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:54.803136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:54.811966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7907d245-aa48-4d3f-b723-7922b01684b5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.393893 Aug 24 02:16:54.812559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3920/4912] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:54 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:55.190508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:55.193129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:55.207521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:55.208466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:55.209813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:55.210724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:55.211366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:55.212269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:55.449032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:55.466369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-608403cb-2419-4fbd-b33f-6ffe4b5a6b3f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.282737 Aug 24 02:16:55.471930 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3921/4913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:55 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:55.834677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:55.835304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:55.847189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:55.847861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:55.848316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:55.851491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:55.851987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:55.855538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:56.536510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:56.547603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29780cc3-017e-4afa-8b10-4ab2a6c2dc47 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.717994 Aug 24 02:16:56.550184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3922/4914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:55 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:56.560236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:56.562395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:56.578626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:56.579791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:56.582446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:56.583554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:56.586462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:56.587595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:56.884466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:56.893251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-046935ac-7092-470b-bc89-87aa6c1a6275 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.340549 Aug 24 02:16:56.898541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3923/4915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:56 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:57.572273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:57.572952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:57.589193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:57.591775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:57.592881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:57.593635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:57.594111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:57.594538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:57.963016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:57.966821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:16:57.976906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-508b0a0b-5f3a-48a8-adfc-bda0914e114a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.405228 Aug 24 02:16:57.978136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3924/4916] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:57 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:57.994193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:57.995217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:58.012946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:58.013818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:58.014499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:58.016588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:58.017325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:58.021380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:58.603918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:58.661159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04d8df27-dc84-4416-8777-dea96602bc2b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.680665 Aug 24 02:16:58.664822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3925/4917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:57 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:16:59.007098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:59.008071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:59.028233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:59.029548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:59.031022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:59.032146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:59.033527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:59.034685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:59.633282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:16:59.647043 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e37ea576-e914-45c1-aabd-a9253f93ec64 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.646744 Aug 24 02:16:59.664805 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3926/4918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:58 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:16:59.698461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:16:59.700564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:16:59.751993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:59.754528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:59.758788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:16:59.760176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:16:59.762584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:16:59.764930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:00.197181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:00.222699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a548840-aa42-4b8b-a933-e22dddea779c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.529071 Aug 24 02:17:00.228070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3927/4919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:16:59 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:00.673291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:00.673974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:00.685590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:00.686093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:00.700225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:00.701049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:00.701543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:00.701989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:01.035244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:01.047685 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a74b34a4-3653-4956-9be2-c17a53896b02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.380267 Aug 24 02:17:01.048201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3928/4920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:00 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:01.251558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:01.252274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:01.260978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:01.262177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:01.264326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:01.265819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:01.267209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:01.268296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:01.506321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:01.518936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4036cb17-85d0-45c2-9be3-c57e690240f2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.271800 Aug 24 02:17:01.520210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3929/4921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:01 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:02.071905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:02.074351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:02.087611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:02.089880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:02.090549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:02.092769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:02.095333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:02.097894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:02.801541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:02.816797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-caf8608b-45f1-4382-a887-0c7e85c817c3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.749264 Aug 24 02:17:02.821244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3930/4922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:02 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:02.829290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:02.838870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:02.863606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:02.872777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:02.873519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:02.875112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:02.875942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:02.877249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:03.480743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:03.498547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cfd369f-68ed-4b62-90c1-5a419fb33605 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.675889 Aug 24 02:17:03.499279 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3931/4923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:02 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:03.848344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:03.850346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:03.865457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:03.867359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:03.873411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:03.875756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:03.876607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:03.878149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:04.990135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:05.003371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88c4b66e-b76a-44f5-8225-03b3c1a46b3c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 1.163164 Aug 24 02:17:05.003981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3932/4924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:03 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:05.013762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:05.016230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:05.024418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:05.025750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:05.026727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:05.027680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:05.028339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:05.029620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:05.684263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:05.701336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-611ec534-1c10-4117-bbe9-05278496364b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.691066 Aug 24 02:17:05.702636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3933/4925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:05 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:05.714810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-415411082", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:05.863915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:17:06.455983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:17:06.456631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:17:06.457143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:17:06.457978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:17:06.458463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:17:06.500499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:06.508260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:06.508844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:06.513512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:06.514106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:06.514558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:06.609845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Getting quotas for project c9e69ebaa5f445a8b145d2a2aeb5a9e7. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:17:06.624065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Getting quotas for user d9620ad6315f47c59df85197215af8fc and project c9e69ebaa5f445a8b145d2a2aeb5a9e7. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:17:06.664175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:17:06.670312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:17:06.797792 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2590c495-24ed-4df3-879d-74686ea871e5 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091209 Aug 24 02:17:06.798512 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3934/4926] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:17:07.072888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0145bde-5e8d-4766-a000-9a23cf2cf691", "name": "network-vif-plugged", "status": "completed", "tag": "27577230-6f3b-4974-be62-dca63d4ba1e5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:07.104172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:07.104671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:07.114152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:07.135857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] Creating event network-vif-plugged:27577230-6f3b-4974-be62-dca63d4ba1e5 for instance c0145bde-5e8d-4766-a000-9a23cf2cf691 on n-h1-854121-3 Aug 24 02:17:07.142402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a99cee90-409e-4f3c-91ff-ca7caee383c2 req-da8fc753-5f31-4ff1-9be5-61c0639edb51 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.332110 Aug 24 02:17:07.143394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3935/4927] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:07.148829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:07.149796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:07.158212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:07.159066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:07.159847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:07.162299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:07.163790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:07.164971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:07.551195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:07.560374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3206c6ff-1369-4f05-bcd2-95e7f87e9217 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1682 microversion: 2.1 time: 0.415623 Aug 24 02:17:07.566503 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3936/4928] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:07 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:07.584818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:07.585447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:07.591611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:07.592067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:07.596758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:07.597672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:07.598331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:07.598927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:08.461685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:08.470954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b8e138e-b7ec-4a7d-97e1-eb1e21fa094c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1202 microversion: 2.1 time: 0.903129 Aug 24 02:17:08.474950 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3937/4929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:07 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1202 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:08.490151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:08.503668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:08.540741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:08.544436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:08.550545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:08.551983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:08.557459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:08.558461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:08.703729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:08.724261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4dfa64e4-112f-4b12-b334-b8a4ac9eec86 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1265 microversion: 2.1 time: 0.243460 Aug 24 02:17:08.728135 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3938/4930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:08 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:08.749095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:08.750487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:08.772423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:08.774831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:08.775416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:08.777502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:08.779861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:08.780823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.053370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:09.062226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf49fcd1-9e4f-42f8-bd73-072ca29e8b67 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.331891 Aug 24 02:17:09.062911 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3939/4931] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:08 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:09.067546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:09.068698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:09.076128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.076628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.077096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.077804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.078264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.078697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.125589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4bce268-a1cd-42fe-bcc8-82be24af3a75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/ips" status: 200 len: 151 microversion: 2.20 time: 0.061618 Aug 24 02:17:09.126195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3940/4932] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 24 02:17:09 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:17:09.495363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:09.495988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:09.513432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.519031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.519791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.520835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.522804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.523252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.924305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:09.939877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8406561-6585-4c0f-a485-fc73fef718af tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1389 microversion: 2.1 time: 0.442802 Aug 24 02:17:09.953351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3941/4933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:09 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1389 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:09.953351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:09.953351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:09.979372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.980007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.980472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:09.989351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:09.989918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:09.990383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:10.211862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:10.221994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f98072a7-dadf-4dd7-b184-d2a49498535d tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1271 microversion: 2.1 time: 0.280271 Aug 24 02:17:10.222571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3942/4934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:09 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:10.254167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:10.254989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:10.274447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:10.282585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:10.283266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:10.284332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:10.284466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:10.284909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:10.354566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:10.625100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:10.634855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c13d981-aec6-4f5c-a1ec-be004205fc51 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1389 microversion: 2.1 time: 0.391803 Aug 24 02:17:10.638897 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3943/4935] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:10 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1389 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:10.661112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:10.661847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:10.674496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:10.675418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:10.676259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:10.678102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:10.678775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:10.679518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.110818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:11.119927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abd7a7b7-6f22-48fd-8877-ba0e985f0425 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.478543 Aug 24 02:17:11.129794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3944/4936] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:10 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:11.144385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:11.146644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:11.169859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.178860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.179617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.180802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.181470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.182727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.474826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:11.485106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5b6e728-4324-4708-b572-9715d4d3b2c9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1389 microversion: 2.1 time: 0.353611 Aug 24 02:17:11.497307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3945/4937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:11 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1389 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:11.512211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:11.512872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:11.524739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.525244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.525685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.526395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.526851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.527274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.678817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:11.695363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1ce3301-df7c-4fb8-8557-cf0187e5b312 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1271 microversion: 2.1 time: 0.196576 Aug 24 02:17:11.695954 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3946/4938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:11 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:11.700838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:11.704398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:11.718508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.719556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.720182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.721292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:11.725056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:11.725631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:11.783878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:17:11.996888 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f39a5858-f251-4292-a8b6-21f988c6c373 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 204 len: 0 microversion: 2.1 time: 0.295493 Aug 24 02:17:11.997829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3947/4939] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:17:11 2022] DELETE /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:17:12.007885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:12.030953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:12.049459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:12.050103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:12.050645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:12.052793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:12.053427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:12.053962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:12.824029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:12.834405 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5048ef2-1ef2-4e25-8a37-3d18fbec4b43 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1395 microversion: 2.1 time: 0.831176 Aug 24 02:17:12.835434 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3948/4940] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:12 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1395 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:12.856598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:12.857379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:12.871423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:12.872045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:12.872598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:12.873453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:12.874036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:12.874583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:12.916825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lazy-loading 'flavor' on Instance uuid fe0906a9-e31a-43da-8d82-b60ae4a9c4ae {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:17:13.278124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad195f46-1212-4fcd-9702-dda720255f63 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/action" status: 202 len: 0 microversion: 2.20 time: 0.441076 Aug 24 02:17:13.279959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3949/4941] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:17:12 2022] POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:17:13.290960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:13.291905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:13.299502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:13.300226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:13.301035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:13.303196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:13.303826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:13.305065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:13.707949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:13.721331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5abc96c-5baa-4713-82c8-b1d58b871730 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.439699 Aug 24 02:17:13.722140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3950/4942] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:13 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:13.728080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:13.730185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:13.737115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:13.737991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:13.738823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:13.740666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:13.747613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:13.748466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:14.126161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:14.149682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a2e4cd4-3aaa-49e3-aaee-06f3a3e4089b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.425783 Aug 24 02:17:14.150630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3951/4943] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:13 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:14.156079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:14.156809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:14.166662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:14.168264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:14.169269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:14.170230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:14.170918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:14.171668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:14.858787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:14.868443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:14.870219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:14.872322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e2b8b60-f2c6-4181-b55c-606967da5d1f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.720446 Aug 24 02:17:14.873594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3952/4944] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:14 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:14.881305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-unplugged", "status": "completed", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:14.890976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:14.894777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:14.898087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:14.898891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:14.921491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] Creating event network-vif-unplugged:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:17:14.934406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e35282e3-78b1-4cc0-b424-e242a61756bf req-533f5949-3f40-41e8-bb33-92c4389655eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058229 Aug 24 02:17:14.936066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3953/4945] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:14.945672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:14.947564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:14.955751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:14.956578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:14.957535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:14.959114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:14.959753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:14.960452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:15.512223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:15.526617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4a6dd43-d504-4a6f-bd30-8598c788a95e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1395 microversion: 2.1 time: 0.587940 Aug 24 02:17:15.537203 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3954/4946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:14 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1395 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:15.545625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:15.546412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:15.559699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:15.560217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:15.560666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:15.561418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:15.561885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:15.562320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:16.222298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:16.239206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4811ab22-93bf-4706-aa28-5a03964e88ff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.700664 Aug 24 02:17:16.242513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3955/4947] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:15 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:16.248252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:16.249391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:16.256113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:16.257356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:16.269240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:16.271318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:16.273853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:16.274540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:16.575061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:16.632603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:16.641144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:16.652321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-21db70d5-84f7-4776-9ad7-0ed24aeb07a2 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.408206 Aug 24 02:17:16.653289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3956/4948] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:16 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:16.684209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:16.985433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2", "tag": "8457b86f-7a42-4955-a80e-77b173a753ef"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:17.044030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.044598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.045089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:17.069622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] Creating event network-changed:8457b86f-7a42-4955-a80e-77b173a753ef for instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 on n-h2-854121-3 Aug 24 02:17:17.086052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8881598b-f452-4dc6-96d3-d14063847939 req-d515c42c-5a87-400b-bdec-afb85d5ac9b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.413650 Aug 24 02:17:17.086673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3957/4949] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:17.099970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0145bde-5e8d-4766-a000-9a23cf2cf691", "name": "network-vif-deleted", "tag": "27577230-6f3b-4974-be62-dca63d4ba1e5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:17.120121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.120609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.125662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:17.146332 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] Creating event network-vif-deleted:27577230-6f3b-4974-be62-dca63d4ba1e5 for instance c0145bde-5e8d-4766-a000-9a23cf2cf691 on n-h1-854121-3 Aug 24 02:17:17.162097 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2854709e-03d4-477c-b368-92382d16c167 req-454cead9-7339-47bb-b35e-44e034191cfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073520 Aug 24 02:17:17.163171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3958/4950] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:17.169112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:17.169842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:17.179875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.180410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.182991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:17.182991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.185197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.185197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:17.584351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:17.603063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:17.604598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:17.605844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c908d25c-b44b-4843-a2c3-925eeeffc07d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.441510 Aug 24 02:17:17.621491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3959/4951] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:17 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:17.621491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:17.621491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:17.645710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.646348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.646926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:17.650330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:17.650848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:17.652222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:18.061866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:18.071320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13fa3c11-e4da-4cee-b5e8-6b63f438bd52 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.463625 Aug 24 02:17:18.071929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3960/4952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:17 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:18.088075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:18.088697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:18.103027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:18.103825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:18.104450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:18.105416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:18.106049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:18.106658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:18.240073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:18.257291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-333c68a0-a05c-4f66-9385-498bde867fc7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1187 microversion: 2.1 time: 0.179957 Aug 24 02:17:18.257942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3961/4953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:18 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1187 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:18.274711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:18.275348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:18.296348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:18.305014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:18.305765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:18.306733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:18.307216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:18.307652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.016800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:19.031306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26236475-a6ce-4bf6-b752-e3dd4ce2bf98 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.769188 Aug 24 02:17:19.032895 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3962/4954] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:18 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:19.039388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:19.042891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:19.069126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.069951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.071948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.073309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.075292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.075941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.194941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45e8abc3-29ad-4f5b-84e1-7542315aa14c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.160419 Aug 24 02:17:19.195749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3963/4955] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:17:19 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:17:19.203658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b254b07-24ba-4066-9357-9f7bd678ed75"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:19.207480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:19.216664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.217314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.217829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.218799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.219537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.220180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.702138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61105610-7042-4641-9ae0-0545dd5a4162 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502795 Aug 24 02:17:19.708822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3964/4956] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:17:19 2022] POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:19.759746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:19.760851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:19.768445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.769437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.770042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:19.771537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:19.772203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:19.772814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:20.978045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:20.989940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:20.993649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:20.999270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70b67de3-c92b-4388-b068-60f303be923a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 1.286596 Aug 24 02:17:21.000175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3965/4957] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:19 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:21.022720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:21.052604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:21.099435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:21.104674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:21.110251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:21.112603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:21.114456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:21.117458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:21.854204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:21.866847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-625c83eb-e0c8-47cf-be30-ef7f07e40efc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1671 microversion: 2.1 time: 0.862768 Aug 24 02:17:21.877356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3966/4958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:21 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1671 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:21.885550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:21.886189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:21.902568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:21.903075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:21.903535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:21.906933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:21.907420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:21.907869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:22.143027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:22.156061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fa55dea-cfa5-4ac6-bd7a-08cf0f309822 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 200 len: 1187 microversion: 2.1 time: 0.285645 Aug 24 02:17:22.156680 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3967/4959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:21 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 1187 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:22.165526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:22.168878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:22.186367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:22.186889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:22.187344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:22.190452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:22.192059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:22.193239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:22.723013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:22.737068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aebd004b-9c50-44ce-9733-c9eda092c596 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.577893 Aug 24 02:17:22.737929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3968/4960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:22 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:22.754651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:22.755278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:22.775487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:22.775986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:22.776449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:22.777188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:22.777642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:22.778069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:23.426124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:23.439898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:23.444053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:23.445726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c177bbd-e464-4963-9f0d-62440945a3d1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.706662 Aug 24 02:17:23.446323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3969/4961] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:22 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:23.460100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:23.460733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:23.482958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:23.483460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:23.483899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:23.489722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:23.490273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:23.490711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:23.899116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:23.911007 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94d65bc5-a44f-4fed-b836-5d095b1909d4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.463559 Aug 24 02:17:23.911846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3970/4962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:23 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:23.918186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:23.918987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:23.943906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:23.943906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:23.945480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:23.947254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:23.956051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:23.958378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:23.996221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 HTTP/1.1 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c0145bde-5e8d-4766-a000-9a23cf2cf691'} Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:23.999282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:17:24.004209 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0844284-2e94-4752-abc3-f8d91e680c81 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 404 len: 111 microversion: 2.1 time: 0.089117 Aug 24 02:17:24.008233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3971/4963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:23 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:17:24.017529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:24.018216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:24.033874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.034383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.034826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:24.048033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.048033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.048033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:24.409441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:24.426415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eefad3a2-27ff-45aa-9306-c58d19ddbf8f tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.417320 Aug 24 02:17:24.428670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3972/4964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:24 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:24.455946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:24.464755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:24.479490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.482002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.482665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:24.493377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.494253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.495174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:24.534380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:24.591759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-761af20b-cbcc-4a86-ad7d-38d9d46fbd63 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 200 len: 324 microversion: 2.1 time: 0.161283 Aug 24 02:17:24.592698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3973/4965] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:17:24 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:24.605112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:24.606311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:24.625118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.626006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.628437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:24.629596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:24.631224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:24.634459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:25.034318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:25.055785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:25.059073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:25.063226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7afcc16-fc1c-40a5-9a82-8842c6a781f0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1743 microversion: 2.20 time: 0.468936 Aug 24 02:17:25.063826 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3974/4966] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:24 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1743 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:25.075692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:25.076308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:25.094740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:25.095609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:25.096312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:25.097317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:25.100205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:25.100971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:25.601415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:25.613339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ab3b6fa-0111-46f4-a89d-20594bcf3dcc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.541390 Aug 24 02:17:25.629274 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3975/4967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:25 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:25.635769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:25.635769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:25.646820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:25.653152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:25.654119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:25.655915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:25.659010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:25.659833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:26.011744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:26.020813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a17fed85-2b04-4c44-923c-d830f025efd3 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.402982 Aug 24 02:17:26.021413 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3976/4968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:25 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:26.031418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:26.039327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:26.057830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:26.058370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:26.063104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:26.064214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:26.064910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:26.065758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:26.704147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:26.718469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cdc02bf-bbeb-4fa3-94ea-558ff2d41d85 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.692853 Aug 24 02:17:26.731778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3977/4969] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:26 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:26.749143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:26.750056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:26.767999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:26.772236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:26.774405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:26.775657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:26.776197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:26.776628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.030598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:27.046261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:27.052392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:27.054903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddb2a175-2acc-453d-aaaa-d12e694a1e27 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1743 microversion: 2.20 time: 0.332690 Aug 24 02:17:27.055872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3978/4970] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:26 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1743 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:27.062389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2", "name": "network-vif-plugged", "status": "completed", "tag": "8457b86f-7a42-4955-a80e-77b173a753ef"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:27.092314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:27.094900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:27.095352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.117310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] Creating event network-vif-plugged:8457b86f-7a42-4955-a80e-77b173a753ef for instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 on n-h2-854121-3 Aug 24 02:17:27.124137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-be8ffb1e-51ef-4ad5-9616-5f87d7b32ffe req-f27db452-456f-4584-a404-598be377e123 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065913 Aug 24 02:17:27.124375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3979/4971] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:27.135478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:27.136192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:27.155859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:27.156558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:27.157048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.159973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:27.160473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:27.163023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.693716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:27.706944 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c42d5e82-ef10-4746-a3b8-133f0dbac207 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.581274 Aug 24 02:17:27.714076 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3980/4972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:27 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:27.726510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:27.727473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:27.744483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:27.745743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:27.750110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.752272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:27.752658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:27.753130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:27.967059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:27.976454 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9344c57-3e31-467b-a6ad-4c00134f8aed tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1313 microversion: 2.1 time: 0.260953 Aug 24 02:17:27.997796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3981/4973] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:27 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:28.005760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:28.007373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:28.021055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:28.024040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:28.029613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:28.030490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:28.031043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:28.031912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:28.317929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:28.326992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37b9077b-59cf-4a8b-8790-c59fcca86dd5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.327791 Aug 24 02:17:28.331427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3982/4974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:27 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:28.345281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:28.345995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:28.359709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:28.360861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:28.362882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:28.363778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:28.365221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:28.366932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:29.302944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:29.319521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:29.323607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:29.325001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0b35fde-c815-4003-ad20-159f8103dd40 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1743 microversion: 2.20 time: 0.992438 Aug 24 02:17:29.328188 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3983/4975] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:28 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1743 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:29.333488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-483297028", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "62fe4463-9689-4fd8-807d-9686124a81d4"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:29.435741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] validate_networks() for [('62fe4463-9689-4fd8-807d-9686124a81d4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:17:30.436975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:17:30.437614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:17:30.437887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:17:30.438519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:17:30.439141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:17:30.462505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:30.464128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:30.464801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:30.465748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:30.466422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:30.467577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:30.519772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:17:30.539697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:17:30.560829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:17:30.563930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:17:30.666539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0b9f597-1bdb-4909-a826-42f8a316f597 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337110 Aug 24 02:17:30.681315 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3984/4976] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:17:30.728400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:30.733468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:30.757085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:30.763117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:30.763795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:30.764698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:30.768424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:30.773552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:31.555043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:31.566300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c7ee0bb-48ec-4cb7-9ca7-abe4c82adf82 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1462 microversion: 2.1 time: 0.883401 Aug 24 02:17:31.568362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3985/4977] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:30 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1462 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:31.574199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:31.575073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:31.582383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:31.583116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:31.583694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:31.584848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:31.585807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:31.586863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:32.023978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:32.042165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:32.043738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:32.053073 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b38977c0-5593-4636-b8ee-01ce9cd0d8c1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.483267 Aug 24 02:17:32.074576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3986/4978] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:31 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:32.084760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:32.085366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:32.102987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:32.103708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:32.107787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:32.108738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:32.109432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:32.110014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:32.349391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:32.371820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-898fd11d-5973-4ea1-b9a0-acc5618791d9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1218 microversion: 2.1 time: 0.282998 Aug 24 02:17:32.372854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3987/4979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:32 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1218 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:32.379354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0c69cc1-61a3-4e09-9b32-55d4100cf705", "device": "/dev/sdb"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:32.409131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:32.426541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:32.427328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:32.428011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:32.429008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:32.429655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:32.430266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.050854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7df61bb1-a3d6-4d9d-b316-72458facf1ee tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "POST /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676695 Aug 24 02:17:33.052560 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3988/4980] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:17:32 2022] POST /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:33.075061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "name": "network-vif-plugged", "status": "completed", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:33.127260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:33.135031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:33.137287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.162778 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] Creating event network-vif-plugged:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h2-854121-3 Aug 24 02:17:33.176120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-056c01ec-e09e-48fc-8d64-c24bf73172bf req-c543ffb4-3c77-4e11-8e4b-f9919ebf3d46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121832 Aug 24 02:17:33.180662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3989/4981] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:33.201851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:33.205246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:33.231478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:33.232303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:33.233529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.237530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:33.238131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:33.243556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.628848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:33.637029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:33.645099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:33.657647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:33.664230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11739aa3-1a6a-4ce1-a416-697200f72a01 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.480266 Aug 24 02:17:33.670346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3990/4982] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:33 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:33.683604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:33.686991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:33.703545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:33.705960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:33.706645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.708608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:33.711563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:33.713893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:33.893302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:33.903190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-651b8e7c-d8c3-4258-81c7-3feeb2a5df21 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1272 microversion: 2.1 time: 0.231324 Aug 24 02:17:33.909773 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3991/4983] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:33 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:34.691974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:34.693297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:34.702449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:34.711328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:34.712044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:34.712978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:34.713825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:34.714756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:35.398432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:35.414230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:35.418813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:35.423295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00017216-4281-46ca-afc7-e3ceae7ca446 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.735030 Aug 24 02:17:35.427388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3992/4984] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:34 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:35.436569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:35.453670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:35.475098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:35.475890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:35.476511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:35.477628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:35.478287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:35.479075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:35.610978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:35.625590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd4b38a0-6a42-4255-85a4-f11a06219e9e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1272 microversion: 2.1 time: 0.196398 Aug 24 02:17:35.641648 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3993/4985] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:35 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:36.046000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:36.046604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:36.056351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.065053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.065664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:36.066447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.066968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.067414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:36.130379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 HTTP/1.1 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c0145bde-5e8d-4766-a000-9a23cf2cf691'} Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:17:36.137937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.141260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.147335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:17:36.152249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-841c3633-4b88-41cc-bcb5-3838c26d80de tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 404 len: 111 microversion: 2.1 time: 0.110067 Aug 24 02:17:36.156608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3994/4986] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:17:36 2022] DELETE /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:17:36.179329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:36.185363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: c0145bde-5e8d-4766-a000-9a23cf2cf691] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:36.217297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.218215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.218690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:36.224454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.226630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.227100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:36.310478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 HTTP/1.1 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c0145bde-5e8d-4766-a000-9a23cf2cf691'} Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:17:36.320366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. Aug 24 02:17:36.324275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:17:36.325724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance c0145bde-5e8d-4766-a000-9a23cf2cf691 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:17:36.330204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-993638a6-53dc-4747-9061-005860793b5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691" status: 404 len: 111 microversion: 2.1 time: 0.171692 Aug 24 02:17:36.337971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3995/4987] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:36 2022] GET /compute/v2.1/servers/c0145bde-5e8d-4766-a000-9a23cf2cf691 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:17:36.456373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:36.457209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:36.471477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:36.476783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.477311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.477868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:36.485813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:36.487084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:36.488291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:37.112816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:37.127422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:37.133367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:37.146340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56480e33-7b01-4c66-aa03-69cac1ed50b9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.694594 Aug 24 02:17:37.153395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3996/4988] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:36 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:37.158452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:37.169636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:37.198762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:37.199642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:37.200321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:37.201283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:37.201953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:37.202593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:37.702058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:37.712082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32a3d038-af15-4ad0-92f7-b8a0ab9389f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.557257 Aug 24 02:17:37.729105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3997/4989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:37 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:38.183900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:38.184687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:38.217488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:38.218249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:38.218814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:38.223826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:38.226179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:38.226767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:39.067073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:39.088135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:39.089823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:39.091035 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00193d72-3ff0-4f7b-9f00-48b944f5b831 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.914453 Aug 24 02:17:39.107917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3998/4990] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:38 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:39.107917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:39.108382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:39.134701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:39.135211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:39.135659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:39.136387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:39.143597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:39.144154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:40.367445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:40.383523 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f19ebe4-53ca-44ec-acaa-fb81faaa79b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 1.275568 Aug 24 02:17:40.384278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 3999/4991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:39 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:40.407113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:40.411269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:40.438724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:40.443148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:40.445173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:40.447692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:40.452663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:40.455658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:40.532276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:40.554272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:41.430400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:41.451624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:41.462101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:41.463839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33b0de4b-5c93-4b6b-b699-cc0aaa561e71 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 1.077857 Aug 24 02:17:41.464952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4000/4992] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:40 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:41.472185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:41.480090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:41.497230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:41.498132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:41.498808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:41.499771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:41.500441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:41.501141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:41.574223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'flavor' on Instance uuid cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:17:41.850807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8141eb25-e3da-40ba-9c9d-ffdceb7361f7 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/action" status: 200 len: 32 microversion: 2.1 time: 0.380685 Aug 24 02:17:41.851696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4001/4993] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:17:41 2022] POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:17:41.865209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:41.877986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:41.913662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:41.914373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:41.919126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:41.920239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:41.921037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:41.922632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:42.876753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:42.897115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bf8e06f-4457-4c7e-8b81-446b270b2f2a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 1.028780 Aug 24 02:17:42.898490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4002/4994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:41 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:42.918792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:42.919794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:42.937578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:42.944512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:42.949253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:42.950815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:42.951520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:42.952314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:43.751612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:43.767566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c590c1f-73af-4e88-a00b-96ccf1e31056 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.865263 Aug 24 02:17:43.770016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4003/4995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:42 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:43.779019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d097c48-b1c3-495b-ae89-bdca18146f17", "tag": "b39944f9-ef70-496c-bfa5-4f946117b8da"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:43.805088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:43.805975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:43.806569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:43.842656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] Creating event network-changed:b39944f9-ef70-496c-bfa5-4f946117b8da for instance 4d097c48-b1c3-495b-ae89-bdca18146f17 on n-h1-854121-3 Aug 24 02:17:43.857470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d9f53a95-f76a-48f6-9b36-49ae6a80a36c req-22800643-32fd-41b4-9759-bb6b3b3f7d94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085170 Aug 24 02:17:43.858747 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4004/4996] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:43.870806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:43.875374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:43.890190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:43.891603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:43.892411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:43.896293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:43.896943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:43.899063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:44.547318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:44.584211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:44.595028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:44.600520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-577f7225-b7a7-433b-884a-cced5953ccb3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.740428 Aug 24 02:17:44.618378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4005/4997] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:43 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:44.639533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:44.639533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:44.663994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:44.664592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:44.665818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:44.670001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:44.670574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:44.672252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:45.014834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:45.027829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d1fd656-6aab-4853-8786-3df8ffc35af8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.407866 Aug 24 02:17:45.028984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4006/4998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:44 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:45.039491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:45.042429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:45.057250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:45.057979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:45.058605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:45.059474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:45.064995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:45.065933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:45.111525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:45.526689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:45.541787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cdd6101-5126-4dd3-aad8-4b6162b2d1f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.511493 Aug 24 02:17:45.543622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4007/4999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:45 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:45.632525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:45.633500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:45.657222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:45.657927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:45.658656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:45.659609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:45.663257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:45.663935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:46.091353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:46.108961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:46.119925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:46.122219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-293597fe-3ba6-4a4d-931b-981a46590a30 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.493731 Aug 24 02:17:46.124147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4008/5000] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:45 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:17:46.145478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:46.149830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:46.159683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:46.161114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:46.161766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:46.162890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:46.163604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:46.164238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:46.617644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:46.642500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96c6260d-86a1-44e6-b03d-7e7daaee9566 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.515744 Aug 24 02:17:46.658907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4009/5001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:46 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:46.684278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:46.686185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:46.702909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:46.707513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:46.709200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:46.712153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:46.712965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:46.715303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:47.243850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:47.257546 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc140271-c2bc-4388-a6c4-c6b16901eed2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.596309 Aug 24 02:17:47.260558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4010/5002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:46 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:47.277706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:47.280675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:47.312369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:47.312909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:47.319979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:47.321235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:47.329004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:47.330773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:49.407345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:49.422675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:49.432359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:49.440471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9acd3319-a41a-44d1-ab23-77357239c893 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 2.178608 Aug 24 02:17:49.445990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4011/5003] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:47 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:49.460227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:49.480362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:49.487845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:49.498323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:49.499918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:49.503912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:49.506086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:49.507410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:50.058955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:50.075749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bac81ad-e9a7-4148-8a9c-262309fe2c8d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.627322 Aug 24 02:17:50.076861 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4012/5004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:49 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:50.085315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:50.086175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:50.112745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:50.114494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:50.115255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:50.116466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:50.118805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:50.119425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:50.419721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:50.435769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6e26e1e-ffb7-4035-8556-c37e35441b65 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.354277 Aug 24 02:17:50.441946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4013/5005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:50 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:50.471813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:50.472996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:50.498304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:50.503725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:50.506136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:50.508361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:50.509518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:50.513080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:50.911896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:50.940295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:50.948022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:50.950008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8f01c33-dcb5-4b05-aa25-aabaa19fc86a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.483751 Aug 24 02:17:50.950880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4014/5006] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:50 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:17:51.114590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:51.115529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:51.131264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:51.135880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:51.136779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:51.140628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:51.141659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:51.146278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:51.482736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:51.510024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92e7025e-b428-46cc-8126-ad4f40fc6380 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.402617 Aug 24 02:17:51.512495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4015/5007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:51 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:51.524004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:51.525689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:51.544422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:51.545966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:51.547266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:51.548086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:51.548618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:51.555979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:52.528402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:52.542536 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e77e9b5d-7068-4db3-9697-6ccdb51b253c tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 1.026570 Aug 24 02:17:52.557427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4016/5008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:51 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:52.565233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:52.572407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:52.583239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:52.586652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:52.587501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:52.588452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:52.589138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:52.591969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:52.963563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:52.975423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:52.977595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:52.979240 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20091497-4288-486b-96cc-bc19975aeef4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.420700 Aug 24 02:17:52.980425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4017/5009] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:52 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:52.985565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:52.986504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:52.994192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:52.995164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:52.995849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:52.996916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:52.997770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:52.998423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:53.398453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:53.421824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f619103-bd1b-4eea-a117-231ac2eada84 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.439990 Aug 24 02:17:53.429896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4018/5010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:52 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:53.568473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:53.569205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:53.587143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:53.589339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:53.591878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:53.592647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:53.602100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:53.602581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:54.090430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:54.101436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aaa4145a-dbf9-4022-b7fd-47694ad6b7da tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.536852 Aug 24 02:17:54.102050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4019/5011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:53 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:54.147411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:54.150098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:54.184413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:54.197317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:54.197941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:54.200330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:54.202997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:54.203667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:54.615762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:54.626718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:54.633903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:54.639909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44520faf-e38c-424b-8acd-fcb0187e28a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.523783 Aug 24 02:17:54.640622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4020/5012] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:54 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:54.649802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:54.650429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:54.677304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:54.677858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:54.678302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:54.681325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:54.681804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:54.682241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:55.130941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:55.146205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e60b4b9-8f88-4eaf-ab11-a45304f897be tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.499485 Aug 24 02:17:55.158282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4021/5013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:54 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:55.183181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d097c48-b1c3-495b-ae89-bdca18146f17", "name": "network-vif-plugged", "status": "completed", "tag": "b39944f9-ef70-496c-bfa5-4f946117b8da"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:17:55.219462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:55.219885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:55.220322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:55.260521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] Creating event network-vif-plugged:b39944f9-ef70-496c-bfa5-4f946117b8da for instance 4d097c48-b1c3-495b-ae89-bdca18146f17 on n-h1-854121-3 Aug 24 02:17:55.267088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4ef4dbbe-7536-45a4-a515-bea0523bb37a req-f4817a57-c4c3-4178-a2cf-93fe906bf5f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107196 Aug 24 02:17:55.269732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4022/5014] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:17:55.276461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:55.277464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:55.289558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:55.291355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:55.292386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:55.293636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:55.294353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:55.294953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:55.501868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:55.524051 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c62626f1-7269-4b9e-a269-8c687cec3d31 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.252250 Aug 24 02:17:55.525328 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4023/5015] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:55 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:55.668510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:55.669217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:55.696538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:55.713170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:55.714106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:55.714873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:55.715350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:55.718360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:56.184387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:56.194304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:17:56.207367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:56.211955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:56.217186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcc8e638-3953-41f7-acc1-daac9a69d55e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.552891 Aug 24 02:17:56.223004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4024/5016] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:55 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:56.236052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:56.236808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:56.287467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:56.290989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:56.293988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:56.298929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:56.299478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:56.299932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:56.739009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:56.749054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6da6f73-2f9e-4ebe-9951-71d27f43a902 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.524963 Aug 24 02:17:56.757719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4025/5017] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:56 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:56.763234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:56.774350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:56.781311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:56.781814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:56.782263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:56.782979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:56.783442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:56.783877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:57.298902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:57.317845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0f469d2-afb4-4c25-8952-aa0c04311ffe tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.558816 Aug 24 02:17:57.319151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4026/5018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:56 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:57.327795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:57.328585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:57.350430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:57.351744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:57.352259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:57.353579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:57.354053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:57.354638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:57.938194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:57.957758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:57.959296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:57.976400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6bb9e85e-2794-4f1a-bee6-ffdf20340094 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.651970 Aug 24 02:17:57.977121 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4027/5019] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:57 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:58.048141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:58.056966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:58.082119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:58.082743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:58.083368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:58.084244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:58.084853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:58.085386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:58.613822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:58.631711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afb53cd1-f460-4f96-a198-03a6e8d35991 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1314 microversion: 2.1 time: 0.648906 Aug 24 02:17:58.636397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4028/5020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:57 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:58.653858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:58.660981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:58.671778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:58.672648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:58.673357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:58.674333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:58.675056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:58.676240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:59.110627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:59.127112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a4801a8-2bea-4424-aff9-74acf457b6f0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1735 microversion: 2.1 time: 0.482898 Aug 24 02:17:59.147594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4029/5021] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:58 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1735 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:17:59.162106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:59.176487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:59.201103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:59.202262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:59.202974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:59.203970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:59.204666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:59.205620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:59.525479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:59.534840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:59.536379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:17:59.549726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5356f59-a52c-4cce-99ee-b79d20fe8c98 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 0.393743 Aug 24 02:17:59.568601 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4030/5022] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:17:59 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:17:59.663330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:17:59.664113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:17:59.690829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:59.691395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:59.697286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:17:59.698060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:17:59.698537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:17:59.698980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:00.183205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:00.197244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6677de29-5f71-4e09-b23d-4a2680f6c4ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1500 microversion: 2.1 time: 0.538945 Aug 24 02:18:00.204361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4031/5023] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:17:59 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1500 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:00.220964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:00.223710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:00.253451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:00.254618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:00.254618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:00.255172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:00.255644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:00.268709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:00.797805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:00.817711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11054d48-6715-4acb-90cc-183096c31005 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1715 microversion: 2.1 time: 0.611502 Aug 24 02:18:00.818466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4032/5024] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:00 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1715 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:00.825725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:00.838616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:00.840569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:00.841430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:00.936401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:18:01.029043 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1f9ed97-8986-4b98-aa93-8d394dbe200d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17/action" status: 202 len: 0 microversion: 2.1 time: 0.209237 Aug 24 02:18:01.029943 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4033/5025] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:00 2022] POST /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:18:01.038758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:01.039718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:01.052524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:01.053282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:01.053909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:01.054795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:01.055402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:01.055979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:02.158714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:02.179376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:02.187886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:02.191776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15f8d261-efb2-4a06-9c82-12ea220e22c7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1738 microversion: 2.20 time: 1.154992 Aug 24 02:18:02.198006 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4034/5026] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:01 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1738 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:02.841609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:02.842853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:02.860533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:02.862321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:02.865189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:02.868064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:02.869551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:02.870580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:03.363166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:03.372893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-409310f2-afbd-4d55-a701-850d2eac7ed1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 1.172776 Aug 24 02:18:03.388502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4035/5027] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:02 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:03.398803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:03.402506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:03.412849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:03.419860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:03.421863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:03.423381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:03.424013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:03.424612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:03.573978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Cannot 'detach_volume' instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed while it is in vm_state rescued Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments/2b254b07-24ba-4066-9357-9f7bd678ed75 HTTP/1.1 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'detach_volume' instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed while it is in vm_state rescued Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed', 'id': '2b254b07-24ba-4066-9357-9f7bd678ed75'} Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed while it is in vm_state rescued Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:18:03.575621 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed while it is in vm_state rescued Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:18:03.579163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 409 to user: Cannot 'detach_volume' instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed while it is in vm_state rescued {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:18:03.579541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05752362-ffa7-476d-a085-931601de8aef tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments/2b254b07-24ba-4066-9357-9f7bd678ed75" status: 409 len: 152 microversion: 2.1 time: 0.184824 Aug 24 02:18:03.582827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4036/5028] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:18:03 2022] DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments/2b254b07-24ba-4066-9357-9f7bd678ed75 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:18:03.591786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:03.592251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:03.605532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:03.606289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:03.606902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:03.607786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:03.608398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:03.609014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:03.954084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:03.973276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:03.986423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:03.991335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35280c1e-8414-43e3-bcea-b2a624e93b5b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1720 microversion: 2.20 time: 0.407312 Aug 24 02:18:03.999157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4037/5029] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:03 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1720 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:04.011242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:04.012285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:04.029407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.030171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.030814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:04.031722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.032361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.032979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:04.194518 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-477a3c94-c08f-480d-8440-257a06748716 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/action" status: 202 len: 0 microversion: 2.1 time: 0.193292 Aug 24 02:18:04.198037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4038/5030] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:03 2022] POST /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:18:04.222201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:04.240133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:04.251501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.254897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.257496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:04.260084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.266809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.268465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:04.302863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:04.791312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:04.800137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69eb55c0-68f8-4160-a2f6-7fc02c4bf5ff tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1723 microversion: 2.1 time: 0.597150 Aug 24 02:18:04.803830 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4039/5031] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:04 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:04.812525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:04.813172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:04.826565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.833151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.833705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:04.834614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:04.835078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:04.835532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:05.217793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:05.234012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d4e4ee4-2973-4331-a402-591d13f689e9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.422459 Aug 24 02:18:05.245088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4040/5032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:04 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:05.250097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:05.250719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:05.266515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:05.267019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:05.267469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:05.268186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:05.268648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:05.269141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:06.127679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:06.166069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:06.168709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:06.170360 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4af30a4-9acc-48e4-9751-a47db4b513ae tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1720 microversion: 2.20 time: 0.924162 Aug 24 02:18:06.193902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4041/5033] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:05 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1720 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:06.200372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:06.201328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:06.217598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:06.218387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:06.219055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:06.220009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:06.220690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:06.221351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:06.650214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:06.662976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5344245c-face-4aff-a4b1-13d16d18fa53 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1723 microversion: 2.1 time: 0.465620 Aug 24 02:18:06.664037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4042/5034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:06 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:06.673626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:06.677558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:06.689444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:06.693349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:06.695744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:06.696418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:06.701314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:06.702298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:06.702843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:07.161383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:07.190163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7959dc6-ee01-4f84-ac01-8b60065cb3b4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.520875 Aug 24 02:18:07.191952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4043/5035] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:06 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:07.210120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:07.210652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:07.247451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:07.254911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:07.255612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:07.256702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:07.257350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:07.257773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:07.718019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:07.731017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:07.735613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:07.741076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f747696-cd3a-4eb5-b90d-cfdc1503eca1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1720 microversion: 2.20 time: 0.537164 Aug 24 02:18:07.742768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4044/5036] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:07 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1720 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:07.751327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:07.752344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:07.772117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:07.773030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:07.775200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:07.775200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:07.775430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:07.777599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:08.291405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:08.315351 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e60b080d-5bf4-4327-97b5-aaf7007b45ca tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1723 microversion: 2.1 time: 0.569108 Aug 24 02:18:08.333794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4045/5037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:07 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1723 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:08.343768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "name": "network-vif-unplugged", "status": "completed", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:08.358380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:08.359433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:08.361284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:08.386940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] Creating event network-vif-unplugged:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h2-854121-3 Aug 24 02:18:08.455714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7f3c0fd2-2ef5-42e3-a142-0f03cb279fdc req-d263ee11-5823-4503-9eae-04045e6a3d1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119557 Aug 24 02:18:08.462583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4046/5038] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:08.497975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:08.499412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:08.513501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:08.515820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:08.517965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:08.519495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:08.520007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:08.520482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:09.029933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:09.043738 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5cec60f-eb7d-4adb-87e6-92a67bb6eda5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.578566 Aug 24 02:18:09.044339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4047/5039] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:08 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:09.048972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:09.049588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:09.063629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:09.064167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:09.064874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:09.065413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:09.066445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:09.066880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:09.525273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:09.533914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:09.535982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:09.550908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7706f79b-5c2e-45e2-88c2-167aef04cde8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1723 microversion: 2.20 time: 0.504825 Aug 24 02:18:09.552031 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4048/5040] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:09 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1723 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:09.556851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:09.557648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:09.569959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:09.571942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:09.572551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:09.574416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:09.577340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:09.577957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:10.014576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:10.023960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b800b474-eb60-4d2e-98a4-e3a64980af48 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1723 microversion: 2.1 time: 0.470688 Aug 24 02:18:10.032504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4049/5041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:09 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:10.052797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ece8679a-e5ee-4e41-a674-4153bc5b47a0"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:10.055596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:10.064647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:10.066144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:10.067292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:10.081965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:10.082887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:10.084548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:10.872217 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7190300-1da6-46f1-b778-bf0e246c6749 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.821422 Aug 24 02:18:10.885124 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4050/5042] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 24 02:18:10 2022] POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 188 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:18:10.898487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:10.899647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:10.948228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:10.949463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:10.950571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:10.955336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:10.957772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:10.963995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:11.617596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:11.625490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdb02a22-832f-414c-a0f3-b4dfc5c6abef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.739207 Aug 24 02:18:11.629968 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4051/5043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:10 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:11.637506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:11.638232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:11.661601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:11.662040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:11.662497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:11.663227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:11.663693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:11.664130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:12.785193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:12.805028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ce86b1a-5b72-401b-aef8-5dc74068d552 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1729 microversion: 2.1 time: 1.170276 Aug 24 02:18:12.805028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4052/5044] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:11 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1729 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:12.807870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:12.821630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:12.828783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:12.829568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:12.830246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:12.831194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:12.831478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:12.831841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:13.138134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128567) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 02:18:13.256552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:13.322158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6514cfb1-ea4c-4588-9708-53518b4acda5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/action" status: 202 len: 0 microversion: 2.20 time: 0.517943 Aug 24 02:18:13.325269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4053/5045] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:18:12 2022] POST /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:18:13.338522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:13.339167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:13.354502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:13.355077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:13.355532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:13.356286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:13.356956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:13.359490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:13.821804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:13.838292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-929f0157-28f4-4223-9fac-f4a922cd5f9c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.511879 Aug 24 02:18:13.838899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4054/5046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:13 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:13.843691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:13.844190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:13.859281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:13.859784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:13.860229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:13.861001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:13.861470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:13.861913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:14.161140 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-837786b3-9d33-4ea3-ae05-972bdbe6c64f tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.320829 Aug 24 02:18:14.161755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4055/5047] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:18:13 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:14.167108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:14.167917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:14.183164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:14.183670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:14.184125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:14.186176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:14.187885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:14.189237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:15.037668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:15.053741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:15.058163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:15.082494 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e97c5fe6-9c31-4454-a9df-36728d5e967b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1749 microversion: 2.20 time: 0.919474 Aug 24 02:18:15.084229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4056/5048] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:14 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1749 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:15.094795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:15.095660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:15.113154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:15.113966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:15.114713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:15.115607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:15.116804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:15.118201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:16.512749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:16.523386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c40cb78b-0949-4884-9755-9f77de6fc4e0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 1.437740 Aug 24 02:18:16.525496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4057/5049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:15 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:16.541238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:16.542126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:16.554718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:16.555830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:16.556583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:16.557533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:16.558345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:16.566044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:17.197218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:17.227702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:17.232487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:17.234121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f43a8405-58f5-4d85-bc3c-07729fca4be1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 0.706358 Aug 24 02:18:17.237972 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4058/5050] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:16 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:17.551179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:17.551974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:17.565024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:17.571309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:17.583707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:17.585054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:17.585750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:17.588044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:18.163905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:18.172027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f1a7b30-baf3-4062-8577-9e887b7f2ab6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.625463 Aug 24 02:18:18.185133 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4059/5051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:17 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:18.270145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:18.270943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:18.283293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:18.284571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:18.286481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:18.287411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:18.288611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:18.290757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:18.582234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:18.603451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:18.605290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:18.606696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02fff066-c066-4983-a8eb-de167a6cf8c6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 0.341063 Aug 24 02:18:18.621131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4060/5052] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:18 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:18:18.968359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:18.986147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:18.989549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:18.990228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:19.030901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] Creating event network-changed:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:18:19.052858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-facd9e9d-2d07-404a-9663-e7da8a3e3f05 req-865ff8d4-1717-4ef8-a929-b9c15bf77236 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088047 Aug 24 02:18:19.061118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4061/5053] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:19.198914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:19.199118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:19.213715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:19.214415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:19.215064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:19.218383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:19.219097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:19.223553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:19.789932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:19.798215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a93f6728-b7fe-42fd-ab98-806b0b3d27ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.605010 Aug 24 02:18:19.815439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4062/5054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:19 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:19.823582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:19.824262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:19.843505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:19.844293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:19.844982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:19.845892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:19.847107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:19.847727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:20.141723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:20.156526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:20.162482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:20.165292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7538346d-7371-40b2-ad4e-418f6fa60484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 0.348236 Aug 24 02:18:20.166190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4063/5055] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:19 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:20.820866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:20.826756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:20.846112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:20.847238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:20.851325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:20.852209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:20.853072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:20.855334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:21.137470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:21.152182 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f24dd59-507b-4ee8-af3b-842035fcfa3a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.336813 Aug 24 02:18:21.153596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4064/5056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:20 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:18:21.193707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:21.194748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:21.213121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:21.213970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:21.214877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:21.215810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:21.218529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:21.219227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:21.507903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:21.525632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:21.531632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:21.536149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-feface00-2e20-4525-846f-e08463226df8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 0.347137 Aug 24 02:18:21.552882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4065/5057] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:21 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:18:21.559677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:21.585898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:21.587355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:21.588033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:21.627656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] Creating event network-changed:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:18:21.643059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-69f1e8cd-6675-4806-a728-08d1cfca955e req-a329b25f-a1a3-43bf-ac45-1d937f9ee4b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097390 Aug 24 02:18:21.649413 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4066/5058] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:22.176415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:22.177166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:22.201761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:22.202354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:22.202816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:22.206684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:22.208071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:22.208886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:22.750015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:22.762780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-beb56558-04fe-46b6-8090-8ec9c685b4b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.591098 Aug 24 02:18:22.777621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4067/5059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:22 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:22.793031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:22.794124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:22.804504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:22.806367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:22.810980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:22.811988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:22.812710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:22.813388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:24.371155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:24.386822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:24.394958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:24.407288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f09a98e-3beb-48cf-8dfb-c56f585baed0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 1.625611 Aug 24 02:18:24.409363 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4068/5060] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:22 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:24.425971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:24.430368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:24.441548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:24.446221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:24.446952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:24.447899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:24.450714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:24.451362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:25.141793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:25.154204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bd0c71d-7174-46d3-b8f7-633bb695b1e1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1510 microversion: 2.1 time: 0.743315 Aug 24 02:18:25.159127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4069/5061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:24 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1510 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:25.165179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1914176890", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "382cb8d5-10f5-470f-95be-dcb49711949c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:25.398207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:18:27.608621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:18:27.609375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:18:27.610014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:18:27.610502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:18:27.610980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:18:27.623804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:27.625394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:27.625816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:27.626580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:27.627082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:27.627615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:27.656883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:18:27.664329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:18:27.737138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:18:27.740227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='382cb8d5-10f5-470f-95be-dcb49711949c',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:18:27.931905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-877f14f3-1ea7-49ed-98af-7cb0b4fb4a66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.770299 Aug 24 02:18:27.933527 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4070/5062] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:18:27.942240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:27.943164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:27.952603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:27.953585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:27.955435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:27.956468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:27.957462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:27.958147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:28.554410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:28.567898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:28.577023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:28.578289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85f6ab7f-bd8f-4603-bd07-7b4f20f01329 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1751 microversion: 2.20 time: 0.643441 Aug 24 02:18:28.579341 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4071/5063] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:27 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1751 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:28.586223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:28.587153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:28.594378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:28.595097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:28.595693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:28.597176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:28.597788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:28.598370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:28.603284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:28.836073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:28.844435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d89ab727-ce28-4f69-8a99-1e9d59654f4d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1487 microversion: 2.1 time: 0.262422 Aug 24 02:18:28.847837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4072/5064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:28 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1487 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:28.858135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:28.859820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:28.873462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:28.876833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:28.878029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:28.878857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:28.882129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:28.882788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:28.980214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:28.991820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57f9afb6-ba3c-4d15-bff0-2c5520abc089 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1113 microversion: 2.1 time: 0.139952 Aug 24 02:18:29.004043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4073/5065] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:28 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1113 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:29.013014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:29.016961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:29.042000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.042924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.043572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.044851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.045325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.045868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.122109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce727a09-d28c-44fe-ab82-fb536bdc9966 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 200 len: 149 microversion: 2.1 time: 0.116685 Aug 24 02:18:29.123240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4074/5066] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:29 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 149 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:29.133801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:29.134738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:29.148917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.152417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.153503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.155686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.156624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.157093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.462616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:29.472388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a48e810-e9b4-4c86-9120-163f4b6159e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.341798 Aug 24 02:18:29.485869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4075/5067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:29 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:29.501493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:29.503553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:29.511247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.511957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.512545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.513435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.514046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.514621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.692066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:29.699958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-507209d9-ee05-4d3d-87b2-7c7815925abd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.206295 Aug 24 02:18:29.718309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4076/5068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:29 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:29.724619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:29.725280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:29.733216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.739133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.739859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.740882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:29.741550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:29.742288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:29.973125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:29.988997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:29.991720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:29.993996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3de7d8c9-a9b2-4b75-91c5-a9258638a8af tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.273877 Aug 24 02:18:29.995294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4077/5069] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:29 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:30.014349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:30.015257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:30.026502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:30.027015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:30.030304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:30.031148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:30.031626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:30.035270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:30.953315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:30.969894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a2dbc18-11c2-4dca-baad-c748b891102f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.971950 Aug 24 02:18:30.970862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4078/5070] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:29 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:30.994605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:30.999561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:31.012198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.014500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.017298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:31.018744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.019223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.019663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:31.203731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:31.216988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ce004a6-e4c1-4722-97c9-535eb7bf71a2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1187 microversion: 2.1 time: 0.244086 Aug 24 02:18:31.229122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4079/5071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:30 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1187 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:31.234314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:31.235259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:31.253709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.254464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.255148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:31.256179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.257144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.257790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:31.769025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:31.782467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20b16110-e897-45bb-ae7c-387b9a72e940 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.550971 Aug 24 02:18:31.785308 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4080/5072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:31 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:31.804051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:31.804968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:31.833861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.839394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.839858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:31.840612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:31.841370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:31.841878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:32.819558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:32.837621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:32.840915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:32.843452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b02bcdfd-f553-4ebe-815f-469d028c61dd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 1.054327 Aug 24 02:18:32.846740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4081/5073] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:31 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:32.859841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1081648695", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "62fe4463-9689-4fd8-807d-9686124a81d4"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:32.983668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] validate_networks() for [('62fe4463-9689-4fd8-807d-9686124a81d4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:18:34.213523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:18:34.214096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:18:34.214484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:18:34.214925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:18:34.215407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:18:34.218793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:34.239213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:34.240858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:34.241504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:34.243958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:34.254887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:34.255696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:34.288067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:18:34.294696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:18:34.317983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:18:34.324707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:18:34.416821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0504665-b7f4-4b56-86e2-2adf00255d23 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568663 Aug 24 02:18:34.429991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4082/5074] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:18:34.473827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:34.474553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:34.506442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:34.506959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:34.507416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:34.508135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:34.508676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:34.509241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:35.256918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:35.272252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8498c898-0d4e-4cc8-be73-5fdb2a8aca9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1229 microversion: 2.1 time: 0.823867 Aug 24 02:18:35.273613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4083/5075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:34 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1229 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:35.279292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:35.280336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:35.287942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:35.288902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:35.294027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:35.297123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:35.298584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:35.302748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:35.973484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:35.995060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:35.997071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:35.998684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54f896c1-ba48-4cc5-9acc-8adffb7418a3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.723728 Aug 24 02:18:36.000306 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4084/5076] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:35 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:36.015718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8640068-8e1e-4e2b-a3db-4ed903de0101", "tag": "b49fc358-d2de-4194-b565-270c99a0c024"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:36.029661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.030347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.031606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:36.065760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] Creating event network-changed:b49fc358-d2de-4194-b565-270c99a0c024 for instance f8640068-8e1e-4e2b-a3db-4ed903de0101 on n-h1-854121-3 Aug 24 02:18:36.094255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-75731ee3-7445-4a1d-9046-b726c9d86dea req-799d533e-f5c6-4353-a758-cc65e06dffb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089093 Aug 24 02:18:36.109136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4085/5077] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:36.114903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:36.115607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:36.136758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.137639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.138129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:36.139041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.139980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.140574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:36.685385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:36.696415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eac1627f-3b1e-4278-aae4-168ee71e76ad tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1267 microversion: 2.1 time: 0.585718 Aug 24 02:18:36.708792 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4086/5078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:36 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1267 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:36.725033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:36.736239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.737165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.737775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:36.751550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] Creating event network-changed:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h1-854121-3 Aug 24 02:18:36.757394 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4a73ee1e-8958-4408-ad93-b8f79c3366c1 req-1ba60ec8-39cc-46d3-bd32-0fb2aab4b2ea service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047127 Aug 24 02:18:36.758598 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4087/5079] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:36.764866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:36.765775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:36.774010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.774676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.775281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:36.776140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:36.776771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:36.777339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:37.233482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:37.244090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4b98685-70af-4f3c-8046-3c6493a3fc33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1229 microversion: 2.1 time: 0.483488 Aug 24 02:18:37.245096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4088/5080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:36 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1229 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:37.265995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:37.282090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:37.296608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:37.297235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:37.297689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:37.298411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:37.298899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:37.299398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:37.890607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:37.903378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:37.904897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:37.906092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28ca58df-9d87-4e2c-a629-4acb804075bd tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.659798 Aug 24 02:18:37.906671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4089/5081] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:37 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:37.923585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:37.924877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:37.945618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:37.946120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:37.946571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:37.947284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:37.947747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:37.949583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:39.738763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:39.747709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84436882-2fbf-40b5-8ac4-e44ae1f248ae tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1315 microversion: 2.1 time: 1.839981 Aug 24 02:18:39.752234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4090/5082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:37 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1315 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:39.778921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:39.789630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:39.805128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:39.805634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:39.806102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:39.818304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:39.818802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:39.819256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:39.882076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:41.334089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:41.346429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-290c3ad2-e057-46da-b4ec-abd43d0c9188 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1229 microversion: 2.1 time: 1.590207 Aug 24 02:18:41.356750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4091/5083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:39 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1229 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:41.376460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:41.387606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:41.395261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:41.395914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:41.396502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:41.397397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:41.397999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:41.398639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:41.869351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:41.884013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:41.888598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:41.890172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37b541db-15e6-48d3-ab62-203cdc808f51 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.535619 Aug 24 02:18:41.893774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4092/5084] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:41 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:41.898971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "793ddb6a-8a97-409b-814a-affbf1c5f889", "tag": "84069d17-6d17-4202-b186-3a042fa1e0a3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:41.923864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:41.929407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:41.930264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:41.954680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] Creating event network-changed:84069d17-6d17-4202-b186-3a042fa1e0a3 for instance 793ddb6a-8a97-409b-814a-affbf1c5f889 on n-h2-854121-3 Aug 24 02:18:41.965163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0432bdf5-2a5a-492a-bb37-04b1faf79f7b req-82ba51f5-b827-4159-9c32-ae7dea8b1859 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069827 Aug 24 02:18:41.969423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4093/5085] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:41.977576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:41.980279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:42.016528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:42.017452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:42.018459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:42.019409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:42.020095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:42.020776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:42.726353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:42.745153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73f2ef3f-f795-47dc-bc4d-d85baa90ec1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1315 microversion: 2.1 time: 0.766816 Aug 24 02:18:42.747154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4094/5086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:41 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:42.779781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:42.787498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:42.824696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:42.825412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:42.826075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:42.826820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:42.827458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:42.828058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:43.372054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:43.396446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59e3f68c-4e08-4c3c-94d8-6a54952d90d0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.647890 Aug 24 02:18:43.400023 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4095/5087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:42 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:43.437546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:43.438242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:43.449651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:43.452421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:43.453356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:43.454412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:43.456292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:43.457323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:44.276629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:44.302526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:44.337711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:44.366306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:44.381358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:44.387267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-074f2bf1-0a67-4a10-bfec-c5f558d47b7e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.985835 Aug 24 02:18:44.407408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4096/5088] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:43 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:44.432211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:44.434502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:44.468382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:44.470057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:44.473505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:44.474627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:44.475330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:44.476930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:45.613040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:45.622111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fadf5f7-4d25-40cf-a64c-ae7f1b2abfe2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1315 microversion: 2.1 time: 1.212595 Aug 24 02:18:45.649091 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4097/5089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:44 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1315 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:45.654155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:45.654987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:45.662761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:45.663474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:45.664064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:45.665059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:45.665660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:45.666231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:46.232433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:46.262020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a26946ae-6b59-4520-acaf-215b6ea50778 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.611483 Aug 24 02:18:46.264859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4098/5090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:45 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:46.275511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:46.277413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:46.313235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:46.315152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:46.315763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:46.316772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:46.317387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:46.317991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:47.514703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:47.535149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:47.538125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:47.541631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fd4a8a3-16e8-4de1-9772-07ca09a6ba62 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 1.275537 Aug 24 02:18:47.564600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4099/5091] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:46 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:47.580964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:47.582580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:47.612865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:47.621953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:47.622761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:47.627665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:47.629870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:47.631461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:48.580394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:48.651314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b297c9c-3bf7-424a-b2a9-7fd1dcff71a0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1315 microversion: 2.1 time: 1.083002 Aug 24 02:18:48.653280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4100/5092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:47 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:48.684016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:48.684915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:48.721903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:48.728162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:48.728926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:48.729690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:48.730208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:48.730584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:49.177743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:49.185998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-938a9486-2b8c-4686-9c51-234cf969fc38 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.532972 Aug 24 02:18:49.199586 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4101/5093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:48 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:49.219898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793ddb6a-8a97-409b-814a-affbf1c5f889", "name": "network-vif-plugged", "status": "completed", "tag": "84069d17-6d17-4202-b186-3a042fa1e0a3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:49.268482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:49.269077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:49.269518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:49.328737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] Creating event network-vif-plugged:84069d17-6d17-4202-b186-3a042fa1e0a3 for instance 793ddb6a-8a97-409b-814a-affbf1c5f889 on n-h2-854121-3 Aug 24 02:18:49.346283 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9f8b1a7a-262e-42cb-a0ef-14acbc7eab4d req-9ebac24d-7470-480c-879d-51f255ba5cc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143653 Aug 24 02:18:49.350110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4102/5094] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:49.362341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:49.365491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:49.374536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:49.375340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:49.376156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:49.377580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:49.378307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:49.379734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:49.918087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:49.944991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:49.951823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:49.960815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d82a4a8-a5c8-4ce4-b319-43dacd1dd9ed tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.609233 Aug 24 02:18:49.967137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4103/5095] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:49 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:49.974432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:49.991998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:50.015865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:50.016677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:50.017907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:50.019163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:50.020427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:50.021059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:50.690079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:50.705674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a4bc480-35c2-440e-8a12-1754a9274f1e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1315 microversion: 2.1 time: 0.733171 Aug 24 02:18:50.707390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4104/5096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:49 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:50.726621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:50.734831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:50.766512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:50.767092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:50.773311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:50.774517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:50.775461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:50.776511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:51.696064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:51.712947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-392ee7c1-881c-4062-8fca-3f5023f2303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 1.002907 Aug 24 02:18:51.717455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4105/5097] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:50 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:51.734447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:51.735078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:51.757915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:51.758505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:51.776833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:51.779557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:51.780835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:51.782655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:52.248829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:52.269431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:52.275686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:52.285226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-025bc0d8-9bdc-4d6c-b456-6e9b85f5b505 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.566153 Aug 24 02:18:52.286649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4106/5098] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:51 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:52.311876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:52.313005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:52.347490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:52.347786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:52.348243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:52.355990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:52.357948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:52.366886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:53.266061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:53.275996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63795def-2822-4250-809c-0d1fc1349719 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1501 microversion: 2.1 time: 0.987957 Aug 24 02:18:53.284053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4107/5099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:52 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1501 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:53.301656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:53.302751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:53.324869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:53.325413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:53.329853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:53.336143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:53.336651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:53.337130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:53.834023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:53.845794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1e9bf4c-4449-48a0-837f-9e99bbf96897 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.554049 Aug 24 02:18:53.846518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4108/5100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:53 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:53.858571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:53.867426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:53.886050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:53.887583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:53.889345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:53.890412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:53.891943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:53.893593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:53.903909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:18:54.007703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8635f9bb-8e1f-4da6-8e8a-85a156efca3b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.156982 Aug 24 02:18:54.011308 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4109/5101] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:53 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:18:54.023790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:54.028527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:54.042909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:54.043413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:54.049438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:54.050289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:54.050686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:54.051127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:54.511912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:54.524832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:54.526744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:54.528085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-861199d3-1a10-4967-b2d9-8840dc7546a6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.518540 Aug 24 02:18:54.529062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4110/5102] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:54 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:54.866786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:54.867626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:54.884029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:54.890159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:54.890988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:54.894559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:54.896638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:54.902560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:55.501104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:55.512451 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f07a10e-9411-460c-ab8d-1a9a0a1b337a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.649404 Aug 24 02:18:55.528770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4111/5103] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:54 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:18:55.528770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:55.554867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:55.567558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:55.570082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:55.570738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:55.573308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:55.574873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:55.577705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:55.693282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f082fea5-d11e-4f22-aeed-2a8422e5c27f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.170224 Aug 24 02:18:55.693947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4112/5104] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:55 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:18:55.706100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:55.711697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:55.739297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:55.739807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:55.740250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:55.741042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:55.741508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:55.741936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.277758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:56.298673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:56.300350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:56.301696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-843b052f-aea7-4c69-aae8-401a71581270 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.604773 Aug 24 02:18:56.309075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4113/5105] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:55 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:56.315239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8640068-8e1e-4e2b-a3db-4ed903de0101", "name": "network-vif-plugged", "status": "completed", "tag": "b49fc358-d2de-4194-b565-270c99a0c024"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:56.349696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:56.352619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:56.353324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.369435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] Creating event network-vif-plugged:b49fc358-d2de-4194-b565-270c99a0c024 for instance f8640068-8e1e-4e2b-a3db-4ed903de0101 on n-h1-854121-3 Aug 24 02:18:56.375166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-44c5d918-c89c-4d5f-a27c-1394bdb8736e req-34cf2466-c136-4ca0-ac80-3884fdb7a026 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063871 Aug 24 02:18:56.376609 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4114/5106] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:18:56.545926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:56.548473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:56.558374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:56.560011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:56.561289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.564358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:56.565036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:56.565683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.768309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:56.782250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acb96a69-5d05-4ce2-b90b-1a1bc76a7edf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.246915 Aug 24 02:18:56.783248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4115/5107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:56 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:18:56.791234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:56.793965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:56.802016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:56.802675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:56.803432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.804363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:56.805067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:56.805914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:56.908828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c051c6bc-c9ea-4312-855c-6d043c469c66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.122730 Aug 24 02:18:56.910389 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4116/5108] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:56 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:18:57.333453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:57.334171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:57.359645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:57.360168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:57.360668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:57.361423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:57.361890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:57.362322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:57.982117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:58.000159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:58.027863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:58.030008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df414af6-96b7-4957-8d1f-3393e7823f37 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.701935 Aug 24 02:18:58.033846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4117/5109] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:57 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:18:58.057935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:58.059051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:58.075931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:58.076731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:58.077351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:58.079944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:58.082268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:58.084456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:58.534288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:58.549527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f5b13e7-99a0-4a05-bc6b-de2c85565ba3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.513059 Aug 24 02:18:58.552522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4118/5110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:58 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:18:58.568825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:18:58.575490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:58.594398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:58.595566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:58.597529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:58.601994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:58.603289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:58.603840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:58.681623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-371a2aab-7569-40e5-91c3-2448ed964b66 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.125927 Aug 24 02:18:58.685299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4119/5111] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:18:58 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:18:59.058002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:59.058702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:59.077285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:59.082032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:59.082556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:59.083310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:59.083978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:59.084200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:59.435146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:59.448329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:59.454093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:18:59.456900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d877fdbf-57f6-4c29-b490-b25d9822fd75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.403131 Aug 24 02:18:59.463916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4120/5112] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:18:59 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:18:59.570694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:18:59.571310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:18:59.594262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:59.594779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:59.595284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:18:59.596008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:18:59.596463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:18:59.596931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:00.325048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:00.337980 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c74fb9e-37ee-4e16-8355-8c5d14a5f6f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1217 microversion: 2.1 time: 0.771037 Aug 24 02:19:00.339419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4121/5113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:18:59 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1217 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:00.356520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:00.365004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:00.386578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:00.387558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:00.388126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:00.390504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:00.392971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:00.396000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:00.481092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10f244b0-703f-4fce-be4b-2e0f3fd886b3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.137955 Aug 24 02:19:00.482233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4122/5114] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:00 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:19:00.497681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:00.501225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:00.521699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:00.522434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:00.524013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:00.525634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:00.526795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:00.527491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:01.381592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:01.392849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:01.402434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:01.418448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6aa5282e-064d-4d72-80c0-0ece48fad4ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.934535 Aug 24 02:19:01.419291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4123/5115] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:00 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:01.424171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:01.428214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:01.454948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:01.455652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:01.456246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:01.457011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:01.457586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:01.461605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:01.865313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:01.876855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-740b09b7-627d-4960-b798-e37176a292f7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1404 microversion: 2.1 time: 0.456312 Aug 24 02:19:01.885039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4124/5116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:01 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:01.894688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:01.898981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:01.920493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:01.921044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:01.925476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:01.928704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:01.930804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:01.933716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:02.033600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4af3240-99fc-4c93-ab3b-4cf975bb330e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 14 microversion: 2.1 time: 0.144011 Aug 24 02:19:02.038193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4125/5117] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:01 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:19:02.051745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:02.052775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:02.061835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:02.063797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:02.064295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:02.065387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:02.066155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:02.066582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:02.066998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:02.344557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:02.357428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-937a8ca4-4dfd-4886-b8ba-252d7f1569c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1404 microversion: 2.1 time: 0.320107 Aug 24 02:19:02.361883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4126/5118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:02 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1404 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:02.384136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2043527299"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:02.388634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:02.428275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:02.433095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:02.433658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:02.434504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:02.435078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:02.435607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:02.621000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Attempting to quiesce instance before volume snapshot. Aug 24 02:19:02.689770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 24 02:19:02.695261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:02.859984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Creating snapshot from volume 382cb8d5-10f5-470f-95be-dcb49711949c. {{(pid=128567) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 24 02:19:03.041150 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:19:03.041723 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101/action (ip 10.222.0.49) !!! Aug 24 02:19:04.925683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-647134de-57ab-4304-ad95-887be6e6e7ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101/action" status: 202 len: 0 microversion: 2.1 time: 2.550157 Aug 24 02:19:04.943837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4127/5119] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:02 2022] POST /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101/action => generated 0 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 24 02:19:04.951783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:04.965580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:04.984225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:04.988587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:04.989292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:05.009473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:05.010205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:05.012810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:05.663423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:05.679759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:05.700451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:05.702763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3eea5c8-aae5-4455-b2aa-fbae7fccd39a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.757310 Aug 24 02:19:05.717772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4128/5120] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:04 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:05.725232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:05.743518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:05.773019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:05.776937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:05.778279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:05.781677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:05.782462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:05.785298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:05.924025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf0a6da8-009b-40e6-89d1-607dd81895d6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action" status: 200 len: 16402 microversion: 2.1 time: 0.198977 Aug 24 02:19:05.929064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4129/5121] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:05 2022] POST /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889/action => generated 16402 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:19:05.935925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:05.936646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:06.015051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:06.015560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:06.017271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:06.018016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:06.018501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:06.019006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:07.513212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:07.525981 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a6c2f1f-94be-4418-977e-3ecb4e2c576a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 1.594553 Aug 24 02:19:07.551307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4130/5122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:05 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:07.577768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:07.580366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:07.598683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:07.600753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:07.601445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:07.602457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:07.607893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:07.608977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:07.996760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:08.009738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:08.018153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:08.025726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc73d8e7-a58f-4d56-94e9-7ea0c24a8465 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.472860 Aug 24 02:19:08.026723 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4131/5123] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:07 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:08.039416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:08.040311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:08.065388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:08.065935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:08.066582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:08.067516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:08.068155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:08.069201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:08.626205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:08.644472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-031c57f6-0ed9-4510-a104-7d507e944dd8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.616363 Aug 24 02:19:08.648046 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4132/5124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:08 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:08.660429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1704335779", "imageRef": "951a9592-eb69-4f11-9d33-90589f89f3d8", "flavorRef": "452", "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:08.861559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:19:09.826191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:19:09.827293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:19:09.827927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:19:09.828494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:19:09.829134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:19:09.843504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:09.845431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:09.850323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:09.851763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:09.854164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:09.857344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:09.903634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:19:09.920633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:19:09.990682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:19:09.993726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b49dd142-f8b9-4270-a3fa-7a7d147d2700',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:19:10.170701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10f0a8c1-bfb3-415d-afad-a29c5a6fd63f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.520438 Aug 24 02:19:10.178732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4133/5125] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:19:10.195214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:10.204141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:10.220346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:10.220583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:10.223974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:10.229134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:10.229699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:10.230168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:11.337499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:11.350829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c913974-a574-42d2-ace7-6c70570c53f1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 1.168837 Aug 24 02:19:11.366662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4134/5126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:10 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:11.383697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:11.390468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:11.402475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:11.403792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:11.406078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:11.407285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:11.409452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:11.411313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:11.788851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:11.805056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:11.816133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:11.817713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ee0b012-248e-4f43-8ee3-912dd04956bc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.448017 Aug 24 02:19:11.828771 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4135/5127] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:11 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:11.839577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:11.841213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:11.854781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:11.857193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:11.857817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:11.864279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:11.866617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:11.874908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:12.014991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:12.027885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fefc8c58-ff77-4e7a-9304-5307114fcb66 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1234 microversion: 2.1 time: 0.197616 Aug 24 02:19:12.034134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4136/5128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:11 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1234 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:12.041569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:12.042619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:12.052424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:12.053383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:12.054479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:12.077764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:12.078656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:12.080464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:12.396501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:12.409432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f6eee49-b113-4e32-9e2f-0376f3757726 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.371755 Aug 24 02:19:12.428103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4137/5129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:12 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:12.453020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:12.453577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:12.481430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:12.482178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:12.483155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:12.484226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:12.485870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:12.486664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:12.741039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'services' on Instance uuid cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:19:13.002399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f15eca73-a230-4dc5-a0d8-f857abc0a1cc tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments/2b254b07-24ba-4066-9357-9f7bd678ed75" status: 202 len: 0 microversion: 2.1 time: 0.568725 Aug 24 02:19:13.003816 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4138/5130] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:19:12 2022] DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments/2b254b07-24ba-4066-9357-9f7bd678ed75 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:13.012053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:13.013453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:13.048295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:13.053598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:13.055283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:13.059041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:13.061414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:13.067157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:13.189351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Locking {{(pid=128567) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 24 02:19:13.333490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c68eecc5-6d8d-4460-b89a-085e61725553 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.328106 Aug 24 02:19:13.335591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4139/5131] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:13 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:13.350489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "name": "network-vif-plugged", "status": "completed", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:13.367743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:13.371306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:13.371926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:13.405212 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] Creating event network-vif-plugged:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h1-854121-3 Aug 24 02:19:13.417196 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-20214659-0d8a-4c73-b3ec-22b7895e9e29 req-5de300da-12d2-4b3a-8289-98ed97ba330d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080075 Aug 24 02:19:13.429325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4140/5132] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:13.440111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:13.441093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:13.456781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:13.457316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:13.458503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:13.458503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:13.459174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:13.459624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:13.510471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:14.091600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:14.147289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:14.158429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:14.170597 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a914e40-b4c1-4105-a8a7-6492778b075d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.733985 Aug 24 02:19:14.175146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4141/5133] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:13 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:14.200260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:14.204494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:14.253761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.254378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.255216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:14.257507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.261821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.262166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:14.361902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7466ffd6-df62-407f-998f-cf0d1c3a53d3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184172 Aug 24 02:19:14.365990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4142/5134] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:14 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:14.381293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:14.382536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:14.397976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.398856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.400694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:14.404475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.405269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.407626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:14.597851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:14.609058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd8de4aa-2047-45c4-943a-54e3e113da99 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1300 microversion: 2.1 time: 0.241137 Aug 24 02:19:14.613043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4143/5135] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:14 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:14.625066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:14.626638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:14.638936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.641033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.643124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:14.644468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:14.647183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:14.647910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.014759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:15.026428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ea1fd39-4137-41d7-9dd4-3161680da9a4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.411620 Aug 24 02:19:15.033597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4144/5136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:14 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:15.070135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:15.087496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.089113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.090440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.164733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action HTTP/1.1 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 15 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: {"os-stop": {}} Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7b335e2c-68ca-463a-88cc-4a142b30bc1c', 'body': {'os-stop': {}}} Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked Aug 24 02:19:15.186932 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:15.199138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 409 to user: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c is locked {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:19:15.199138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03771101-984a-4997-b364-7d89ce5bc2c7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 409 len: 107 microversion: 2.1 time: 0.133408 Aug 24 02:19:15.199138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4145/5137] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:15 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 107 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:19:15.220569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:15.224512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:15.247483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.253516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.259246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.263829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.273354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.273954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.652503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:15.666771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:15.670278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:15.672148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd4a2f30-b595-4ec8-839a-48cbdf2e1d6e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 0.474483 Aug 24 02:19:15.689585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4146/5138] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:15 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:15.708925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:15.710045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:15.717852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.718471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.719933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.721500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.723478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.724044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.814859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Unlocking {{(pid=128567) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 02:19:15.920891 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de1a6ce8-3c6f-4712-9671-9ff720d4b66a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.229704 Aug 24 02:19:15.921880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4147/5139] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:15 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:15.927650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:15.930284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:15.947367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.949776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.953747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:15.954830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:15.955847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:15.956663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:16.042909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-399d3c7f-4965-4576-824e-1935bf1579d5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119112 Aug 24 02:19:16.049064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4148/5140] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:15 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:16.054029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:16.059183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:16.075425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:16.076310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:16.077125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:16.078143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:16.087411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:16.089455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:17.365412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:17.375355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e861b77-ae30-4ab0-89a0-c7cf2bda9a3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 1.324960 Aug 24 02:19:17.377446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4149/5141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:16 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:17.387144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:17.401505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:17.402970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:17.404285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:17.461195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:19:17.614068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a18a1635-b99b-427a-8e3a-dc926ae7d2d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.218773 Aug 24 02:19:17.622153 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4150/5142] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:17 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:17.645427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:17.647344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:17.670561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:17.671078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:17.671540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:17.672306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:17.672816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:17.673267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:18.607935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:18.628623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:18.634989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:18.639804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb15f713-7d8c-4e41-af61-cf130e8ba902 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1807 microversion: 2.20 time: 1.015003 Aug 24 02:19:18.643216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4151/5143] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:17 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1807 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:18.664098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:18.677514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:18.702775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:18.707205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:18.707817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:18.713239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:18.718402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:18.718955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:18.876736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcc953b1-3ef8-430e-8142-176a7a0d80e4 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.230478 Aug 24 02:19:18.880344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4152/5144] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:18 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:18.891055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:18.892877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:18.907232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:18.907662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:18.908124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:18.908869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:18.913899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:18.914987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:19.870889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:19.949128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:20.056707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:20.068482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45220473-486e-460b-8d43-9bb07b8ddac3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 1.186520 Aug 24 02:19:20.069337 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4153/5145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:18 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:20.074437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:20.075453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:20.092082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:20.092602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:20.093092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:20.093828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:20.094349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:20.094798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:20.648039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:20.676133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d46287f-b4bd-4747-9f58-9660d8af6986 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.603926 Aug 24 02:19:20.690196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4154/5146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:20 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:20.708878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:20.712119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:20.734287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:20.737313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:20.738033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:20.744135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:20.745864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:20.746734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:20.826400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:21.441998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:21.463039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:21.467944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:21.482454 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-196b8536-463d-46d6-bd94-12300c1ae9d6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1794 microversion: 2.20 time: 0.772336 Aug 24 02:19:21.483129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4155/5147] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:19:20 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1794 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:19:21.515308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:21.533609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:21.553522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:21.555536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:21.574295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:21.577618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:21.581961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:21.583481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:21.722112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6549751f-4a5a-4604-b498-e431fd60f536 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231404 Aug 24 02:19:21.724421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4156/5148] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:21 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:21.737371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:21.740491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:21.757151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:21.759312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:21.762052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:21.762889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:21.763388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:21.763835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:22.363143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:22.379167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c45ee7d-7157-41a7-ab07-4998fa952f78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.652472 Aug 24 02:19:22.380690 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4157/5149] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:21 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:22.395260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:22.396056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:22.410102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:22.410872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:22.412146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:22.414541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:22.416384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:22.418786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:22.831948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:22.845578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5178af31-d8f9-4101-820d-db128a796c9c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.461278 Aug 24 02:19:22.846177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4158/5150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:22 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:22.864353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:22.876265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:22.892268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:22.895541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:22.896601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:22.901930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:22.902623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:22.904125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:22.977406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56e004ba-3c61-4cb8-92be-6e83afa590f8 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127315 Aug 24 02:19:22.985071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4159/5151] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:22 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:23.412384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:23.416130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:23.465440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:23.472132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:23.473507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:23.474537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:23.477557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:23.480538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:24.400956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:24.415419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e9c534a-d606-4861-87f5-b22c5a0cfe41 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 1.011856 Aug 24 02:19:24.418832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4160/5152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:23 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:24.467652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:24.473423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:24.510302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:24.511441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:24.512333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:24.514405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:24.519257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:24.520069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:25.269380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:25.310961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-098a0789-426f-4c1c-8214-c1ac28216383 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.890209 Aug 24 02:19:25.331152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4161/5153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:24 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:25.348485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:25.359048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:25.396107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:25.397407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:25.406882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:25.410963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:25.419125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:25.429008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:25.632339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-110a3321-bbf9-48a7-bee1-a34414fe0d07 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.291772 Aug 24 02:19:25.635736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4162/5154] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:25 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:25.653256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d584280-e7ec-4d65-8063-d366fd0bca13", "tag": "66fd0e44-9883-4416-bb98-e3480cb1bedf"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:25.679746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:25.680358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:25.680877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:25.710707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] Creating event network-changed:66fd0e44-9883-4416-bb98-e3480cb1bedf for instance 9d584280-e7ec-4d65-8063-d366fd0bca13 on n-h2-854121-3 Aug 24 02:19:25.725714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-59f34d4b-c7dd-4a2b-bd6a-d1bf66fc3640 req-29a48e62-4c79-4b38-bbc6-472444b4f1d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088258 Aug 24 02:19:25.728306 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4163/5155] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:25.741694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:25.742425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:25.769374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:25.769917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:25.770347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:25.771087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:25.771559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:25.772001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:26.214313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:26.235180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7852bb61-ccd6-4aa9-9b34-e017a0c28735 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.501712 Aug 24 02:19:26.253918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4164/5156] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:25 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:26.339439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:26.341137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:26.358193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:26.360282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:26.364244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:26.370312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:26.371429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:26.372749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:26.801825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:26.831152 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93c5f671-e329-4790-85fc-ec67027b6fc9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.498853 Aug 24 02:19:26.837362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4165/5157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:26 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:26.842586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:26.860934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:26.879334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:26.880194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:26.880866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:26.881933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:26.894618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:26.895544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:27.008645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1f5740a-bb68-4e31-bc59-8bbe66b1afd5 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168229 Aug 24 02:19:27.009942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4166/5158] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:19:26 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:19:27.183027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:27.199474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:27.251053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:27.258394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:27.258876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:27.260803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:27.261321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:27.261960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:27.400606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Cannot 'reboot' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action HTTP/1.1 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 28 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: {"reboot": {"type": "HARD"}} Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'reboot' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e', 'body': {'reboot': {'type': 'HARD'}}} Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:19:27.430074 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 409 to user: Cannot 'reboot' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dab381e4-599a-4a50-8bd7-afdf4e665811 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action" status: 409 len: 145 microversion: 2.1 time: 0.271886 Aug 24 02:19:27.439010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4167/5159] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:27 2022] POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action => generated 145 bytes in 274 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:19:27.471928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:27.478438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:27.554314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:27.557723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:27.559706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:27.567033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:27.572851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:27.573826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.074172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:28.096547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f82f0fd5-9241-4223-a889-3affd1406a78 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.651863 Aug 24 02:19:28.097884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4168/5160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:27 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:28.138019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:28.148367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:28.171086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:28.179916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.182301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.185840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.187002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.194013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.195720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.339277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Cannot 'rebuild' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action HTTP/1.1 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 65 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: exception: Cannot 'rebuild' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e', 'body': {'rebuild': {'imageRef': '71c852a4-8aa1-4649-8920-fa03a58666b5'}}} Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:19:28.341173 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued Aug 24 02:19:28.350955 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:28.353336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 409 to user: Cannot 'rebuild' instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e while it is in vm_state rescued {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:19:28.353336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1850394c-67e9-44d6-8eb3-5010960450a9 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action" status: 409 len: 146 microversion: 2.1 time: 0.229634 Aug 24 02:19:28.355814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4169/5161] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:28 2022] POST /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e/action => generated 146 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 02:19:28.420841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:28.425972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:28.435628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.436531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.437262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.440997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.441922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.442638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.722445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:28.731396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c3f54ff-93a8-48ea-9132-1ce04af85a5d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.374119 Aug 24 02:19:28.748575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4170/5162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:28 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:28.759960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:28.763973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:28.777902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.780431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.782324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.784447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:28.785230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:28.785974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:28.860746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:19:28.968106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:29.099091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91164649-3bf4-4aed-9fea-66e6f9ea37c3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 204 len: 0 microversion: 2.1 time: 0.348829 Aug 24 02:19:29.101068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4171/5163] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:19:28 2022] DELETE /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:19:29.113744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:29.115001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:29.132817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:29.133624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:29.134385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:29.138055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:29.152348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:29.152890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:29.703012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:29.719488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-220c2aa5-f4c1-48a7-8e17-f4c497c586e2 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1689 microversion: 2.1 time: 0.614039 Aug 24 02:19:29.720374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4172/5164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:29 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1689 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:29.725154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:29.729511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:29.743160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:29.743319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:29.743827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:29.744589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:29.745095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:29.757302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:30.683746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:30.694692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-375896f8-efa7-481f-a586-7b01ae5423c6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1656 microversion: 2.1 time: 0.973023 Aug 24 02:19:30.698919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4173/5165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:29 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1656 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:30.707857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:30.708958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:30.724067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:30.725831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:30.726552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:30.728023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:30.729181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:30.730418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:31.280799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:31.289961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-101161ba-3bf0-45b3-9174-4b0b1cc56bdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.589776 Aug 24 02:19:31.318552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4174/5166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:30 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:31.323718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:31.332171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:31.332171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:31.333426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:31.357790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 02:19:31.416760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e46ed67-5515-40ba-8b88-f48eb426388b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.095965 Aug 24 02:19:31.419174 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4175/5167] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:31 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:31.434404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:31.435158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:31.444229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:31.444983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:31.445650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:31.446529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:31.447155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:31.448132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:31.995830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:32.027063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-200995e0-7bef-4d18-a4be-9a295e359236 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1689 microversion: 2.1 time: 0.591550 Aug 24 02:19:32.029685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4176/5168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:31 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1689 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:32.036336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:32.047649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:32.065119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:32.066363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:32.067991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:32.069268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:32.070805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:32.072534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:32.462072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:32.474625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ae10551-1d40-4388-9d6f-32165ca1241f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1665 microversion: 2.1 time: 0.442019 Aug 24 02:19:32.477360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4177/5169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:32 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1665 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:32.493523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:32.494151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:32.524803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:32.525387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:32.533565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:32.534368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:32.534923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:32.535471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:33.236391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:33.247267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87733b52-b38d-4031-967a-feea5c50b94c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.768563 Aug 24 02:19:33.254933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4178/5170] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:32 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:33.268542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:33.269439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:33.289863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:33.290625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:33.294824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:33.295790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:33.296500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:33.297345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:33.986523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:34.000803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cec1abf2-40e6-49ac-8ca0-8e1dfddae0cf tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1689 microversion: 2.1 time: 0.744589 Aug 24 02:19:34.001425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4179/5171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:33 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1689 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:34.021252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:34.022920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:34.039610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:34.044398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:34.045087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:34.046074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:34.046774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:34.047448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:34.403702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:34.417874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac6fc60c-6415-4b98-ae8e-7e9c6a517737 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1665 microversion: 2.1 time: 0.400504 Aug 24 02:19:34.418773 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4180/5172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:34 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1665 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:34.435619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:34.436550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:34.447966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:34.456828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:34.457725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:34.458773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:34.459455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:34.461082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:34.914959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:34.924982 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82fa56c9-459d-4cc4-8d39-51b1913cac4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.504911 Aug 24 02:19:34.928564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4181/5173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:34 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:35.030159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:35.032154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:35.066689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.072519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.077580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:35.084152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.085050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.088620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:35.449350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:35.459901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5273334-f119-4c8c-ae5b-2559df9cf5e0 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1622 microversion: 2.1 time: 0.437417 Aug 24 02:19:35.461165 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4182/5174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:35 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1622 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:35.478080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:35.481009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:35.511478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.512938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.514321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:35.518270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.519073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.522309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:35.697303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:35.708828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-437eb181-8a1c-4408-b1cb-b50bc3b1b6ee tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.246428 Aug 24 02:19:35.710043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4183/5175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:35 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:35.735844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:35.737230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:35.748795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.753402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.754102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:35.755091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:35.755743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:35.756339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.018375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:36.028129 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-583af5ab-e09f-4da6-b1f4-b38783b07e90 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.297084 Aug 24 02:19:36.029476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4184/5176] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:35 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:36.035866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:36.037015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:36.045333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.046156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.047355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.048224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.048797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.049426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.291997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:36.307534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-846a2748-77a5-4a92-8250-54bd90e389e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.276710 Aug 24 02:19:36.311053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4185/5177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:36 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:36.322312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:36.326003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:36.337637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.338306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.339735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.340639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.341490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.342087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.391067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:36.409033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Unlocking {{(pid=128567) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 24 02:19:36.545919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-affd6ea3-35b8-46ec-b0ba-0fda171e7cb5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.233214 Aug 24 02:19:36.559585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4186/5178] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:36 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:36.585100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed", "name": "network-vif-deleted", "tag": "3abeb2ab-3b3f-4738-96ce-fbac74a756f4"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:36.614267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.616695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.619157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.677659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] Creating event network-vif-deleted:3abeb2ab-3b3f-4738-96ce-fbac74a756f4 for instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed on n-h2-854121-3 Aug 24 02:19:36.694470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d8ae41c7-e3f8-475d-b8b2-ba46b7fe9b74 req-a28ac562-ab08-4958-b3ec-d3a52e0f031a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129392 Aug 24 02:19:36.695832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4187/5179] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:19:36.711341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:36.712156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:36.740266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.741159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.741854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.743299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.744888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.745509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.807097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.807678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.808176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.809374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lazy-loading 'fault' on Instance uuid cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:19:36.860522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:36.872038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4970ab9-36b0-4233-9872-881a7f90206a tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 200 len: 1336 microversion: 2.1 time: 0.174777 Aug 24 02:19:36.872997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4188/5180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:36 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:36.878534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:36.879159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:36.886020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.887163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.887620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:36.888345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:36.888869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:36.889316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:37.090899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:37.101596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94152460-111d-45e8-bd82-c8c5f159c20c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.227359 Aug 24 02:19:37.102445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4189/5181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:36 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:37.124227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:37.125871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:37.133441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:37.134185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:37.134830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:37.135836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:37.136456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:37.137229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.206101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:38.256663 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0a47acd-adc7-4d8d-9728-f306cb98eeb9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 1.103505 Aug 24 02:19:38.260529 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4190/5182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:37 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:38.282008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:38.285652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:38.293901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.294565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.295574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.296610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.297524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.298296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.557172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:38.574982 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d777d8f-6b18-4fa2-82bc-7ba333080f35 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.311376 Aug 24 02:19:38.576394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4191/5183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:38 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:38.586431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:38.587587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:38.596789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.597748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.598643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.599822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.600564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.601189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.621241 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed HTTP/1.1 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed'} Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:38.623079 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 404 to user: Instance cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-165fe227-1f09-4e96-bfc6-5fc81962d8e3 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed" status: 404 len: 111 microversion: 2.1 time: 0.045607 Aug 24 02:19:38.628563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4192/5184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:38 2022] GET /compute/v2.1/servers/cbcfa91b-481a-4b55-b33b-f8c0a7ce10ed => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:19:38.631578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:38.632247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:38.639457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.639975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.640742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.641468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:38.641942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:38.642390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:38.916115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:38.928295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb396427-eaff-4c59-9625-348f788ee2f5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.300050 Aug 24 02:19:38.928979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4193/5185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:38 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:38.941773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cee58609-9824-4602-87c9-461abd72b775 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '.version_select at 0x7f6b91059310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:38.994490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cee58609-9824-4602-87c9-461abd72b775 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184368489" status: 202 len: 0 microversion: 2.1 time: 0.062929 Aug 24 02:19:38.998521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4194/5186] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1184368489 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:39.004212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:39.004808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:39.026780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.027623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.028885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:39.029915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.030746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.031412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:39.256270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f25171d5-f8a1-4741-a459-359d43353708 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.256122 Aug 24 02:19:39.261327 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4195/5187] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:38 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:39.276680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:39.287754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:39.333600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.339232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.340117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:39.345255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.345962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.351114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:39.912798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:39.927387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43ad3651-60a2-49b4-a17b-13a6c8c3ad10 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1674 microversion: 2.1 time: 0.660276 Aug 24 02:19:39.929122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4196/5188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:39 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1674 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:39.952368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:39.959416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:39.979306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.979869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.980428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:39.981482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:39.985760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:39.987188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:40.354514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:40.370445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d72171b5-2d76-4407-b8a4-c3574bfe3424 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.436399 Aug 24 02:19:40.371371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4197/5189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:39 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:40.951000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:40.952214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:40.967541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:40.971374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:40.972253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:40.974408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:40.975425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:40.977576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:41.714186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:41.734269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28211438-4daf-4f0c-8ed5-7c464295528a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1654 microversion: 2.1 time: 0.787328 Aug 24 02:19:41.735177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4198/5190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:40 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1654 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:41.742285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:41.756466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:41.775291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:41.776061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:41.777466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:41.779421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:41.782339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:41.783013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:42.477325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:42.492534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-838fe7c7-f33b-4c80-93d0-70e560eae4f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.755389 Aug 24 02:19:42.493766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4199/5191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:41 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:42.514694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:19:42.518866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:42.530988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:42.533200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:42.534041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:42.535644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:42.536375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:42.537117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:42.704543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-baaa188a-6c5d-4254-8acf-ea1e01a836d8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.203432 Aug 24 02:19:42.708114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4200/5192] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:19:42 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:42.715188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:42.717216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:42.742082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:42.749222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:42.752656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:42.753728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:42.759810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:42.760519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:42.840176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:43.147296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:43.170218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-024cac4c-a992-4617-b987-8da5a1e52760 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1661 microversion: 2.1 time: 0.459947 Aug 24 02:19:43.174041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4201/5193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:42 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1661 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:43.520484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:43.521353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:43.535518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:43.536121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:43.536572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:43.539603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:43.541520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:43.542303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:44.035607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:44.051058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc8e2420-e7c1-41c4-8612-560151ce3dd6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.535788 Aug 24 02:19:44.052381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4202/5194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:43 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:44.194362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:44.195253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:44.207953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:44.208780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:44.209437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:44.213373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:44.214178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:44.215740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:44.949640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:44.958175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c966061-5731-45b4-ac57-dac00622e1f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.767811 Aug 24 02:19:44.959070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4203/5195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:44.983642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:44.985111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:44.994333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:44.995179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:44.996797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:44.997729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:44.998399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:44.999083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:45.332383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:45.342507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe2c6a37-8e8f-45ff-80c6-59ba695b963c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.364311 Aug 24 02:19:45.346356 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4204/5196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:45.360769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:45.362758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:45.378492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:45.381342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:45.382369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:45.383370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:45.384696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:45.386350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:45.892311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:45.923269 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04db4e1a-5be1-40cf-9ef9-e24ab75abee1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.574177 Aug 24 02:19:45.925509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4205/5197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:45 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:45.937337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:45.938847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:45.957322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:45.958122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:45.961781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:45.962688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:45.963178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:45.963621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:46.877121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:46.885340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bab90fe-1e83-44e1-9672-984f11f0bdbb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.958011 Aug 24 02:19:46.885926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4206/5198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:45 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:46.918229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:46.919195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:46.956670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:46.957216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:46.965198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:46.966095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:46.966602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:46.971951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:47.695775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:47.706421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70899627-694d-4e40-a9b9-1f3a8c1985c0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.802018 Aug 24 02:19:47.716194 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4207/5199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:46 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:47.724404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:47.725061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:47.762143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:47.762653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:47.763108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:47.771626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:47.774060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:47.774530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:48.410346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:48.431236 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce13f475-24e8-48bb-9905-6252b191b522 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.713718 Aug 24 02:19:48.434658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4208/5200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:47 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:48.443956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:48.453827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:48.481346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:48.483484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:48.485200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:48.485960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:48.486439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:48.493516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:49.370665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:49.382628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1046a17-d4b5-48c2-a890-871c8786e29f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.946145 Aug 24 02:19:49.383243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4209/5201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:48 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:49.408377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:49.409150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:49.430511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:49.431250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:49.431575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:49.432394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:49.438815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:49.441029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:49.959394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:49.998553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-121098be-eb37-4753-b992-685f6cafc759 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.592157 Aug 24 02:19:50.006693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4210/5202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:49 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:50.018775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:50.020664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:50.074428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:50.077324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:50.078433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:50.082237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:50.087415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:50.089405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:50.547435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:50.557966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09f30ff0-1835-484b-b0b4-7761e778a6b3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1342 microversion: 2.1 time: 0.549632 Aug 24 02:19:50.558638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4211/5203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:50 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1342 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:51.588030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:51.589626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:51.604327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:51.612904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:51.614005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:51.615667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:51.616366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:51.617051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:53.052559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:53.066574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a5c559a-1130-437b-8330-2d9b215fa4fc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1388 microversion: 2.1 time: 1.480939 Aug 24 02:19:53.072688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4212/5204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:51 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1388 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:53.089698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:53.090826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:53.108544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:53.110930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:53.113456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:53.118257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:53.119274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:53.120069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:53.349774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lazy-loading 'services' on Instance uuid ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:19:53.555135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86ba6bd7-aa15-4245-a73a-decc4c1e91aa tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2/os-volume_attachments/e0c69cc1-61a3-4e09-9b32-55d4100cf705" status: 202 len: 0 microversion: 2.1 time: 0.480637 Aug 24 02:19:53.555829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4213/5205] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:19:53 2022] DELETE /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2/os-volume_attachments/e0c69cc1-61a3-4e09-9b32-55d4100cf705 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:19:54.092096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:54.093501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:54.116434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:54.125037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:54.126791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:54.127436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:54.131506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:54.140532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:54.145115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:55.030959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:55.055557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6879e372-50af-44a1-be82-3f8a63bc0a63 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.968071 Aug 24 02:19:55.064244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4214/5206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:54 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:19:56.082808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:56.084131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:56.109657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:56.113244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:56.114404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:56.118044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:56.118749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:56.122199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:56.760576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:56.777151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61b778f2-0f9a-458e-a940-2fc566e934ef tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.699459 Aug 24 02:19:56.780632 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4215/5207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:56 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:57.801505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:57.802130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:57.822805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:57.825338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:57.825961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:57.828259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:57.828993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:57.829938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:58.536814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:58.546749 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf12b956-08f2-43c1-8f86-d0b6d42de0df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.749150 Aug 24 02:19:58.570108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4216/5208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:57 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:58.580855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:58.589679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:58.612084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:58.613403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:58.616418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:58.617491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:58.618174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:58.624487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:58.651961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:19:58.707802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:19:58.921845 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73fffe01-7c50-42bb-a711-2e7579d94b0e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 204 len: 0 microversion: 2.1 time: 0.349818 Aug 24 02:19:58.925946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4217/5209] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:19:58 2022] DELETE /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:19:58.943374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:58.947666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:58.963539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:58.966548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:58.967746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:58.968940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:58.971096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:58.971594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:59.586596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:19:59.600939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-173e76db-87be-42fb-9b0d-3d6c76be1b32 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1508 microversion: 2.1 time: 0.669768 Aug 24 02:19:59.603584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4218/5210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:58 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1508 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:19:59.615015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:19:59.618043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:19:59.632170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:59.634521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:59.634999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:19:59.635748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:19:59.636514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:19:59.638952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:00.082114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:00.101997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7b25350-3632-4528-98f8-f952bb349507 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.497110 Aug 24 02:20:00.103178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4219/5211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:19:59 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:00.622701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:00.623323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:00.632176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:00.632692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:00.634489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:00.637987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:00.638669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:00.641261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:00.835025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:00.885858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-952f4e71-328f-4fb3-a2a0-008cdcf7d157 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 200 len: 1466 microversion: 2.1 time: 0.265085 Aug 24 02:20:00.887486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4220/5212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:00 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 1466 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:00.921715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e", "name": "network-vif-deleted", "tag": "bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:00.944404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:00.945152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:00.946242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:00.961482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] Creating event network-vif-deleted:bc34b0d2-9d72-43b0-9d2b-08d8afebb7ae for instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e on n-h1-854121-3 Aug 24 02:20:00.970331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c67f6c11-dd32-4f03-8ed6-08edaf24f044 req-dd32b253-54d9-4295-93d2-2aba5938bc9b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079224 Aug 24 02:20:00.971801 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4221/5213] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:01.125404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:01.126216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:01.173468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:01.174172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:01.174731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:01.178611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:01.179402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:01.180183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:01.634042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:01.667299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6bb7d280-3e2c-4bbd-8093-a05ed7a99e33 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.547248 Aug 24 02:20:01.667833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4222/5214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:01 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:01.909485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:01.910374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:01.929521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:01.931202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:01.932077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:01.933654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:01.934365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:01.935055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:01.959506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e HTTP/1.1 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e'} Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:01.961966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 404 to user: Instance 83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2090752a-288a-421b-8524-dc2c4f3e4c82 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e" status: 404 len: 111 microversion: 2.1 time: 0.059871 Aug 24 02:20:01.968506 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4223/5215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:01 2022] GET /compute/v2.1/servers/83df8a7a-0bde-4c4b-9ebc-8a8e9795b88e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:20:01.973112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:01.973724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:01.994379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:01.995030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:01.998610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:02.000159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:02.002479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:02.003605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:02.042253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:20:02.216364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55b5b519-996e-4ff7-acbf-8657c5022208 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "DELETE /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 204 len: 0 microversion: 2.1 time: 0.246804 Aug 24 02:20:02.220681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4224/5216] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:20:01 2022] DELETE /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:20:02.232913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:02.238067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:02.250548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:02.252641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:02.253313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:02.254856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:02.256297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:02.257209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:02.705757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:02.714446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9baf4110-07b0-408e-97f1-97ea948b3caa tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.492280 Aug 24 02:20:02.720134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4225/5217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:02 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:02.739118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:02.740013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:02.755739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:02.756454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:02.757101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:02.757983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:02.759947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:02.760520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:03.067955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:03.079246 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a528635c-4aab-498f-a1d9-09db47404b8d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.357384 Aug 24 02:20:03.081612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4226/5218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:02 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:03.745377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:03.746005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:03.752672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:03.753251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:03.753638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:03.754347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:03.754820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:03.755258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:03.919197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:03.932200 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad5e68d5-b880-4635-8303-b6a3cd1e57a6 tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.190593 Aug 24 02:20:03.940828 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4227/5219] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:03 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:03.950098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:03.950624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:03.957183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:03.957784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:03.958224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:03.959113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:03.959582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:03.960017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.011553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:20:04.128205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30b8e189-1de6-4c7c-8da1-03ea88eeedeb tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 204 len: 0 microversion: 2.1 time: 0.189425 Aug 24 02:20:04.129651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4228/5220] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:20:03 2022] DELETE /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:20:04.137197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:04.137925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:04.147768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.150772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.151257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.151998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.152500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.152954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.339374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:04.351301 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46596e5f-a8a5-4f23-aa32-cd9683f46c50 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.219560 Aug 24 02:20:04.352443 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4229/5221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:04 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:04.357521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:04.358824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:04.365878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.366658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.367505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.368683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.369242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.372643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.386860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:04.712337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:04.722535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5629e3af-223c-4ae7-8a82-cb8f8017a603 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1468 microversion: 2.1 time: 0.368793 Aug 24 02:20:04.728219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4230/5222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:04 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1468 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:04.734328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d584280-e7ec-4d65-8063-d366fd0bca13", "name": "network-vif-plugged", "status": "completed", "tag": "66fd0e44-9883-4416-bb98-e3480cb1bedf"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:04.745189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.746087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.747227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.763102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] Creating event network-vif-plugged:66fd0e44-9883-4416-bb98-e3480cb1bedf for instance 9d584280-e7ec-4d65-8063-d366fd0bca13 on n-h2-854121-3 Aug 24 02:20:04.770060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6a7225db-d8db-4fcc-8abd-a0a562ca99c2 req-bd269ef4-b945-4534-82fd-1f35a0179c36 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040296 Aug 24 02:20:04.775227 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4231/5223] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:04.958625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:04.959351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:04.976148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.977124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.977531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:04.978471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:04.979353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:04.996537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:05.750184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2da781ddf9a4aa0a4c04554ff8ecd2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9360466b32d4c5083a55f35afe881d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:05.770217 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4bbc5ea-dbec-47dd-b725-26b4d6f7c96d tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 200 len: 1523 microversion: 2.1 time: 0.814392 Aug 24 02:20:05.771075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4232/5224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:04 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 1523 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:05.782943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:05.791596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:05.806679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:05.807314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:05.807752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:05.808498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:05.812967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:05.813607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.085487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:06.099220 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4f481f1-4714-439d-ae8d-0465dcc23b4b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.322153 Aug 24 02:20:06.101970 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4233/5225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:05 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:06.117221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d5d503-43c2-4722-be4d-110754c00312", "name": "network-vif-deleted", "tag": "2cdc2691-9fd9-40f6-a282-836b503c2a83"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:06.131659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:06.132296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:06.132973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.159948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] Creating event network-vif-deleted:2cdc2691-9fd9-40f6-a282-836b503c2a83 for instance 18d5d503-43c2-4722-be4d-110754c00312 on n-h1-854121-3 Aug 24 02:20:06.166608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c57f78e9-9980-4cf7-85fc-c313ee0bf924 req-89f1b157-7605-431a-964a-7235388bd6c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063244 Aug 24 02:20:06.167748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4234/5226] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:06.176357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:06.177539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:06.187314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:06.188055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:06.188697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.190054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:06.191938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:06.192615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.428375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:06.449305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6022bf0c-ab3d-4197-ba3b-b8c0bd241571 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1468 microversion: 2.1 time: 0.276469 Aug 24 02:20:06.453927 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4235/5227] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:06 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:06.793495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:06.795361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] [instance: 18d5d503-43c2-4722-be4d-110754c00312] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:06.803089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:06.803948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:06.804531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.805626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:06.806173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:06.807025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:06.825424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] HTTP exception thrown: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Request method failure captured: Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 HTTP/1.1 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYlcto00W6ROZDp0QcI_pCyeBBcYxTKJY25aZ6KoiEcGiRglb3mpehQW44EMA91O1lzSHbEuJpoxJcwA0JXvNaNUOEYMQYvHlayDIVa0yQsMm_VWS4DQCOrjSM6a5SgxMoIIl9uyC-KKt1KxCYdCf6JnGKifQE0xcdBqFheyNALP_Yk Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a9360466b32d4c5083a55f35afe881d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a9360466b32d4c5083a55f35afe881d1 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778051288 Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d2da781ddf9a4aa0a4c04554ff8ecd2b Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778051288-project Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '18d5d503-43c2-4722-be4d-110754c00312'} Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:06.827366 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] Returning 404 to user: Instance 18d5d503-43c2-4722-be4d-110754c00312 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ff0aede-71d8-499b-95e1-3d554297776e tempest-ServerRescueNegativeTestJSON-778051288 tempest-ServerRescueNegativeTestJSON-778051288-project] 10.222.0.49 "GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312" status: 404 len: 111 microversion: 2.1 time: 0.039814 Aug 24 02:20:06.831320 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4236/5228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:06 2022] GET /compute/v2.1/servers/18d5d503-43c2-4722-be4d-110754c00312 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:20:07.120643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:07.121552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:07.132702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:07.134547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:07.135213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:07.136315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:07.137040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:07.137760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:07.457051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:07.470813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94389ec1-e7b3-46b3-b61f-8be3771b9be6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1376 microversion: 2.1 time: 0.354447 Aug 24 02:20:07.471400 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4237/5229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:07 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1376 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:07.497089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:07.497750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:07.516172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:07.516693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:07.522076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:07.523051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:07.523694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:07.524300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:07.844749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9620ad6315f47c59df85197215af8fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e69ebaa5f445a8b145d2a2aeb5a9e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:07.860701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83bdb309-da5d-4687-aced-4e3c932cf054 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 200 len: 1468 microversion: 2.1 time: 0.387931 Aug 24 02:20:07.865880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4238/5230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:07 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:07.884042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2", "name": "network-vif-deleted", "tag": "8457b86f-7a42-4955-a80e-77b173a753ef"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:07.902522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:07.903416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:07.907244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:07.937169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] Creating event network-vif-deleted:8457b86f-7a42-4955-a80e-77b173a753ef for instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 on n-h2-854121-3 Aug 24 02:20:07.945135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-36f7ce2f-c6ef-49b3-9499-667782f4e76f req-fc61740f-a0a5-4cf5-9b51-bac979c0bcd0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066854 Aug 24 02:20:07.953062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4239/5231] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:20:08.493662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:08.495281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:08.506003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:08.506791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:08.507406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:08.508504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:08.509262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:08.510063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:08.968141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:08.979968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35a68c3e-2453-4c28-90f2-deefa2d472a4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1563 microversion: 2.1 time: 0.490944 Aug 24 02:20:08.997738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4240/5232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:08 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1563 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:09.003525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:09.004309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] [instance: ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:09.011251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.011886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.012625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.013680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.015037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.015789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.032432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] HTTP exception thrown: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Request method failure captured: Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 HTTP/1.1 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYocBOrLdho2vYp1pwm5vsmBTvIr2PuTxLsNT_Gt6GsFAqrmFHXTAymbTL5nvEC04PbbQpff3yy4_Tbz0L_kgv1i-pWtS5C12CRamh-KVRrgfzFu-Zep72itPW6cwZADyMqpzUdB28Oj1JdsbXZwr8izhAD0j_ZmtIT61szhMrr7rqE Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c9e69ebaa5f445a8b145d2a2aeb5a9e7 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesBackupsTest-497169420 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c9e69ebaa5f445a8b145d2a2aeb5a9e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9e69ebaa5f445a8b145d2a2aeb5a9e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c9e69ebaa5f445a8b145d2a2aeb5a9e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c9e69ebaa5f445a8b145d2a2aeb5a9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesBackupsTest-497169420 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c9e69ebaa5f445a8b145d2a2aeb5a9e7 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesBackupsTest-497169420 Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesBackupsTest-497169420-project Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d9620ad6315f47c59df85197215af8fc Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesBackupsTest-497169420-project Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2'} Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:09.034307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. Aug 24 02:20:09.038177 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:09.041077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] Returning 404 to user: Instance ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:09.042943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff7091ed-245b-4f81-b335-1a086a6966b0 tempest-VolumesBackupsTest-497169420 tempest-VolumesBackupsTest-497169420-project] 10.222.0.49 "GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2" status: 404 len: 111 microversion: 2.1 time: 0.043679 Aug 24 02:20:09.047498 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4241/5233] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:08 2022] GET /compute/v2.1/servers/ec8bbd0c-76fb-4ce4-8769-068e30d3e2b2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:20:09.053320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:09.054489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:09.063846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.063846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.063846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.065023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.065645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.066626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.566102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:09.575985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2549618b-aa66-45bb-bf85-1c3be89e36b0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1563 microversion: 2.1 time: 0.527189 Aug 24 02:20:09.580753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4242/5234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:09 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1563 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:09.711110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:09.711736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:09.724855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.725558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.726110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.729092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:09.729715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:09.732657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:09.796256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:20:09.996162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a977203-8f2b-485a-9c4b-59feb4d66a78 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 204 len: 0 microversion: 2.1 time: 0.289266 Aug 24 02:20:09.997076 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4243/5235] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:20:09 2022] DELETE /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:20:10.009875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:10.011195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:10.027825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:10.032829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:10.033538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:10.034471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:10.034965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:10.036014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:10.616460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:10.634672 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f83352e-d0da-4155-84a1-f42428061079 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1569 microversion: 2.1 time: 0.631016 Aug 24 02:20:10.635905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4244/5236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:10 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1569 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:11.658204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:11.660481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:11.682794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:11.684704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:11.686503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:11.687937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:11.691045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:11.692773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:11.969989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:11.982215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5627e767-67f0-44d2-be3a-ce1d6d3f387f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1569 microversion: 2.1 time: 0.329046 Aug 24 02:20:11.999406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4245/5237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:11 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1569 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:13.007555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:13.009067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:13.029835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:13.030357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:13.030815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:13.033475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:13.033982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:13.034431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:13.187299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:13.205362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb98371e-7118-48b2-b8c1-68efe304a9e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1527 microversion: 2.1 time: 0.201522 Aug 24 02:20:13.219021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4246/5238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:13 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:13.254452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d584280-e7ec-4d65-8063-d366fd0bca13", "name": "network-vif-deleted", "tag": "66fd0e44-9883-4416-bb98-e3480cb1bedf"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:13.265828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:13.266573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:13.267783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:13.293256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] Creating event network-vif-deleted:66fd0e44-9883-4416-bb98-e3480cb1bedf for instance 9d584280-e7ec-4d65-8063-d366fd0bca13 on n-h2-854121-3 Aug 24 02:20:13.306391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9fcbf6d9-8c02-4e83-9f70-58a7bb9ea90a req-58ef4c1a-2edc-499e-b2c6-f47b553aabc4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081466 Aug 24 02:20:13.309329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4247/5239] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:14.249371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:14.250795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:14.266488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:14.271338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:14.272012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:14.272935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:14.284067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:14.285343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:14.552423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:14.562995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-906ec597-837c-4ed9-8b3f-42cbb36e35ab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.336642 Aug 24 02:20:14.581636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4248/5240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:14 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:15.589386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:15.590007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:15.605184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:15.605701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:15.606152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:15.607386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:15.607925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:15.608364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:15.617553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:16.065012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:16.080491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1daef45b-5b94-4032-871c-51212c8d8150 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.487558 Aug 24 02:20:16.081207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4249/5241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:15 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:18.053847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:18.054440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:18.103752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.104208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.104663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:18.105421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.105905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.106351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:18.217027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7dacba7-03c5-4063-899c-4a3f4a9acd1a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments/ece8679a-e5ee-4e41-a674-4153bc5b47a0" status: 200 len: 194 microversion: 2.20 time: 1.338872 Aug 24 02:20:18.218423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4250/5242] 10.222.0.49 () {60 vars in 1454 bytes} [Wed Aug 24 02:20:16 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments/ece8679a-e5ee-4e41-a674-4153bc5b47a0 => generated 194 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:18.244881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:18.245174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:18.280110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.280624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.281112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:18.281832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.293106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.293830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:18.645952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:18.683406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-312c124a-78f7-49c5-867f-c8b51eddd095 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.440957 Aug 24 02:20:18.686717 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4251/5243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:18 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:18.700369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:18.700920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:18.713693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:18.735391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.736012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.736475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:18.743666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:18.744190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:18.744647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:19.059876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lazy-loading 'services' on Instance uuid fe0906a9-e31a-43da-8d82-b60ae4a9c4ae {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:20:19.325317 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae06a7b4-a490-4e2d-993a-4fa4ebb271d0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments/ece8679a-e5ee-4e41-a674-4153bc5b47a0" status: 202 len: 0 microversion: 2.20 time: 0.634882 Aug 24 02:20:19.328880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4252/5244] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 24 02:20:18 2022] DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments/ece8679a-e5ee-4e41-a674-4153bc5b47a0 => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:20:19.351725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:19.362725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:19.387302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:19.392167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:19.395464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:19.396818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:19.400917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:19.401775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:19.505358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73abd8cd-107d-43ff-8e09-90f6a6ade330 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.170251 Aug 24 02:20:19.508580 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4253/5245] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:19 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:19.708634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:19.710420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:19.731498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:19.732257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:19.734979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:19.739073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:19.741639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:19.745307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:20.278513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:20.293770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc1a91b3-8f3a-4e90-b7f6-211e1174bf6f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.585508 Aug 24 02:20:20.298778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4254/5246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:19 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:20.520271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:20.524350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:20.549147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:20.552333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:20.556186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:20.557144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:20.560448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:20.566603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:20.679686 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b76cbc9-2081-4575-89b1-12bb7d4a5925 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164831 Aug 24 02:20:20.685173 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4255/5247] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:20 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:21.315447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:21.322104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:21.343252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:21.345252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:21.345731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:21.346474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:21.346946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:21.347376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:21.686178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:21.705702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f23336e-99cb-492e-a916-ac0d36e099a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.393680 Aug 24 02:20:21.708633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4256/5248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:21 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:21.716017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:21.719217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:21.726614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:21.727353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:21.727956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:21.729016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:21.729809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:21.730402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:21.770380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-63f5ae40-ab7e-4500-856f-df8e2c27924c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060254 Aug 24 02:20:21.771638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4257/5249] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:21 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:22.727203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:22.728008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:22.740112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:22.742782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:22.745564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:22.746476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:22.749265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:22.749980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:22.900247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:22.910441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73f29c2e-4f14-4977-acc3-543a218ce532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.187349 Aug 24 02:20:22.911030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4258/5250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:22 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:22.942593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:22.958373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:22.975327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:22.976071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:22.978119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:22.980131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:22.981212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:22.982397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:23.043543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd39903b-683c-46b3-b626-d3a5a063b591 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114777 Aug 24 02:20:23.044288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4259/5251] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:22 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:23.551779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-934c3370-e269-4c51-8ce7-7081cc09957d tempest-ComputeTenantNetworksTest-554487997 tempest-ComputeTenantNetworksTest-554487997-project] Calling method '.version_select at 0x7f6b9125adc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:24.185157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-934c3370-e269-4c51-8ce7-7081cc09957d tempest-ComputeTenantNetworksTest-554487997 tempest-ComputeTenantNetworksTest-554487997-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.856754 Aug 24 02:20:24.186029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4260/5252] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:20:23 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:24.190739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:24.191539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:24.197754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:24.198262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:24.198699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:24.199601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:24.200082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:24.200542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:24.475184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:24.488045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3832e130-2313-40fc-a59c-d0074c04dadc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 200 len: 1361 microversion: 2.1 time: 0.301090 Aug 24 02:20:24.498512 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4261/5253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:24 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:24.511106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:24.514579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:24.526457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:24.527191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:24.527928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:24.528920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:24.529614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:24.530252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:24.570982 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8acd676d-3f19-46b9-b1c4-65a7d6d5dfc3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070739 Aug 24 02:20:24.571509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4262/5254] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:24 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:24.579931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f5b582a-1bb4-4d96-bdc4-cc8bb0929b47 tempest-ComputeTenantNetworksTest-554487997 tempest-ComputeTenantNetworksTest-554487997-project] Calling method '.version_select at 0x7f6b904b1af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:24.807287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f5b582a-1bb4-4d96-bdc4-cc8bb0929b47 tempest-ComputeTenantNetworksTest-554487997 tempest-ComputeTenantNetworksTest-554487997-project] 10.222.0.49 "GET /compute/v2.1/os-tenant-networks/8172d0f7-86ba-4b9b-b904-b46955733ef6" status: 200 len: 139 microversion: 2.1 time: 0.234469 Aug 24 02:20:24.809429 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4263/5255] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:20:24 2022] GET /compute/v2.1/os-tenant-networks/8172d0f7-86ba-4b9b-b904-b46955733ef6 => generated 139 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:25.511495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:25.512497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:25.528240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:25.529006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:25.531119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:25.537897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:25.538723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:25.540630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:25.572618 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 HTTP/1.1 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9d584280-e7ec-4d65-8063-d366fd0bca13'} Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:25.580832 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:20:25.584881 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:25.593223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:25.595715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49a0d731-3902-4b67-8218-b1da1a2a0243 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 404 len: 111 microversion: 2.1 time: 0.089837 Aug 24 02:20:25.597360 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4264/5256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:25 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:20:25.607370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:25.615833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:25.627136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:25.630905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:25.634756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:25.636137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:25.636941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:25.637776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:25.753080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a2d05ff-da53-4a70-b9e5-add0235a9e55 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150928 Aug 24 02:20:25.757718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4265/5257] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:25 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:26.770699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:26.774111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:26.799690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:26.801186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:26.802605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:26.804484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:26.806532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:26.807408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:26.898682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-132e13c7-f8a6-4aff-bfa4-deb6d8bcde6a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132667 Aug 24 02:20:26.909246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4266/5258] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:26 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:27.913349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:27.918302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:27.940065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:27.942573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:27.944076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:27.954034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:27.958267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:27.959219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:28.032081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:28.038266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c7ddbd4-29b7-43fb-b8cd-ba03febb5b7f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129406 Aug 24 02:20:28.039435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4267/5259] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:27 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:20:28.679026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9efeb520-17d2-4988-985c-da1d925cdcf1 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Action: 'create', calling method: .version_select at 0x7f6b904e08b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1821096829", "metadata": {"Type": "work"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9efeb520-17d2-4988-985c-da1d925cdcf1 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 122 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1821096829", "metadata": {"Type": "work"}}} Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1821096829', 'metadata': {'Type': 'work'}}}} Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:20:28.683924 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 02:20:28.688108 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.695609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9efeb520-17d2-4988-985c-da1d925cdcf1 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:28.696798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9efeb520-17d2-4988-985c-da1d925cdcf1 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.623013 Aug 24 02:20:28.699376 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4268/5260] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 02:20:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 626 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:20:28.715523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b58b731c-4fca-44cf-bfde-eb787b0ddabc tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Action: 'create', calling method: .version_select at 0x7f6b913143a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-523174399", "metadata": {"Type": "work"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b58b731c-4fca-44cf-bfde-eb787b0ddabc tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 119 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-523174399", "metadata": {"Type": "work"}}} Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-523174399', 'metadata': {'Type': 'work'}}}} Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '0' Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:20:28.724597 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b58b731c-4fca-44cf-bfde-eb787b0ddabc tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:28.728669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b58b731c-4fca-44cf-bfde-eb787b0ddabc tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018964 Aug 24 02:20:28.734873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4269/5261] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 02:20:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:20:28.745610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65c01ac4-d740-4d49-9b41-5c7bce16b6e2 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Action: 'create', calling method: .version_select at 0x7f6b904ae790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1971582028", "metadata": {"Type": "work"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65c01ac4-d740-4d49-9b41-5c7bce16b6e2 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 119 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1971582028", "metadata": {"Type": "work"}}} Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1971582028', 'metadata': {'Type': 'work'}}}} Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '' Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 02:20:28.757756 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 02:20:28.761859 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.764427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65c01ac4-d740-4d49-9b41-5c7bce16b6e2 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:28.770164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65c01ac4-d740-4d49-9b41-5c7bce16b6e2 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033150 Aug 24 02:20:28.774772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4270/5262] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 02:20:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:20:28.781225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c3553c4-95d3-4ed4-918b-98275ea60ca4 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Calling method '.version_select at 0x7f6b9047f430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:28.835899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8c3553c4-95d3-4ed4-918b-98275ea60ca4 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] HTTP exception thrown: Volume tempest-invalid-1448028029 could not be found. Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c3553c4-95d3-4ed4-918b-98275ea60ca4 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1448028029 HTTP/1.1 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume tempest-invalid-1448028029 could not be found. Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'tempest-invalid-1448028029'} Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1448028029 could not be found. (HTTP 404) (Request-ID: req-0994c47c-414d-49ce-8eda-ee3f272e6b97) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:20:28.837847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1448028029 could not be found. Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1448028029 could not be found. Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1448028029 could not be found. Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c3553c4-95d3-4ed4-918b-98275ea60ca4 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 404 to user: Volume tempest-invalid-1448028029 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c3553c4-95d3-4ed4-918b-98275ea60ca4 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1448028029" status: 404 len: 99 microversion: 2.1 time: 0.063247 Aug 24 02:20:28.842367 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4271/5263] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:20:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1448028029 => generated 99 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 24 02:20:28.851167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b9cb66d-1b2c-41b6-b4c5-47d969ff1c18 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005370 Aug 24 02:20:28.852092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4272/5264] 10.222.0.49 () {58 vars in 1140 bytes} [Wed Aug 24 02:20:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 02:20:28.862121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fd201f3-fed5-425d-b07d-b3ad44277aeb tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004773 Aug 24 02:20:28.866793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4273/5265] 10.222.0.49 () {58 vars in 1137 bytes} [Wed Aug 24 02:20:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 02:20:28.874375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d467fea4-cbe6-45fd-86f6-846bd1224aab tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Calling method '.version_select at 0x7f6b9047f790>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:28.938017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d467fea4-cbe6-45fd-86f6-846bd1224aab tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] HTTP exception thrown: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d467fea4-cbe6-45fd-86f6-846bd1224aab tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/os-volumes/3554936d-7abc-42a1-85df-623876fee851 HTTP/1.1 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3554936d-7abc-42a1-85df-623876fee851'} Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. (HTTP 404) (Request-ID: req-dd6c8c70-e610-4f8d-b687-80c6b8fe8c11) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:20:28.943920 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. Aug 24 02:20:28.947990 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:28.954004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d467fea4-cbe6-45fd-86f6-846bd1224aab tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 404 to user: Volume 3554936d-7abc-42a1-85df-623876fee851 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:28.958699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d467fea4-cbe6-45fd-86f6-846bd1224aab tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/3554936d-7abc-42a1-85df-623876fee851" status: 404 len: 109 microversion: 2.1 time: 0.090917 Aug 24 02:20:28.961842 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4274/5266] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:20:28 2022] DELETE /compute/v2.1/os-volumes/3554936d-7abc-42a1-85df-623876fee851 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:20:28.985450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1ee5623-3d6d-447e-ad3c-a49cf0a25683 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Calling method '.version_select at 0x7f6b904e25e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:29.063124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d1ee5623-3d6d-447e-ad3c-a49cf0a25683 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] HTTP exception thrown: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1ee5623-3d6d-447e-ad3c-a49cf0a25683 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Request method failure captured: Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-volumes/69d637c4-693c-4899-8aae-43519cfd01f1 HTTP/1.1 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYrrVH1xkURvC485t_dFDKpFcHwPUXfCViR390a_y_n7ogvc3P-Lc4OfEP6FbMC79iirc-Jr64UcLZEqRyTn3nhVumoTq-kXI2eNO_4y4PGdMD4_FgrzSWH5uLVIBECtaSCavKL1kqcBi6QKCxW8sULS7vOcdG14DFY1QW0ayz8OC_c Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5702118851db4ac5a46eb215a8a0636e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5702118851db4ac5a46eb215a8a0636e Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-1840452422 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: abb84987bc8d4f79b12b192ff70382c1 Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-1840452422-project Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '69d637c4-693c-4899-8aae-43519cfd01f1'} Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. (HTTP 404) (Request-ID: req-b9993657-46f3-4d93-aa57-47425eac65ae) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:20:29.066412 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1ee5623-3d6d-447e-ad3c-a49cf0a25683 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] Returning 404 to user: Volume 69d637c4-693c-4899-8aae-43519cfd01f1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1ee5623-3d6d-447e-ad3c-a49cf0a25683 tempest-VolumesNegativeTest-1840452422 tempest-VolumesNegativeTest-1840452422-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/69d637c4-693c-4899-8aae-43519cfd01f1" status: 404 len: 109 microversion: 2.1 time: 0.100610 Aug 24 02:20:29.070629 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4275/5267] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:20:28 2022] GET /compute/v2.1/os-volumes/69d637c4-693c-4899-8aae-43519cfd01f1 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:20:29.079906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:29.087695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:29.096857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:29.098176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:29.098837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:29.099762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:29.100429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:29.101198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:29.175285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84885396-9b6d-4c60-b172-241c36ecb04e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103820 Aug 24 02:20:29.179953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4276/5268] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:29 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:30.191556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:30.194755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:30.210904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:30.211607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:30.211857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:30.212582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:30.213085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:30.215341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:30.296522 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07c15146-8460-45fb-adc5-3cf3245d63a7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108834 Aug 24 02:20:30.298011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4277/5269] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:30 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:20:31.309623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:31.312570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:31.332032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:31.332545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:31.333120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:31.344355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:31.344898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:31.345357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:31.444104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9920ad1-eafd-4b1e-a609-91ca2e8576ee tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.138801 Aug 24 02:20:31.453018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4278/5270] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:20:31 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:31.683678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:31.684204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:31.696990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:31.697514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:31.697980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:31.722702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:31.723431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:31.723961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:31.818324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:20:32.052232 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b371db65-8bbc-4e54-a473-c5fe39050bd6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 204 len: 0 microversion: 2.20 time: 0.372966 Aug 24 02:20:32.052899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4279/5271] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:20:31 2022] DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 02:20:32.070294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:32.071096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:32.093079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:32.093593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:32.097937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:32.099405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:32.102502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:32.103439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:32.535511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:32.558598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:32.572044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:32.577000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d07ac162-1bb3-422a-8186-e0ced0090333 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.515037 Aug 24 02:20:32.580691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4280/5272] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:32 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:20:33.616617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:33.628480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:33.658241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:33.668478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:33.671651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:33.673658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:33.676243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:33.677781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:34.545112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:34.563536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:34.565673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:34.575713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e86dbd9-ed91-4682-9bb0-e3c17004f3c5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.965831 Aug 24 02:20:34.576590 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4281/5273] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:33 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:35.603152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:35.603992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:35.625045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:35.633975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:35.634826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:35.643845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:35.645268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:35.646642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:36.158226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:36.188047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:36.198799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:36.203165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cccbc8cd-ac2d-482f-b7f8-79e2f862898a tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1722 microversion: 2.20 time: 0.604844 Aug 24 02:20:36.207406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4282/5274] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:35 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1722 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:36.226124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:36.255982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:36.260937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:36.453616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ee43c579-047e-4fe8-9b9a-5d3aa46c5690 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.244409 Aug 24 02:20:36.459514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4283/5275] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:20:36 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:20:36.470926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:36.472979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:36.487784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:36.491319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:36.492208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:36.494869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:36.496340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:36.497958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:37.055345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:37.071737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0262140-0f7d-4066-82d8-49ffa6c7f8b0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1671 microversion: 2.1 time: 0.610601 Aug 24 02:20:37.077513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4284/5276] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:36 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1671 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:37.240943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:37.241498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:37.257109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:37.257617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:37.258583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:37.265451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:37.267040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:37.267495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:37.441672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:37.464233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:37.467778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:37.476073 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d94c320-a862-45fe-a13c-0d7d9f051613 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1654 microversion: 2.20 time: 0.239096 Aug 24 02:20:37.478836 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4285/5277] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:37 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1654 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:37.833109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0906a9-e31a-43da-8d82-b60ae4a9c4ae", "name": "network-vif-deleted", "tag": "9b2296fe-4c72-4643-b6e0-36f91a87ca35"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:37.898202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:37.903284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:37.905203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:37.971400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] Creating event network-vif-deleted:9b2296fe-4c72-4643-b6e0-36f91a87ca35 for instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae on n-h1-854121-3 Aug 24 02:20:37.996232 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-af7a39a4-0ddc-4417-885c-2c7c53c7a864 req-a696d642-4ded-443b-803a-5df6fd22c1dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175562 Aug 24 02:20:37.999010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4286/5278] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:20:38.106319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:38.107486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:38.138974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:38.139531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:38.142250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:38.147179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:38.147742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:38.148204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:38.706883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:38.735682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-485120f0-94c0-4ca7-8fb3-9b7454f8591d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1671 microversion: 2.1 time: 0.638834 Aug 24 02:20:38.752162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4287/5279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:38 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1671 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:38.757556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:38.761086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:38.775291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:38.785996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:38.786893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:38.790120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:38.792149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:38.793711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:38.921694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:38.933888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:38.938187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:38.939561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lazy-loading 'fault' on Instance uuid fe0906a9-e31a-43da-8d82-b60ae4a9c4ae {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:20:39.111085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:39.130292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:39.141196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:39.142796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1856e48a-0831-4322-a763-5d1c0979ab1c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 200 len: 1370 microversion: 2.20 time: 0.389187 Aug 24 02:20:39.146502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4288/5280] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:38 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:39.760097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:39.760925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:39.773044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:39.780653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:39.784585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:39.786353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:39.787733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:39.789247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:40.469134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:40.491096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39ed037e-6e86-4cfd-95c0-377b643e4216 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.735355 Aug 24 02:20:40.520518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4289/5281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:39 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:40.532437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:40.555468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:40.582189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:40.582735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:40.583188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:40.584071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:40.584565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:40.609755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:40.653119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:40.686444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae HTTP/1.1 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fe0906a9-e31a-43da-8d82-b60ae4a9c4ae'} Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:40.691442 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:40.696273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:40.697786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae56853f-269b-4359-89ee-f33ddb136253 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 404 len: 111 microversion: 2.20 time: 0.171276 Aug 24 02:20:40.699077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4290/5282] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:40 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:20:40.715307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81cd2ec2-6226-437b-9fd9-5e5907bf7cfa tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '.version_select at 0x7f6b90498dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:40.760897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81cd2ec2-6226-437b-9fd9-5e5907bf7cfa tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894869779" status: 204 len: 0 microversion: 2.20 time: 0.054559 Aug 24 02:20:40.762294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4291/5283] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 02:20:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894869779 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:20:42.422958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b6f9c42-ebb5-4f8d-a4f8-57de67efd3b1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: .version_select at 0x7f6b904404c0>, body: {"keypair": {"name": "tempest-keypair-875903123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHw4UFMe4UXc0Vdu7P83Oqm+tSuZf/CUk8A/1JDSaqU+PJnCz7SvAr/7+NZvK1Q1SNSXAA9eWu4D1nt8OBY4w92zMYsR49tfXM+zDm2ZG/ZutpQIoBjvi3XBoNzkVZiIA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:42.476331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0b6f9c42-ebb5-4f8d-a4f8-57de67efd3b1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:20:42.491479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0b6f9c42-ebb5-4f8d-a4f8-57de67efd3b1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for user cd03ebf2c9274253a3e3bbb58ff122ef and project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:20:42.568822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b6f9c42-ebb5-4f8d-a4f8-57de67efd3b1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.152157 Aug 24 02:20:42.570933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4292/5284] 10.222.0.49 () {62 vars in 1200 bytes} [Wed Aug 24 02:20:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 157 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 02:20:44.032016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:44.032693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:44.045849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:44.046425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:44.046874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:44.047806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:44.048474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:44.049089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:44.081923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:20:44.251944 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-547fc0bf-6ec9-446a-a26d-52e9f07f3883 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 204 len: 0 microversion: 2.1 time: 0.227635 Aug 24 02:20:44.254068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4293/5285] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:20:44 2022] DELETE /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:20:44.264748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:44.265816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:44.274152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:44.274998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:44.275722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:44.276806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:44.277700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:44.278462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:45.042181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:45.053842 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f633396e-cce3-4c89-8a67-ea245c3d4daf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1410 microversion: 2.1 time: 0.795502 Aug 24 02:20:45.061442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4294/5286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:44 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1410 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:46.084435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:46.085084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:46.103889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:46.109158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:46.109826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:46.111525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:46.114085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:46.114725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:46.640021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:46.657476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-308aa91c-b75e-419a-9497-5799e7ff29aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1410 microversion: 2.1 time: 0.576749 Aug 24 02:20:46.658275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4295/5287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:46 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1410 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:46.673649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1216816596", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77dcbd3e-3d75-4775-8a4e-f6a7216de9e2"}], "security_groups": [{"name": "tempest-securitygroup--329178864"}], "key_name": "tempest-keypair-875903123", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:47.005764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] validate_networks() for [('77dcbd3e-3d75-4775-8a4e-f6a7216de9e2', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:20:48.127503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:20:48.128118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:20:48.128409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:20:48.128856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:20:48.129286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:20:48.145595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:48.156749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:48.157442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:48.158438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:48.159076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:48.161287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:48.199530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:48.216622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:20:48.225745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Getting quotas for user cd03ebf2c9274253a3e3bbb58ff122ef and project ecdf582657bf485498c0ed06bc6fe49c. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:20:48.277921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:20:48.280852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:20:48.509898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fbf3634-fc46-4668-a8e5-acc06ca46651 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.848614 Aug 24 02:20:48.510904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4296/5288] 10.222.0.49 () {62 vars in 1188 bytes} [Wed Aug 24 02:20:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 02:20:48.522938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8640068-8e1e-4e2b-a3db-4ed903de0101", "name": "network-vif-deleted", "tag": "b49fc358-d2de-4194-b565-270c99a0c024"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:48.535562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:48.537235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:48.537930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:48.558182 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] Creating event network-vif-deleted:b49fc358-d2de-4194-b565-270c99a0c024 for instance f8640068-8e1e-4e2b-a3db-4ed903de0101 on n-h1-854121-3 Aug 24 02:20:48.567216 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-76a11901-5c6a-46a4-a9fb-115d9823e56d req-b51afaa0-7400-4964-a88a-f1d38757fb1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054070 Aug 24 02:20:48.569196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4297/5289] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:20:48.579723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:48.581102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:48.612029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:48.616000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:48.617828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:48.618626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:48.624188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:48.627236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:48.919764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:48.937825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9a5b9d6-5be3-4de8-b0ba-2dc6cbe8ee6e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.366460 Aug 24 02:20:48.941576 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4298/5290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:48 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:48.947093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:48.947734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:49.110578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:49.125416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:49.128429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:49.134711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1e641db-2ca8-409d-a6e7-c17b31ec1fc9 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1281 microversion: 2.20 time: 0.190853 Aug 24 02:20:49.137182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4299/5291] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:48 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:49.963187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:49.964068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:49.996068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:49.996592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:49.997117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:49.998214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:49.998891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:49.999548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:50.286878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:50.318084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a724b6bb-706d-4ae5-bc32-996fd7b1c3e2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.355494 Aug 24 02:20:50.322238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4300/5292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:49 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:50.347985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:50.358034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:50.391489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:50.392240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:50.394231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:50.398150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:50.399860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:50.400351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:50.701010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:50.720143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:50.722800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:50.730239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4878e92a-cda0-4252-9cf6-abad79a416db tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1333 microversion: 2.20 time: 0.393257 Aug 24 02:20:50.744421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4301/5293] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:50 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1333 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:51.346852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:51.347516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:51.356391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:51.356940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:51.357400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:51.358134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:51.358605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:51.359048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:51.859711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:51.870821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f86e5895-5169-458f-8cd7-aa807489e80a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.528354 Aug 24 02:20:51.873152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4302/5294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:51 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:51.888701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:51.889943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:51.901022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:51.904491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:51.909639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:51.910827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:51.911533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:51.912216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:52.048608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:52.057995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:52.067810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:52.072033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3278882-9194-4caa-b9b1-ff799c207ab1 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1339 microversion: 2.20 time: 0.197611 Aug 24 02:20:52.074113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4303/5295] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:51 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:52.898138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:52.900088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:52.923174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:52.924126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:52.926530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:52.927534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:52.929319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:52.931402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:53.105773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:53.117022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3036b874-38b7-405b-96a7-ed884eba9366 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.223974 Aug 24 02:20:53.119414 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4304/5296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:52 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:53.140843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:53.154931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:53.176486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:53.177338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:53.177971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:53.181011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:53.181866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:53.183509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:53.889440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:53.902161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:53.903762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:53.907064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7dbaaceb-ecc7-4152-abf2-894dff07777c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.772597 Aug 24 02:20:53.911444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4305/5297] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:53 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:54.146615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:54.147512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:54.166245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:54.166783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:54.167246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:54.167996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:54.172507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:54.173456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:54.429354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:54.449213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41f6e383-bc6f-43a3-bfef-c589d55e8a73 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.306664 Aug 24 02:20:54.452339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4306/5298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:54 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:54.550575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:20:54.571442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:54.572262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:54.582543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:54.615924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] Creating event network-changed:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:20:54.627563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ab902aea-9f58-4713-9f48-368c504c2a67 req-3181e10f-08b3-4955-b6fe-5ac94514d68a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084266 Aug 24 02:20:54.628173 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4307/5299] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:20:54.931236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:54.932998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:54.980338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:54.980932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:54.981443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:54.982192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:54.982670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:54.983109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:55.280057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:55.298879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:55.300402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:55.301913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adebc986-322f-40f0-be38-d811ebf7f0fb tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.376053 Aug 24 02:20:55.302844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4308/5300] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:54 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:20:55.471741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:55.472966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:55.487517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:55.490749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:55.493575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:55.494658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:55.495215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:55.500741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:55.627634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:55.641293 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05866daa-ce84-44de-918b-7a68816c13aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.171607 Aug 24 02:20:55.641894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4309/5301] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:55 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:20:56.329538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:56.330627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:56.338216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:56.338947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:56.339596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:56.341424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:56.342536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:56.343223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:56.588282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:56.592653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:56.611143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:56.612439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:56.613630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a31d8ae-492a-4c3d-bb44-28f3d796f47b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.288631 Aug 24 02:20:56.625075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4310/5302] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:56 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:20:56.662948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:56.662948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:56.675110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:56.675629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:56.676105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:56.676833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:56.677302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:56.677746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:56.823953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:56.836953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc6a7ab2-e944-4afd-b2bf-8b3eb38983f4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 200 len: 1202 microversion: 2.1 time: 0.178533 Aug 24 02:20:56.838044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4311/5303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:56 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:20:57.635821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:57.637931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:57.653326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:57.653911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:57.654389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:57.655899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:57.657413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:57.658093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:57.955754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:57.967239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:57.968824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:57.970231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66108d1c-804d-4cdd-b42e-dc70883d972c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.338610 Aug 24 02:20:57.971653 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4312/5304] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:57 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:20:57.977077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:57.977911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:57.984637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:57.985445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:57.986119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:57.987163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:57.987910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:57.988569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:58.005179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 HTTP/1.1 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f8640068-8e1e-4e2b-a3db-4ed903de0101'} Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:20:58.007504 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:20:58.011461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:20:58.013953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:20:58.015315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1f1dc80-ba24-4ca0-b21e-ca029569a22d tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 404 len: 111 microversion: 2.1 time: 0.042480 Aug 24 02:20:58.016115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4313/5305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:20:57 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:20:58.999442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:20:59.000229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:20:59.003831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:59.023745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:59.024488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:59.025119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:59.027282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:20:59.029467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:20:59.029949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:20:59.120954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:20:59.389140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:59.401349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:59.406394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:20:59.409687 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c449f00-5cb1-4434-bc29-43ec3777286f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.414688 Aug 24 02:20:59.413094 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4314/5306] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:20:58 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:21:00.439121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:00.440884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:00.448852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:00.449548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:00.450322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:00.451336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:00.451988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:00.452619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:00.724448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:00.737622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:00.739484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:00.748152 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea2e8bef-7f2b-457d-9611-846037528e15 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.313928 Aug 24 02:21:00.749017 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4315/5307] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:21:00 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:21:00.813045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "name": "network-vif-plugged", "status": "completed", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:21:00.838616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:00.839131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:00.839585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:00.865172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] Creating event network-vif-plugged:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:21:00.874922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-03c2fda2-1e3e-4e58-a3d9-209eaaf428ac req-2f2722b1-94ec-4ad8-bd4a-c6afe8238605 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065395 Aug 24 02:21:00.875952 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4316/5308] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:21:01.779281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:01.781417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:01.794699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:01.795534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:01.796347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:01.797588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:01.798397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:01.799572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:01.996002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:02.007691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:02.009545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:02.012029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b033b6b2-dd33-4228-a9c3-8c4a20864d1e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1406 microversion: 2.20 time: 0.241096 Aug 24 02:21:02.013006 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4317/5309] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:21:01 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:21:03.036795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:03.038549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:03.048867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:03.050814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:03.051310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:03.052306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:03.052819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:03.053446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:03.223817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:03.256575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:03.259620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:03.261526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc9feaf8-b812-4d5b-a59e-7f5c633a960d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1597 microversion: 2.20 time: 0.229402 Aug 24 02:21:03.263346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4318/5310] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:21:03 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1597 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:21:03.292757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:03.294710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:03.306511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:03.307032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:03.307607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:03.308371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:03.308881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:03.310230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:03.422171 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed0c7a63-2ae5-48dd-b414-7bb90740e484 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.139391 Aug 24 02:21:03.429716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4319/5311] 10.222.0.49 () {60 vars in 1316 bytes} [Wed Aug 24 02:21:03 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:21:05.816313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:21:05.842985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:05.843498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:05.843959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:05.872432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] Creating event network-changed:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:21:05.879877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7d4e36ec-a3e4-44d4-ae23-f87f72dd5a06 req-8ba483f3-3390-4773-ad4c-ab636c0c40e6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068071 Aug 24 02:21:05.881312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4320/5312] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:21:09.157718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:09.160267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:09.177089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:09.183302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:09.184650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:09.187634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:09.188315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:09.188997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:09.209179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 HTTP/1.1 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9d584280-e7ec-4d65-8063-d366fd0bca13'} Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:21:09.211610 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.215447 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.217190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:21:09.218699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c2f528c-e42b-433a-b577-4dfedff5ac07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 404 len: 111 microversion: 2.1 time: 0.066352 Aug 24 02:21:09.219275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4321/5313] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:21:09 2022] DELETE /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:21:09.232432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:09.233274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: 9d584280-e7ec-4d65-8063-d366fd0bca13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:09.242875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:09.243775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:09.244421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:09.245387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:09.246036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:09.247215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:09.264321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 HTTP/1.1 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9d584280-e7ec-4d65-8063-d366fd0bca13'} Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:09.266413 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. Aug 24 02:21:09.271051 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:09.272978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance 9d584280-e7ec-4d65-8063-d366fd0bca13 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:21:09.274228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2053951-13b8-4b55-9e59-d92be146860c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13" status: 404 len: 111 microversion: 2.1 time: 0.050162 Aug 24 02:21:09.275277 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4322/5314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:09 2022] GET /compute/v2.1/servers/9d584280-e7ec-4d65-8063-d366fd0bca13 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:21:10.747856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:10.751709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:10.759142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:10.759649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:10.760103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:10.775143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:10.775658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:10.776140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:10.826447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 HTTP/1.1 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f8640068-8e1e-4e2b-a3db-4ed903de0101'} Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:21:10.834574 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.838970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:21:10.840587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b1fa34d-997b-406e-b8d1-fcca31e638c6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 404 len: 111 microversion: 2.1 time: 0.099840 Aug 24 02:21:10.841105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4323/5315] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:21:10 2022] DELETE /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:21:10.852792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:10.857802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: f8640068-8e1e-4e2b-a3db-4ed903de0101] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:10.864488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:10.865383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:10.866042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:10.867013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:10.867723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:10.868380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:10.888975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 HTTP/1.1 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f8640068-8e1e-4e2b-a3db-4ed903de0101'} Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:21:10.891874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance f8640068-8e1e-4e2b-a3db-4ed903de0101 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1120f3d0-0b9d-4eb5-b7bf-d26a4a9745c5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101" status: 404 len: 111 microversion: 2.1 time: 0.046421 Aug 24 02:21:10.900657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4324/5316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:10 2022] GET /compute/v2.1/servers/f8640068-8e1e-4e2b-a3db-4ed903de0101 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:21:11.033600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9af88047-d729-4c0f-bba4-be5d2bb230ac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: .version_select at 0x7f6b9125a310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-716469685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/2qnQAjn/N9sRNYoCR2KjLLn9fN8vL/YuSAE4oBQGsis+A5G1ykXfQflgeKmWCjEs3mYa2nzSr1MBIrYzvhhmyDC9waRa+Gs3Zu71hUsrNSjVuDJoZxaqOymOC/VvKTg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:21:11.067072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9af88047-d729-4c0f-bba4-be5d2bb230ac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:21:11.082703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9af88047-d729-4c0f-bba4-be5d2bb230ac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:21:11.125785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9af88047-d729-4c0f-bba4-be5d2bb230ac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.096481 Aug 24 02:21:11.135105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4325/5317] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:21:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:21:43.635306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:43.636469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:43.658558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=54 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:21:43.661340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:21:43.672058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:21:43.680922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:43.683371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:43.685774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:43.686607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:43.687125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:43.687598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:43.904299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:43.917484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7901040b-afaa-4456-a8a2-bd969a156cff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.285918 Aug 24 02:21:43.919313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4326/5318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:43 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:21:43.945754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:43.946849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:43.956943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:43.957899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:43.958612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:43.959798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:43.960976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:43.972046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:44.458056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:44.489995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8134b54-fb8f-430f-90fc-b913cb8b4181 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.548996 Aug 24 02:21:44.490861 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4327/5319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:43 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:44.522294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:44.523209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:44.534799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:44.535330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:44.535790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:44.536816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:44.538767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:44.540298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:44.961216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:44.977705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3458c36e-78a3-4bba-9b73-60cf744c499d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.460437 Aug 24 02:21:44.978353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4328/5320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:45.003319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:45.003960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:45.016336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:45.017002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:45.017475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:45.018241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:45.018717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:45.030015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:45.573980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:45.589178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5bf98bd3-7b56-4cb6-b1ca-dacc610734d1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.589785 Aug 24 02:21:45.609137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4329/5321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:21:45.872632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1088780213", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "62fe4463-9689-4fd8-807d-9686124a81d4"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:21:45.996575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] validate_networks() for [('62fe4463-9689-4fd8-807d-9686124a81d4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:21:47.151174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:21:47.151857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:21:47.152553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:21:47.153112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:21:47.154334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:21:47.193145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:47.200082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:47.201970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:47.203472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:47.209587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:47.210184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:47.286409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:21:47.301600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:21:47.344353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:21:47.351677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:21:47.481352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26b88247-36d6-4839-88da-8bfe7ae793c4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.612949 Aug 24 02:21:47.484128 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4330/5322] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:21:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:21:47.538188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5d87fa0-12de-4c14-bd85-20f8aa56862d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:47.544434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5d87fa0-12de-4c14-bd85-20f8aa56862d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:47.741010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5d87fa0-12de-4c14-bd85-20f8aa56862d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:47.751214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5d87fa0-12de-4c14-bd85-20f8aa56862d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1215 microversion: 2.1 time: 0.251135 Aug 24 02:21:47.769374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4331/5323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:47 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1215 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:48.773016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a24b2e6-2a82-4e24-a194-25e1bf2a407d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:48.773662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a24b2e6-2a82-4e24-a194-25e1bf2a407d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:48.927342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a24b2e6-2a82-4e24-a194-25e1bf2a407d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:48.937416 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a24b2e6-2a82-4e24-a194-25e1bf2a407d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1215 microversion: 2.1 time: 0.168339 Aug 24 02:21:48.944894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4332/5324] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:48 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1215 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:21:49.964633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ece15f4-c679-43b6-9a38-d1403e2b8361 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:49.966183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ece15f4-c679-43b6-9a38-d1403e2b8361 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:50.124884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ece15f4-c679-43b6-9a38-d1403e2b8361 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:50.134306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ece15f4-c679-43b6-9a38-d1403e2b8361 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1215 microversion: 2.1 time: 0.176276 Aug 24 02:21:50.150756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4333/5325] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:49 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:51.156754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02a3a1f0-ca2c-4396-865d-48a8760ad853 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:51.157408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02a3a1f0-ca2c-4396-865d-48a8760ad853 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:51.367654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02a3a1f0-ca2c-4396-865d-48a8760ad853 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:51.380070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02a3a1f0-ca2c-4396-865d-48a8760ad853 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1215 microversion: 2.1 time: 0.227497 Aug 24 02:21:51.391760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4334/5326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:51 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:52.404787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:52.406198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:52.415375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:52.417649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:52.418408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:52.419682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:52.420445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:52.421570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:52.560575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:52.575863 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8fd441b-f54f-4a56-a741-a097ded82651 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1219 microversion: 2.1 time: 0.173403 Aug 24 02:21:52.578910 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4335/5327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:52 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1219 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:21:53.609366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:53.610012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:53.633510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:53.639986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:53.640694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:53.644114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:53.644825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:53.645469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:54.084265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:54.093547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50b526ed-3983-45a0-8d6c-7784a4e1e3b8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1275 microversion: 2.1 time: 0.497913 Aug 24 02:21:54.097514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4336/5328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:53 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1275 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:55.124265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:55.125910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:55.139107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:55.139816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:55.140433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:55.152595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:55.153428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:55.154039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:55.395666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:55.413504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8792677a-1844-434d-8e9d-4d0d733554a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1273 microversion: 2.1 time: 0.294311 Aug 24 02:21:55.417559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4337/5329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:55 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:56.436123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:56.436957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:56.490857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:56.494333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:56.497408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:56.501259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:56.502375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:56.504296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:57.240217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:21:57.292346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:57.302324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f482c603-47bb-439a-91a3-2adc37de65fb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 0.869496 Aug 24 02:21:57.304575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4338/5330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:56 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:21:58.260836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e455b0-b9f4-42cd-9670-eed2f4e27d86", "tag": "dc8fbfac-f0a7-45f4-b6f0-778a2086b32c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:21:58.281867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:58.282400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:58.282862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:58.311775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] Creating event network-changed:dc8fbfac-f0a7-45f4-b6f0-778a2086b32c for instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 on n-h1-854121-3 Aug 24 02:21:58.320131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77b2e2fa-1851-40d9-970b-8e0c6c035e05 req-ff5254b6-8d42-41ec-b275-cfef0b85f04a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063677 Aug 24 02:21:58.322193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4339/5331] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:21:58.338818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:21:58.339477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:21:58.352587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:58.353139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:58.353742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:58.355316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:21:58.359688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:21:58.360426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:21:59.125992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:21:59.157497 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a775bf99-d63a-4e5b-8e31-bcb1e1c9621a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 0.833687 Aug 24 02:21:59.158213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4340/5332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:21:58 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:00.187660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:00.193398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:00.227604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:00.227604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:00.230374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:00.232079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:00.237795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:00.238263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:00.968101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:00.976204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-975e44f8-8561-4e40-a767-43218953accd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 0.801006 Aug 24 02:22:00.989229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4341/5333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:00 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:00.994883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1379803604", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716469685", "security_groups": [{"name": "tempest-secgroup-smoke-1480869671"}], "block_device_mapping_v2": [{"uuid": "4f7dc634-efdc-46ce-8db1-9b15ea4b7061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:01.373207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:01.417139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:22:03.068795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:22:03.069602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:22:03.071199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:22:03.071199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:22:03.071199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:22:03.091958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:03.098094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:03.107591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:03.108745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:03.109397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:03.111026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:03.153450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:22:03.161608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:22:03.304081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:22:03.311588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f7dc634-efdc-46ce-8db1-9b15ea4b7061',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:22:03.687973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a77d0f4c-98f2-4995-b8f3-086be4db484e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.697273 Aug 24 02:22:03.688657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4342/5334] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:22:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:22:03.695403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:03.697145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:03.712781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:03.714756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:03.715569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:03.717781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:03.719218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:03.720476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:04.872948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:04.889329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad469d9f-08bb-43e6-9924-9f42771fa7d0 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 1.199241 Aug 24 02:22:04.898696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4343/5335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:03 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:04.903825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0250efd8-c16c-40a7-a3b6-a21e8fe4be9a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:04.907016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0250efd8-c16c-40a7-a3b6-a21e8fe4be9a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:05.081451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0250efd8-c16c-40a7-a3b6-a21e8fe4be9a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:05.092050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0250efd8-c16c-40a7-a3b6-a21e8fe4be9a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1094 microversion: 2.1 time: 0.191933 Aug 24 02:22:05.098544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4344/5336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:04 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1094 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:05.799049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e455b0-b9f4-42cd-9670-eed2f4e27d86", "name": "network-vif-plugged", "status": "completed", "tag": "dc8fbfac-f0a7-45f4-b6f0-778a2086b32c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:05.823668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:05.824405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:05.825231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:05.852504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] Creating event network-vif-plugged:dc8fbfac-f0a7-45f4-b6f0-778a2086b32c for instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 on n-h1-854121-3 Aug 24 02:22:05.861126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bb6a21a9-ccc4-4f70-a3ae-93edda40739a req-6a1e4e11-50a4-4d42-9201-6464cba82ec6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066115 Aug 24 02:22:05.863660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4345/5337] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:22:05.922308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:05.924125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:05.940857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:05.941776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:05.942411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:05.943817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:05.961813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:05.962527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:06.337088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:06.351048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1702eec1-4b9c-488e-8ef5-a12b32ccd350 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 0.434529 Aug 24 02:22:06.365295 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4346/5338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:05 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:06.386361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:06.387509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:06.396596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:06.413382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:06.413900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:06.414947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:06.430841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:06.431349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:06.643959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:06.663513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2373cb14-97d8-425f-abca-4d4dd9352e36 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1200 microversion: 2.1 time: 0.293049 Aug 24 02:22:06.668377 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4347/5339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:06 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1200 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:07.372590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:07.373310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:07.414878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:07.415692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:07.416963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:07.417940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:07.420672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:07.421408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:07.829184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:07.840941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-475d7994-860d-4bb2-88ba-1d0ac3fff42e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1315 microversion: 2.1 time: 0.472480 Aug 24 02:22:07.855818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4348/5340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:07 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:07.861297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:07.862108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:07.870755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:07.871539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:07.872167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:07.873336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:07.873970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:07.874592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:08.166921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:08.185120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2890e14d-296d-4441-a4fd-011fe919b4a0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1210 microversion: 2.1 time: 0.323388 Aug 24 02:22:08.185749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4349/5341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:07 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1210 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:08.867685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:08.869602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:08.908929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:08.913841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:08.914580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:08.919990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:08.926047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:08.934041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:08.945745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:09.462439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:09.473748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37fc81ce-5d70-4333-a38d-4f74c88ab9a5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1501 microversion: 2.1 time: 0.613368 Aug 24 02:22:09.476953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4350/5342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:08 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1501 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:09.497049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:09.497706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:09.524616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:09.525695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:09.526159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:09.526893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:09.527361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:09.527802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:10.031854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:10.055585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-328f372d-c8ec-4935-9b9a-256e377e973a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.577109 Aug 24 02:22:10.056593 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4351/5343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:09 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:10.067275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:10.067834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:10.084709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:10.085166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:10.085615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:10.091048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:10.093804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:10.094473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:10.387601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Removing security group 87fee3fa-dab1-4b5d-8e9c-0192ab5597b3 from port dc8fbfac-f0a7-45f4-b6f0-778a2086b32c Aug 24 02:22:11.125699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6be6603-2e41-468a-a79d-605b6099208f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86/action" status: 202 len: 0 microversion: 2.1 time: 1.066528 Aug 24 02:22:11.127293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4352/5344] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:22:10 2022] POST /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86/action => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:22:11.616959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36351fd-229e-4c1e-9074-4ad4cd5fcaac", "tag": "35339885-684f-4a23-ba58-54568d3329e8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:11.641191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:11.641709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:11.644772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:11.674925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] Creating event network-changed:35339885-684f-4a23-ba58-54568d3329e8 for instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac on n-h2-854121-3 Aug 24 02:22:11.683133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-874a64d0-da25-4c12-a6cb-3d88beeb2382 req-00ce3a2c-fa31-4732-8c48-5696ca123357 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.554339 Aug 24 02:22:11.690279 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4353/5345] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:11.695789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:11.696510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:11.715736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:11.716617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:11.717283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:11.718209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:11.726641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:11.727631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:12.649688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:12.669432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4d9923a-cd41-4188-bcd3-43f41d773bd5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.976674 Aug 24 02:22:12.670440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4354/5346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:11 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:12.681124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:12.684908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:12.704245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:12.707012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:12.707786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:12.708601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:12.710325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:12.711330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:12.712098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:12.856212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:12.867976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6892c10-6701-47a1-ba6a-2bfdfb5acd1f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1459 microversion: 2.1 time: 0.196040 Aug 24 02:22:12.871974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4355/5347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:12 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1459 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:12.877024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00e455b0-b9f4-42cd-9670-eed2f4e27d86", "tag": "dc8fbfac-f0a7-45f4-b6f0-778a2086b32c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:12.903471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:12.908248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:12.908906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:12.943714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] Creating event network-changed:dc8fbfac-f0a7-45f4-b6f0-778a2086b32c for instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 on n-h1-854121-3 Aug 24 02:22:12.959460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ea9ed656-36b2-46dc-85e5-88d01c7c91fd req-4cbf04f9-8b88-429d-9b5a-8b3109076314 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086039 Aug 24 02:22:12.970979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4356/5348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:12.987698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:12.988432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:13.030095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.030610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.031073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:13.031811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.032283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.032745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:13.143863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:13.404946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:13.418244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6481cb90-0d74-49fb-8258-753cb52b169d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.443225 Aug 24 02:22:13.419082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4357/5349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:12 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:13.449723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:13.450625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:13.460109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.467440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.468484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:13.469488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.470189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.470840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:13.937502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:13.952461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-486911e4-f172-4737-84fe-97682b34974f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.504942 Aug 24 02:22:13.953159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4358/5350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:13 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:13.963602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:13.969333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:13.982852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.983384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.983846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:13.984579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:13.985088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:13.989884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:14.505412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:14.517463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88e4feaf-dc5e-4ec5-b837-b61b50b1dcf1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.562367 Aug 24 02:22:14.518770 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4359/5351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:13 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:14.523689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:14.524568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:14.531663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:14.532450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:14.533200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:14.534192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:14.534901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:14.535584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:14.775939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:14.806285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6e957f1-5b54-4256-971b-357433b4502e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.278148 Aug 24 02:22:14.807569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4360/5352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:14 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:14.829320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:14.835957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:14.852459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:14.855494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:14.856202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:14.858344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:14.860022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:14.860772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:15.092935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:15.119911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:15.142361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d073700-fcff-4887-8151-3b5acedc8ba4 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.316218 Aug 24 02:22:15.142967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4361/5353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:14 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:15.283706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1675703882", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "62fe4463-9689-4fd8-807d-9686124a81d4"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:15.384161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] validate_networks() for [('62fe4463-9689-4fd8-807d-9686124a81d4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:22:16.012225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:22:16.013129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:22:16.013727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:22:16.014252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:22:16.014777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:22:16.026078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:16.026707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:16.027260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:16.028103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:16.028806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:16.029438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:16.050835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:22:16.059450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Getting quotas for user edaba266e8b3458984461dcfed847166 and project 47c1c958062b4286b2a50983aa87e606. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:22:16.076981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:22:16.085127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:22:16.178790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76e66eea-3ca6-4ed1-a3ad-7c043779cc30 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896624 Aug 24 02:22:16.185276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4362/5354] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:22:16.191840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:16.195608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:16.222724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:16.226529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:16.237668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:16.240766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:16.242010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:16.243257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:16.541996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:16.558399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b94fb6e1-aae9-4009-8c1b-04d8ffe948e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.376747 Aug 24 02:22:16.562733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4363/5355] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:16 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:16.579321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5715ad53-a70d-4bed-9156-acfea965b674 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:16.597591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5715ad53-a70d-4bed-9156-acfea965b674 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:16.741107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5715ad53-a70d-4bed-9156-acfea965b674 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:16.752257 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5715ad53-a70d-4bed-9156-acfea965b674 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1215 microversion: 2.1 time: 0.188151 Aug 24 02:22:16.752878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4364/5356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:16 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:17.583665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:17.584315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:17.601308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:17.602058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:17.602798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:17.616495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:17.625441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:17.627824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:17.931963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:17.943238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6df49cd-60b1-4d74-b654-88832763c7a9 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.363587 Aug 24 02:22:17.983384 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4365/5357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:17 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:18.011756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:18.013709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:18.039659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:18.040168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:18.040656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:18.041420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:18.041887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:18.042327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:18.179490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:18.196597 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-addf4ad9-3ba5-41c0-bd9f-7f1e2c9e849a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1267 microversion: 2.1 time: 0.209850 Aug 24 02:22:18.202060 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4366/5358] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:17 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:18.977692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:18.979413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:18.998696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:19.001289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:19.002030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:19.010138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:19.010764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:19.011327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:19.507700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:19.518994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35712b9c-9a5a-4fcd-80e9-7ec651c04abc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.551137 Aug 24 02:22:19.521772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4367/5359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:18 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:19.527370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:19.528260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:19.545542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:19.546061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:19.546518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:19.547248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:19.547717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:19.548158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:20.151730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:20.172436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a4528ee-2913-4d9d-99c1-edc9486ec4d5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.649316 Aug 24 02:22:20.177343 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4368/5360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:19 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:20.193589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:20.194791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:20.220297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:20.222953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:20.224848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:20.226948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:20.230409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:20.230980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:20.299872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7ed8b22-7e89-4793-b1c1-059f99ff4e0e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/ips" status: 200 len: 151 microversion: 2.20 time: 0.120923 Aug 24 02:22:20.300474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4369/5361] 10.222.0.49 () {60 vars in 1289 bytes} [Wed Aug 24 02:22:20 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/ips => generated 151 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:22:20.541071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:20.541860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:20.561508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:20.562336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:20.569354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:20.571082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:20.573076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:20.574692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:20.644952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:21.548331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:21.575433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fac3ce2b-8cf2-4738-836a-32df8b6caaab tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 1.031578 Aug 24 02:22:21.579306 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4370/5362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:20 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:21.605481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:21.607917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:21.630344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:21.631147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:21.631878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:21.633107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:21.634158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:21.636498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:22.170087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:22.216032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35c10266-6aff-4705-939c-a2865878d625 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.626273 Aug 24 02:22:22.219686 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4371/5363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:21 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:22.767728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42c33-168f-4856-a6a6-9ea375ba92e5", "tag": "474addcc-5215-44b7-ac64-a82256b8786b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:22.786736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:22.789502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:22.791241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:22.824395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] Creating event network-changed:474addcc-5215-44b7-ac64-a82256b8786b for instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 on n-h1-854121-3 Aug 24 02:22:22.846953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-964d693f-2907-4026-82c3-e388571474a7 req-eb080848-4e04-4ae5-a4d5-d6a1d791974f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.435560 Aug 24 02:22:22.850336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4372/5364] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:22.869393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:22.870140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:22.895597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:22.904621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:22.905222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:22.906275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:22.907523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:22.909638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:23.690544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:23.706349 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4a25e29-6d6e-4f80-bad3-fdb807d83903 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1278 microversion: 2.1 time: 0.853581 Aug 24 02:22:23.709442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4373/5365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:22 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1278 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:23.715233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:23.723957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:23.738096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:23.738882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:23.739531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:23.740457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:23.741154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:23.741792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:23.932595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:23.944328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba219864-06e1-483d-a440-5e01dcc9697c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.233549 Aug 24 02:22:23.959196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4374/5366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:23 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:24.730241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:24.731160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:24.738424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:24.738937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:24.739391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:24.740313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:24.741228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:24.741837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.010732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:25.030417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40588cbd-4764-4d49-afb9-ebd30d75c037 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.303542 Aug 24 02:22:25.031068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4375/5367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:24 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:25.037076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:25.037713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:25.051813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.052331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.052818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.053551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.057317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.069598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.402688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:25.417410 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cb88dd4-1c40-4902-ba1b-59fa36edb5f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.384774 Aug 24 02:22:25.418112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4376/5368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:25 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:25.428166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:25.429059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:25.441117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.441927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.442574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.453922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.454530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.455063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.504970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lazy-loading 'flavor' on Instance uuid 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:22:25.874374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb88521f-6f30-4d4c-8e88-5188a6fd0356 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/action" status: 202 len: 0 microversion: 2.20 time: 0.454779 Aug 24 02:22:25.877744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4377/5369] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:22:25 2022] POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:22:25.934970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:25.935993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:25.963914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.965445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.966142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:25.973736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:25.974243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:25.974706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:26.038810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:26.181289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:26.191483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:26.193056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:26.203002 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2026712c-824e-477e-8510-54931c88a84e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.310176 Aug 24 02:22:26.204440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4378/5370] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:25 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:26.210477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:26.211290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:26.219418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:26.220149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:26.220819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:26.221704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:26.222337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:26.222938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:26.745391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:26.822322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:26.835474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b1e4409-5895-4305-af58-f8dcad708158 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.625180 Aug 24 02:22:26.848610 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4379/5371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:26 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:26.848610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:26.848610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:26.849625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:26.850411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:26.851102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:26.852055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:26.853002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:26.853673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:27.233791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:27.245422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c1f81bf-f28b-48ac-b2f0-1c90e7ce1822 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.407896 Aug 24 02:22:27.246021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4380/5372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:26 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:27.250563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:27.251182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:27.274796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:27.275308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:27.275765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:27.276489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:27.276981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:27.277920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:28.144669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:28.159701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:28.165827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:28.172125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4ed23e9-5df1-4f13-b3ff-948b3440d6f4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.920123 Aug 24 02:22:28.177890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4381/5373] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:27 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:28.193269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:28.198727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:28.217705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:28.219196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:28.219857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:28.223038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:28.224403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:28.225273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:29.230358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:29.264224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-196cf25d-ff74-4ac1-9e04-826c9e883dcf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 1.079081 Aug 24 02:22:29.272989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4382/5374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:28 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:29.286449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:29.292366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:29.320637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:29.328000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:29.328561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:29.333407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:29.333986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:29.338151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:29.639031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:29.646688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3abe5683-81a6-49f7-83ff-2e2629b5b0de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.370697 Aug 24 02:22:29.649604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4383/5375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:29 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:29.662176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:29.663029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:29.672650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:29.674490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:29.675118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:29.677548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:29.678196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:29.679123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:30.077349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:30.087564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:30.089121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:30.090340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf51fc09-b32c-4278-a2b9-36f6d902bd82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.439189 Aug 24 02:22:30.095390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4384/5376] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:29 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:30.274283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42c33-168f-4856-a6a6-9ea375ba92e5", "name": "network-vif-plugged", "status": "completed", "tag": "474addcc-5215-44b7-ac64-a82256b8786b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:30.318910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:30.319818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:30.320496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:30.357115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] Creating event network-vif-plugged:474addcc-5215-44b7-ac64-a82256b8786b for instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 on n-h1-854121-3 Aug 24 02:22:30.374138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b408c833-6c73-4917-8b5b-4b01fa0fa6ec req-00464d83-b087-4596-8e40-15e19c69f987 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274618 Aug 24 02:22:30.375050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4385/5377] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:30.393349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:30.397240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:30.460548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:30.463665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:30.468467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:30.474123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:30.475092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:30.479358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:30.571229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:30.971392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:30.981022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1da4093-319f-4bb5-9b01-d288439941c4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.604428 Aug 24 02:22:30.986709 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4386/5378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:30 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:30.996064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:30.998654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:31.016126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:31.018973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:31.019613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:31.020488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:31.023173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:31.023781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:31.513880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:31.536244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f995552a-4208-47e0-b651-ecb5efdab219 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1315 microversion: 2.1 time: 0.548080 Aug 24 02:22:31.545233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4387/5379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:30 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:31.546017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:31.546892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:31.554033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:31.554539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:31.555194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:31.556736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:31.557380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:31.557972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:31.867440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:31.890355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:31.897996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:31.901681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd2ede39-51ed-4001-8157-b5387de28fb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.359499 Aug 24 02:22:31.904634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4388/5380] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:31 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:32.009626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:32.010483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:32.020131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:32.020644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:32.021139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:32.021876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:32.022352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:32.022798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:32.473258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:32.482352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e534369-5b06-4c14-a9ec-490c081066b6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.476992 Aug 24 02:22:32.502450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4389/5381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:32 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:22:32.582147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:32.597516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:32.625131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:32.627378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:32.631594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:32.635328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:32.637968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:32.638951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.103208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:33.117661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1a725d1-a918-419d-b56d-04bb2a935d32 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1501 microversion: 2.1 time: 0.558446 Aug 24 02:22:33.134043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4390/5382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:32 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1501 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:33.140148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:33.142482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:33.156351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.167400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.172023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.174237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.176771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.177482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.553909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:33.566970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:33.581697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:33.584880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1a5d993-d385-4b87-b6ce-a74692799b06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.449234 Aug 24 02:22:33.596593 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4391/5383] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:33 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:33.608843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:33.616066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:33.632901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.639122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.639622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.640382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.640906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.641358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.879806 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3a49751-4782-4813-acce-dcc33ce0f205 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5/action" status: 202 len: 0 microversion: 2.1 time: 0.281595 Aug 24 02:22:33.888710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4392/5384] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:22:33 2022] POST /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:22:33.903608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:33.904587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:33.920973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.921729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.922758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:33.927825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:33.928550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:33.929229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:34.313471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:34.325698 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eba7c8ca-c4d7-47b3-b887-2b3f7b114ede tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.435189 Aug 24 02:22:34.326610 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4393/5385] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:33 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:34.348089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:34.348982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:34.356933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:34.357917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:34.358501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:34.359331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:34.361015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:34.361709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:34.588363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:34.599173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae531342-e554-4f6a-918d-4cfbc4d22a8f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1486 microversion: 2.1 time: 0.256676 Aug 24 02:22:34.600449 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4394/5386] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:34 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1486 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:34.622783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:34.623700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:34.679235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:34.682141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:34.683018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:34.689138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:34.691329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:34.693803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:34.771351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lazy-loading 'flavor' on Instance uuid d4e42c33-168f-4856-a6a6-9ea375ba92e5 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:22:35.183668 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff6b13cd-6244-4171-8624-60d59b4424fc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5/action" status: 202 len: 0 microversion: 2.1 time: 0.565587 Aug 24 02:22:35.187975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4395/5387] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:22:34 2022] POST /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:22:35.194649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:35.195619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:35.204701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:35.205970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:35.207000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:35.208229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:35.208985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:35.209624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:36.003973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:36.034204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:36.037185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:36.038807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9facf31e-9aca-494c-9369-cf04f416e001 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.849023 Aug 24 02:22:36.040169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4396/5388] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:35 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:36.060487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:36.065444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:36.071776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:36.089701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:36.091657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:36.094554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:36.095612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:36.108684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:36.113322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:36.393877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:36.404862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6bc0416-9f92-4c62-a7a3-bb7b8aa25c93 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1492 microversion: 2.1 time: 0.362927 Aug 24 02:22:36.405779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4397/5389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:36 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1492 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:36.420775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:36.423984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:36.435259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:36.441879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:36.442649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:36.443626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:36.444479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:36.445234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:36.737982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:36.752978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fc6b14a-8fed-4d23-8464-527e901195b2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 0.345381 Aug 24 02:22:36.769392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4398/5390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:36 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:37.064295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:37.064964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:37.088973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:37.089753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:37.090372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:37.091123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:37.091967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:37.092088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:37.384744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:37.411936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:37.413515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:37.414768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b7655b5-590c-4c17-8eb5-5ee9b1c48e6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.355626 Aug 24 02:22:37.436461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4399/5391] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:37 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:22:37.452211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36351fd-229e-4c1e-9074-4ad4cd5fcaac", "name": "network-vif-plugged", "status": "completed", "tag": "35339885-684f-4a23-ba58-54568d3329e8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:37.488937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:37.489440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:37.489910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:37.505546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:37.529886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] Creating event network-vif-plugged:35339885-684f-4a23-ba58-54568d3329e8 for instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac on n-h2-854121-3 Aug 24 02:22:37.542977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-285839dd-68b5-43d5-b8f3-d191852cc5f3 req-8c7383ed-93e1-4486-b251-2670aac7c710 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104897 Aug 24 02:22:37.557547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4400/5392] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:37.563265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:37.563985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:37.578305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:37.579109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:37.579787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:37.580999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:37.582644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:37.583752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:37.961075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:37.972696 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c961743c-cdd6-444b-9445-28140527c28b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1513 microversion: 2.1 time: 0.413482 Aug 24 02:22:37.974384 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4401/5393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:37 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:37.995341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:37.996067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:38.013948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:38.014474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:38.015370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:38.016119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:38.016596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:38.023842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:39.143911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:39.156452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ab38de1-b5c2-4564-878b-93dc1d915811 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1266 microversion: 2.1 time: 1.180368 Aug 24 02:22:39.158298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4402/5394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:37 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1266 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:39.173022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:39.173915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:39.186492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:39.187405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:39.196884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:39.199080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:39.199776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:39.206621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:39.854224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:39.870308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:39.877231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:39.880361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d0592e7-54c3-4f6b-b4c2-388020e84be8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.719935 Aug 24 02:22:39.880990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4403/5395] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:39 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:39.909266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:39.909905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:39.952627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:39.956514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:39.961388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:39.962762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:39.968864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:39.972168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:40.838069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:40.858561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bd3a4c2-84d5-45df-a868-a715523456f9 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1513 microversion: 2.1 time: 0.959820 Aug 24 02:22:40.860243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4404/5396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:39 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1513 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:40.868266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:40.884293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:40.898758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:40.908380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:40.910771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:40.913020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:40.917733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:40.918328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:41.609692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:41.627240 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-072f7781-1dbe-4a93-9dfa-9ec3bf92a5a3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1453 microversion: 2.1 time: 0.763405 Aug 24 02:22:41.645675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4405/5397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:40 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1453 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:41.659024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:41.682377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:41.707853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:41.708834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:41.708834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:41.716943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:41.717722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:41.718398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:42.575287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:42.589375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:42.595261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:42.604626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8dc9d115-2f66-4e99-8165-5701783f0f6f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.953948 Aug 24 02:22:42.626191 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4406/5398] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:41 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:42.653089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:42.657093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:42.681674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:42.682439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:42.684601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:42.685696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:42.686377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:42.687582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:43.351940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:43.376167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9d878cd-cc31-40d9-9acf-eefa59fae645 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1453 microversion: 2.1 time: 0.737582 Aug 24 02:22:43.377494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4407/5399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:42 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1453 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:43.389288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:43.392864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:43.421216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:43.422703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:43.424696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:43.430044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:43.436141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:43.438323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:45.119534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:45.148457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa0865bd-f77b-4c71-9867-1ccd3299dbe8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 1.758439 Aug 24 02:22:45.149729 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4408/5400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:43 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:45.182266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:45.183160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:45.211100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:45.213692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:45.218915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:45.219967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:45.220617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:45.221315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:45.975959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:45.996963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:46.002197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:46.003736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ee56a6e-9111-4073-a949-b2a489948ad0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1743 microversion: 2.20 time: 0.847785 Aug 24 02:22:46.009290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4409/5401] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:45 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1743 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:46.021570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42c33-168f-4856-a6a6-9ea375ba92e5", "name": "network-vif-plugged", "status": "completed", "tag": "474addcc-5215-44b7-ac64-a82256b8786b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:46.065854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:46.073157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:46.073691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:46.124986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] Creating event network-vif-plugged:474addcc-5215-44b7-ac64-a82256b8786b for instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 on n-h1-854121-3 Aug 24 02:22:46.150170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-816b256e-718c-46e0-bb6e-b4cc3d5cd785 req-98b25a75-e470-4fdf-bdfb-94bff291e1bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133542 Aug 24 02:22:46.153682 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4410/5402] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:46.180945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:46.182418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:46.223603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:46.250780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:46.251693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:46.252643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:46.255403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:46.255867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:46.873537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:46.899031 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2292fc55-6784-426e-954b-e0404359506b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 0.732081 Aug 24 02:22:46.910578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4411/5403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:46 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:47.040006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:47.041529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:47.077168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:47.080654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:47.081848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:47.086597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:47.089040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:47.092918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:48.290687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:48.303607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:48.306410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:48.314052 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a33abe2e-9e75-471e-ad30-a2fc4a4d3d7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 1.279838 Aug 24 02:22:48.337236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4412/5404] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:47 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:48.347176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:48.347813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:48.361695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:48.362111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:48.363898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:48.365847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:48.367108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:48.368368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:50.215865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:50.230215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbc5302b-4753-4ec3-b9c3-9b7883103bb6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 1.891673 Aug 24 02:22:50.257537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4413/5405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:48 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:50.269395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:50.292943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:50.330885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:50.340668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:50.341577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:50.342577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:50.344023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:50.349255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:51.713779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:51.738654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:51.743434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:51.752657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70ea9d54-caac-4d37-8d48-4a7599b6b62f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 1.489740 Aug 24 02:22:51.765111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4414/5406] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:50 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:51.788976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "name": "network-vif-plugged", "status": "completed", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:51.844845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:51.851899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:51.854310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:51.910800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] Creating event network-vif-plugged:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:22:51.933610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d6ae1276-02c8-48f4-91a4-965689c5a3ac req-a0486d13-26ae-448b-b50b-ed49daa20b1f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166713 Aug 24 02:22:51.941024 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4415/5407] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:51.959370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:51.966233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:52.027985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:52.029045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:52.029820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:52.030867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:52.033866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:52.034628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:53.335977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:53.350040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9addb903-fe66-46e0-aed7-12b9e98b9c07 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 1.405164 Aug 24 02:22:53.356783 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4416/5408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:51 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:53.414893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:53.428243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:53.480171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:53.480171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:53.481681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:53.482853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:53.483343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:53.483794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:55.253422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:55.271582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:55.278809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:55.280349 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7b9948e-868a-4359-997b-2234ecfab133 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 1.895031 Aug 24 02:22:55.285214 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4417/5409] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:53 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:55.304991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:55.306894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:55.315260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:55.319490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:55.330455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:55.331524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:55.332177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:55.332817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:56.962542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:56.985309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:22:57.006334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dc1fd50-ddde-4c02-a1bb-2cbd2704781c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 1.719671 Aug 24 02:22:57.024745 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4418/5410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:55 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:57.031701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:57.046328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:57.062333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:57.071066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:57.071940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:57.073005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:57.076219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:57.077084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:57.884745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:57.907224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:57.921530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:57.926899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0edc2729-9595-4d23-a1dc-8f9256c03cb5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.912117 Aug 24 02:22:57.929409 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4419/5411] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:57 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:22:58.047945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:58.049334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:58.055732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:58.057929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:58.058664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:58.059326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:58.059800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:58.064961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:58.693989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:22:58.705636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80c171c8-e173-455e-bf6f-0e891c7c24cc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 0.670525 Aug 24 02:22:58.706238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4420/5412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:22:58 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:22:58.735915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a36351fd-229e-4c1e-9074-4ad4cd5fcaac", "tag": "35339885-684f-4a23-ba58-54568d3329e8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:22:58.785729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:58.797576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:58.801373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:58.850094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] Creating event network-changed:35339885-684f-4a23-ba58-54568d3329e8 for instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac on n-h2-854121-3 Aug 24 02:22:58.879670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-55fd80d5-a22d-4d43-8fce-84e08efa5dd3 req-12c106ac-75f8-4413-9b66-00993245a019 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145645 Aug 24 02:22:58.881536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4421/5413] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:22:58.953163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:22:58.954434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:22:58.969368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:58.977395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:58.982181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:22:58.988850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:22:58.993354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:22:58.994080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:00.280349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:00.309030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:00.311985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:00.321368 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc43e180-bb22-47db-aa1b-75ad22cb4a06 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 1.372764 Aug 24 02:23:00.328735 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4422/5414] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:22:58 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:23:00.346882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:00.359085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:00.385950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:00.386475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:00.395458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:00.396280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:00.396818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:00.404814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:01.038493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:01.064846 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6671c58-8128-4d3e-a227-bcd9883d975f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 0.724979 Aug 24 02:23:01.071447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4423/5415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:00 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:01.368954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:01.369669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:01.380657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:01.384801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:01.385301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:01.400430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:01.403816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:01.404305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:01.976630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:01.991718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:01.997319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:02.000353 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-264a6d22-606d-4abd-92f5-8fa812c8feb7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.643339 Aug 24 02:23:02.003631 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4424/5416] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:01 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:23:02.105737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:02.106382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:02.122448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:02.123248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:02.124018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:02.125527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:02.137798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:02.138673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:04.361314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:04.411034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc81f61f-ca15-4507-aa8f-a1c362994078 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 2.322047 Aug 24 02:23:04.439584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4425/5417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:02 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:04.458508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:04.462124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:04.486294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:04.491935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:04.493946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:04.494946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:04.496827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:04.498147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:05.086693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:05.096533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:05.098094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:05.111476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f83452b-2021-4edb-a19b-b2fe3b7dd58e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.669251 Aug 24 02:23:05.117397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4426/5418] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:04 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:05.444170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:05.445572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:05.461900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:05.462699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:05.465637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:05.468006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:05.478825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:05.481987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:07.510256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:07.527563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f899d8c-17db-4dcd-ae57-ae3e33ec1783 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 2.082859 Aug 24 02:23:07.531589 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4427/5419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:05 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:07.543799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:07.549982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:07.564086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=61 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:07.574420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:07.575530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:07.576419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:07.582882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:07.584617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:07.587042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:08.298334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:08.317640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:08.323804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:08.332344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f5f79f1-478e-41fb-9101-46799ab4ea29 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.799190 Aug 24 02:23:08.334149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4428/5420] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:07 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:09.068911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:09.070761 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:23:09.070761 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:23:09.072344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:09.074471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:09.075589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:09.077459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:09.078831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:09.083313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:09.190479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f711986b-1ea5-4139-8e32-bb4a56d27fa9 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.854341 Aug 24 02:23:09.191930 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4429/5421] 10.222.0.49 () {58 vars in 1185 bytes} [Wed Aug 24 02:23:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:09.200957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:09.204019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:09.256383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:09.257622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:09.259465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:09.262080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:09.263233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:09.266622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:10.030837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:10.038916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3daf3cd-7133-48da-aab3-2421700033f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1508 microversion: 2.1 time: 0.845623 Aug 24 02:23:10.039509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4430/5422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:09 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1508 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:10.054878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:10.055522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:10.115363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:10.121119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:10.124264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:10.135837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:10.139521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:10.140527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:10.546375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:10.556944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:10.562692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:10.567063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9d03da3-4df3-4582-b849-9a0d3b36934b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.526520 Aug 24 02:23:10.572854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4431/5423] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:10 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:10.577944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2101645314", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "availability_zone": "nova:n-h1-854121-3", "networks": [{"uuid": "e6b311af-0760-47e3-8fb6-504c7d275f94"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:12.877407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] validate_networks() for [('e6b311af-0760-47e3-8fb6-504c7d275f94', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:23:15.593291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:23:15.594871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:23:15.595550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:23:15.596141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:23:15.596816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:23:15.615474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:15.616248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:15.618679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:15.619641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:15.621276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:15.625223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:15.667765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Getting quotas for project a61c46db15544cde9a577e6eebabd877. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:23:15.680027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Getting quotas for user 8b5f13cd00cb4996ac0c134014a58b84 and project a61c46db15544cde9a577e6eebabd877. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:23:15.755029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:23:15.768023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:23:15.898438 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6319d704-22e7-4f20-aa81-49a1ed555028 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.318105 Aug 24 02:23:15.906874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4432/5424] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:23:15.932845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:15.937958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:15.956136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:15.956651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:15.959206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:15.959956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:15.961014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:15.961466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:16.470202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:16.481608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-045ff501-e6b8-4a5a-92d2-d839404936cd tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1505 microversion: 2.1 time: 0.572825 Aug 24 02:23:16.483570 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4433/5425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:15 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1505 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:16.488852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:16.489745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:16.508659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:16.509537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:16.510295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:16.511287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:16.512123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:16.517030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:16.722570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:16.735161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:16.737949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:16.739960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf917e65-863a-4153-bb7f-8f7bfdc88387 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.255095 Aug 24 02:23:16.741055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4434/5426] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:16 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:16.746445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25e73684-1656-4768-bfe1-e26ab6c56a23 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:16.747471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25e73684-1656-4768-bfe1-e26ab6c56a23 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:16.848287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25e73684-1656-4768-bfe1-e26ab6c56a23 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1329 microversion: 2.1 time: 0.098124 Aug 24 02:23:16.848979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4435/5427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:16 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1329 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:16.870179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42c33-168f-4856-a6a6-9ea375ba92e5", "name": "network-vif-unplugged", "status": "completed", "tag": "474addcc-5215-44b7-ac64-a82256b8786b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:16.907337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:16.910638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:16.911961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:16.947520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] Creating event network-vif-unplugged:474addcc-5215-44b7-ac64-a82256b8786b for instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 on n-h1-854121-3 Aug 24 02:23:16.966029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-382c25bd-f041-4335-b836-9f1a33c08619 req-4096d6a0-ae06-4a72-bb4d-61e06a87aef9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107925 Aug 24 02:23:16.969798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4436/5428] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:17.505152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:17.505866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:17.520287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:17.524496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:17.525249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:17.533371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:17.537720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:17.539068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:17.885518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:17.894715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b193673-36eb-4ce8-9a94-4561d3705a9d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1505 microversion: 2.1 time: 0.393640 Aug 24 02:23:17.897279 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4437/5429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:17 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:17.903854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:17.904683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:17.931845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:17.935414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:17.938291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:17.941579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:17.947061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:17.948395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:18.565236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:18.575550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:18.577684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:18.583088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d6dca1c-ef1b-4004-9259-eeac4534ef5d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.683125 Aug 24 02:23:18.585038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4438/5430] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:17 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:18.591203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:18.597189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:18.623638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:18.625122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:18.626716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:18.627725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:18.628690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:18.629412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:18.669624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:18.784207 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-056337f5-464f-400b-ae06-e0b712de0799 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1416 microversion: 2.1 time: 0.196609 Aug 24 02:23:18.791243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4439/5431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:18 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1416 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:18.919908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:18.920633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:18.929937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:18.930443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:18.930886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:18.937853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:18.941734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:18.943873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:19.484438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:19.498253 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd8fa35c-a28c-4ce9-acbf-6931175ddc22 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 200 len: 1448 microversion: 2.1 time: 0.582024 Aug 24 02:23:19.499289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4440/5432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:18 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 1448 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:23:19.530050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:19.531162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:19.539493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:19.540314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:19.540983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:19.542385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:19.543034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:19.544806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:20.162462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:20.177065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41d9391e-4cb5-46ff-83b4-24f7e0f06d7a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.649373 Aug 24 02:23:20.184371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4441/5433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:19 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:20.204741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:20.206177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:20.222629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:20.227884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:20.228587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:20.229552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:20.230517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:20.231127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:20.610336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:20.635184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:20.640394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:20.644559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-450c01c5-533d-4966-afd9-436cd77baad4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1738 microversion: 2.20 time: 0.458827 Aug 24 02:23:20.647504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4442/5434] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:20 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1738 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:20.661115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:20.662015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:20.679253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:20.680136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:20.680933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:20.681978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:20.682632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:20.683260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:21.156468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98edd8fd-eaf9-4d42-9d0a-e44c710f4a2c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.507650 Aug 24 02:23:21.173403 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4443/5435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:20 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:21.188178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:21.189397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:21.201316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:21.202113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:21.202750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:21.204709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:21.206179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:21.206988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:21.612100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:21.635837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aed31291-0554-46d4-9393-bf2e06af17ab tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.459118 Aug 24 02:23:21.638825 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4444/5436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:21 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:21.661705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:21.662727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:21.681487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:21.686585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:21.687243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:21.688611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:21.689230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:21.689789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:22.245341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:22.261064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6ccb4be-905b-4e89-a566-67b55a069d08 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.603279 Aug 24 02:23:22.281740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4445/5437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:21 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:23:22.303558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:22.313534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:22.334746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:22.335436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:22.335994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:22.336987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:22.337721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:22.338391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:22.690820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:22.707126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:22.710173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:22.711838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-032585b7-97cc-4029-ac8a-7248404b13ad tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1720 microversion: 2.20 time: 0.425805 Aug 24 02:23:22.727608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4446/5438] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:22 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1720 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:22.738556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:22.742725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:22.776154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:22.777802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:22.781520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:22.782861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:22.785425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:22.789959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:23.710411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f22d898-04b7-4698-bade-bd65751e8b5a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.977513 Aug 24 02:23:23.712617 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4447/5439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:22 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:23.721941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:23.743088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:23.764699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:23.766743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:23.767404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:23.769225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:23.772100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:23.773044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.157186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:24.167765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-390197ad-04bb-4a3c-967b-8c95307867ed tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.453417 Aug 24 02:23:24.168935 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4448/5440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:23 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:24.173687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adc5c738-c565-41f2-afa1-e33f4a62d3eb", "tag": "26e0cad5-31ac-473f-8c4d-4049ebbe9c9e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:24.185016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.185872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.186974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.200483 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] Creating event network-changed:26e0cad5-31ac-473f-8c4d-4049ebbe9c9e for instance adc5c738-c565-41f2-afa1-e33f4a62d3eb on n-h1-854121-3 Aug 24 02:23:24.206543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-726cb6bd-0a13-4156-9fc6-b469f37afc6d req-b411b2d9-a5df-4834-b88d-97bd81c92623 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036276 Aug 24 02:23:24.212045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4449/5441] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:24.218257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "name": "network-vif-unplugged", "status": "completed", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:24.230357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.231225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.231924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.250684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] Creating event network-vif-unplugged:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:23:24.256583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a9384366-e3c8-420a-bbb6-707e774a404c req-018616a2-4a2c-4806-b566-c0a6c6e02641 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042754 Aug 24 02:23:24.258123 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4450/5442] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:24.264562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:24.266251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:24.274505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.275305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.276042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.277029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.277991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.278736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.520886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:24.535766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:24.539383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:24.541467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6f4a67e-0f51-4326-b3d8-a149987991a4 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1720 microversion: 2.20 time: 0.281873 Aug 24 02:23:24.559544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4451/5443] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:24 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1720 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:24.566326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:24.576004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.576886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.578959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.638409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:23:24.772064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8470cf81-2bd8-4fdd-b800-a28418bcba62 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.210446 Aug 24 02:23:24.774056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4452/5444] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:23:24 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:23:24.786569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:24.792888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:24.814532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.818331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.820440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:24.821344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:24.824211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:24.824211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:25.150276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-385c7ae3-956e-4b30-97d1-d8bb96fbbb9b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.370183 Aug 24 02:23:25.151192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4453/5445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:24 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:25.175726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:25.176371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:25.212095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:25.212695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:25.213748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:25.215378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:25.215959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:25.216572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:25.638461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:25.648018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:25.675629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-961ef02f-3833-43b9-8c01-9ff5d7b0512e tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.489951 Aug 24 02:23:25.685870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4454/5446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:25 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:25.695429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:25.696066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:25.709278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:25.713600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:25.714239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:25.715042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:25.715583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:25.717001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:25.949194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:25.964115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:25.984555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:25.990012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a635355-7c21-42cf-9f25-b65a7c282d2c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1723 microversion: 2.20 time: 0.312451 Aug 24 02:23:25.991190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4455/5447] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:25 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:26.027690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04c97ed5-9a1c-40ac-9a36-2f2cf887b5db"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:26.033433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:26.048785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:26.051756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:26.052430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:26.053998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:26.056096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:26.056772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:26.066308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:26.773262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9840c889-b8b3-400d-82e8-cd58f612ee82 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.755764 Aug 24 02:23:26.774166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4456/5448] 10.222.0.49 () {62 vars in 1364 bytes} [Wed Aug 24 02:23:26 2022] POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments => generated 188 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:23:26.792350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:26.793662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:26.817484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:26.819213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:26.824172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:26.825356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:26.827143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:26.827839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:26.878467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:27.244147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6f0c571-c2c8-40d8-b69f-5f29ca65224a tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.462975 Aug 24 02:23:27.244754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4457/5449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:26 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:27.259562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:27.262265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:27.286358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:27.287034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:27.287501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:27.291073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:27.291561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:27.292009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:27.644116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:27.663623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58971478-0728-4085-973f-b58637326f57 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.408915 Aug 24 02:23:27.664863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4458/5450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:27 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:27.670140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:27.670645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:27.686336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:27.686850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:27.689881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:27.692325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:27.695268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:27.698062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.297274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2014b952-0766-427e-ad5c-ea3365983018 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments/04c97ed5-9a1c-40ac-9a36-2f2cf887b5db" status: 202 len: 0 microversion: 2.20 time: 0.630599 Aug 24 02:23:28.299709 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4459/5451] 10.222.0.49 () {60 vars in 1457 bytes} [Wed Aug 24 02:23:27 2022] DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments/04c97ed5-9a1c-40ac-9a36-2f2cf887b5db => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:23:28.326190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:28.327133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:28.343494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.345376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.347409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.351045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.354350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.354896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.579175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da460aca-77b5-4138-a8c0-807f2c888934 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.277778 Aug 24 02:23:28.579880 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4460/5452] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:28 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:28.585325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:28.585932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:28.601254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.601781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.602239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.603427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.604143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.604600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.643603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128567) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 02:23:28.782628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7aaf5c69-4ca3-4a9e-90d0-f3db31576aa3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/action" status: 202 len: 0 microversion: 2.20 time: 0.201037 Aug 24 02:23:28.784494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4461/5453] 10.222.0.49 () {62 vars in 1319 bytes} [Wed Aug 24 02:23:28 2022] POST /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:23:28.793120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:28.794101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:28.811455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.814894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.815591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:28.816500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:28.817156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:28.819030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:29.221262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:29.231299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7b24b50-e125-4f4b-9f9b-0bad1ccb914a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.444565 Aug 24 02:23:29.243903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4462/5454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:28 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:29.251532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:29.265778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:29.277316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:29.277970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:29.278553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:29.279401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:29.280416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:29.280416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:29.606539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:29.622870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:29.624881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:29.626477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55975f7c-38a2-4f47-9b92-bdba92f3f875 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1671 microversion: 2.20 time: 0.380803 Aug 24 02:23:29.628676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4463/5455] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:29 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1671 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:29.646411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:29.647411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:29.664863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:29.671338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:29.686882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:29.687860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:29.688377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:29.695394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:30.317278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-934f9577-384a-4075-8195-de0b27a572c1 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.686869 Aug 24 02:23:30.317875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4464/5456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:29 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:30.337762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:30.338863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:30.352494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:30.365858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:30.367810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:30.369962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:30.370982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:30.374525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:30.375408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:30.592789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:30.603659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7af20e41-235c-489c-9e4f-07e01f34f150 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.273132 Aug 24 02:23:30.607126 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4465/5457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:30 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:30.652584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:30.653132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:30.678771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:30.679298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:30.679759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:30.681297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:30.681976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:30.683031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.180410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:31.182729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:31.194752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:31.198401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:31.201683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-890e9c38-a512-45b2-9e72-7d2d67772874 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1671 microversion: 2.20 time: 0.553361 Aug 24 02:23:31.205518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4466/5458] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:30 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1671 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:31.216210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc5c738-c565-41f2-afa1-e33f4a62d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "26e0cad5-31ac-473f-8c4d-4049ebbe9c9e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:31.266334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:31.271412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:31.271892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.307617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] Creating event network-vif-plugged:26e0cad5-31ac-473f-8c4d-4049ebbe9c9e for instance adc5c738-c565-41f2-afa1-e33f4a62d3eb on n-h1-854121-3 Aug 24 02:23:31.314878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-305fd762-4fab-48bb-abed-719b073d3515 req-37ebdb7d-5fa8-4cae-bdeb-69d146f7c2a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107144 Aug 24 02:23:31.315536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4467/5459] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:31.341515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:31.343535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:31.355638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:31.356564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:31.357757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.358627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:31.359178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:31.359724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.693559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7dd7e0ab-9e3e-49fe-9fd5-5cefeea1fd20 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.359307 Aug 24 02:23:31.713390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4468/5460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:31 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:31.722622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:31.723252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:31.747770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:31.748746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:31.749318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.750386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:31.750960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:31.751555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:31.979701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:31.988220 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98b5048a-e174-4746-822a-4b89035a50a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.273662 Aug 24 02:23:32.002763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4469/5461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:31 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:32.239076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:32.239878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:32.271317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:32.271928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:32.274380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:32.275159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:32.275656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:32.276094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:33.036513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:33.048582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:33.050194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:33.056491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe70bf01-8834-4a1a-af52-d659f6a0c0f6 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.829494 Aug 24 02:23:33.057717 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4470/5462] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:32 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:33.062982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:33.063616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:33.111687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:33.112335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:33.113968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:33.114821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:33.115300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:33.115789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:33.477897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fdd60b60-f533-435a-a32d-3b31a5e2304b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1464 microversion: 2.1 time: 0.418396 Aug 24 02:23:33.497282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4471/5463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:33 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:33.502807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:33.503657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:33.528506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:33.531248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:33.533606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:33.534395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:33.534885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:33.535330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:34.072025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:34.087666 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebfdff1e-089d-4589-b06e-5b0316f03fc7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.588862 Aug 24 02:23:34.107127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4472/5464] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:33 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:34.114544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:34.115517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:34.123414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:34.124287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:34.125084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:34.126151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:34.127084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:34.127985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:34.675483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:34.692874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:34.696306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:34.699531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3340b07-9503-4eb7-be4d-c7b47ffbfba3 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.590503 Aug 24 02:23:34.704272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4473/5465] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:34 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:34.717769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:34.718492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:34.749426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:34.750221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:34.750857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:34.751798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:34.752438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:34.756107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.108541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebbf2fe1-6444-4625-b8a1-10607cc1ce3d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1649 microversion: 2.1 time: 0.402595 Aug 24 02:23:35.109354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4474/5466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:34 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1649 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:35.122228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:35.122887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:35.136456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.137006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.137464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.138201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.138672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.139119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.434632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:35.444748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1040627b-c0a9-4eba-bb94-39c9854c8ca1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1679 microversion: 2.1 time: 0.329697 Aug 24 02:23:35.445359 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4475/5467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:35 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:35.461831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:35.462855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:35.477256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.478169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.478859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.479883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.480586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.484487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.795607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab642c45-bca5-41d8-b103-9ed8fe039840 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1649 microversion: 2.1 time: 0.349147 Aug 24 02:23:35.798559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4476/5468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:35 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1649 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:35.807362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:35.809708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:35.824187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.826669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.827799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:35.831256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:35.832023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:35.832808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:36.161282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:36.175835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:36.182960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:36.184638 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58a79ddf-83b5-4c88-9ca3-24e51b16251f tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.384773 Aug 24 02:23:36.189640 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4477/5469] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:35 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:36.197910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:36.198747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:36.223607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:36.224380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:36.225645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:36.233496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:36.234292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:36.235038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:36.497117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3eae6dac-a1cc-471f-ba78-a8ca7f610ccb tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1649 microversion: 2.1 time: 0.304130 Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4478/5470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:36 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1649 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:36.512627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:36.513850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:36.513850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:36.514297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:36.785501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:36.797356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5200909a-c3f8-445a-8e1c-0f36b64f88ce tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1656 microversion: 2.1 time: 0.297851 Aug 24 02:23:36.797942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4479/5471] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:36 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1656 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:36.808461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1773804236", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "availability_zone": "nova:n-h2-854121-3", "networks": [{"uuid": "e6b311af-0760-47e3-8fb6-504c7d275f94"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:36.940060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] validate_networks() for [('e6b311af-0760-47e3-8fb6-504c7d275f94', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:23:37.734936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:23:37.735568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:23:37.735781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:23:37.736212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:23:37.736645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:23:37.747540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:37.748054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:37.748517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:37.749306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:37.749990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:37.750598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:37.787277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Getting quotas for project a61c46db15544cde9a577e6eebabd877. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:23:37.806742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Getting quotas for user 8b5f13cd00cb4996ac0c134014a58b84 and project a61c46db15544cde9a577e6eebabd877. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:23:37.828511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:23:37.831719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:23:37.963558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e5d8886-3418-4359-b2d7-efa304e49164 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163075 Aug 24 02:23:37.970870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4480/5472] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:23:37.976943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:37.983852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:37.984813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:37.985519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:38.052105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 02:23:38.174304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f25dc96-16f2-49ba-8f0f-62f68a5cb3c5 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.201700 Aug 24 02:23:38.180013 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4481/5473] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:23:37 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:23:38.186657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:38.187521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:38.238049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:38.241492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:38.241492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:38.242006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:38.242530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:38.245919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:38.593321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:38.608254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:38.613888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:38.615548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8d8c2df-49fb-41cb-87bc-d2e701869dd7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.434113 Aug 24 02:23:38.616173 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4482/5474] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:38 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:38.625715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f95ba97-9c29-4ba6-8f02-85f0eae0c396 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:38.632524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f95ba97-9c29-4ba6-8f02-85f0eae0c396 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:38.769281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f95ba97-9c29-4ba6-8f02-85f0eae0c396 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1329 microversion: 2.1 time: 0.146849 Aug 24 02:23:38.771238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4483/5475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:38 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1329 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:38.783356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:38.784200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:38.800573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:38.801369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:38.802017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:38.802921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:38.805461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:38.810083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:39.310195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:39.313227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:39.337947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1dd5e29-e062-455c-a9ff-b3c7f9a9d276 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1665 microversion: 2.1 time: 0.563993 Aug 24 02:23:39.348779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4484/5476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:38 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1665 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:39.658240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:39.659318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:39.681828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:39.683304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:39.685299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:39.687784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:39.689566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:39.693328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:40.154027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:40.181256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:40.184439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:40.188798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58562639-0f12-4366-ab21-be41335dd1cc tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.552753 Aug 24 02:23:40.193092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4485/5477] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:39 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:40.206049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:40.212961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:40.240190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:40.244943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:40.245551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:40.246937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:40.247433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:40.247911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:40.479181 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a37dae04-52c8-4ed1-b37e-c9cce978bb80 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1416 microversion: 2.1 time: 0.284349 Aug 24 02:23:40.497104 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4486/5478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:40 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1416 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:40.502193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:40.504121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:40.536121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:40.536643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:40.541341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:40.542078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:40.542635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:40.543095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:40.918588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:40.930218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1740fc0-2ee8-4b35-a877-0285e29a0e02 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1665 microversion: 2.1 time: 0.449328 Aug 24 02:23:40.931479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4487/5479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:40 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1665 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:41.223204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:41.230761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:41.252036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.254759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.255037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:41.255957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.265432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.266572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:41.666556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:41.681376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:41.685836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:41.690328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20c282e1-6376-4afb-8bed-61ee68601368 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.474660 Aug 24 02:23:41.693150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4488/5480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:41 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:41.704837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:41.705980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:41.725781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.726401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.726868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:41.727703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.728334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.728749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:41.883470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28318b46-9999-439f-be6d-810ceaea1af5 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1422 microversion: 2.1 time: 0.186105 Aug 24 02:23:41.885136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4489/5481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:41 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1422 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:41.953161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:41.953862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:41.971820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.972361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.972946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:41.973644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:41.978891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:41.980896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:42.430250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:42.443121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33ba7e67-058c-4cf5-9058-2bb09897d618 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1665 microversion: 2.1 time: 0.494543 Aug 24 02:23:42.447483 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4490/5482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:41 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1665 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:42.719690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:42.720556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:42.737999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:42.738916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:42.739547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:42.741063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:42.749572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:42.750402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.006492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:43.017448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:43.019594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:43.021250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb91b2c4-7ed9-464c-8324-3476d27a7106 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.305464 Aug 24 02:23:43.022572 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4491/5483] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:42 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:23:43.028265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:43.029454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:43.035921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.036636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.038051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.039824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.040472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.041187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.209911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e96c6294-41d3-4795-af3d-f67fdb1b6ab2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1422 microversion: 2.1 time: 0.183261 Aug 24 02:23:43.217812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4492/5484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:43 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1422 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:43.471001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:43.472071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:43.484188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.485143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.492451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.498034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.498524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.498994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.864670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:43.876249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3990038-53c5-45b9-a5db-720f1602e4d7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.409733 Aug 24 02:23:43.897097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4493/5485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:43 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:43.903400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:43.905510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:43.936815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.936815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.936815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:43.936815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:43.936815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:43.939474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.213641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:44.236524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3b4462c-1859-4748-931c-cd28c51eb9ef tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.336939 Aug 24 02:23:44.236945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4494/5486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:43 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:44.243282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:44.249673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:44.269353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.269617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.270577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.273567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.274169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.274825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.594343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:44.618695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:44.621964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:44.640527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17c052b5-f59a-432e-8511-5f9c21c75154 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.402219 Aug 24 02:23:44.663443 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4495/5487] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:44 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:44.694269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:44.694942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:44.706216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.709701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.711781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.713436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.714847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.717409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.931059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57994c8c-294f-4347-828c-825218918ef8 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.265687 Aug 24 02:23:44.937526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4496/5488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:44 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:44.942945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:44.945861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:44.961292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.965090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.968352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:44.969740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:44.971000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:44.971953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:45.312327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:45.336237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5b46354-439b-4eab-ac75-15a4f6464e3f tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.397004 Aug 24 02:23:45.337262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4497/5489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:44 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:45.371483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:45.373035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:45.393333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:45.394246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:45.397214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:45.398253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:45.398983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:45.400108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:45.804661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:45.817581 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08098903-c510-44cf-9954-a90fbfcc311b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.459124 Aug 24 02:23:45.820391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4498/5490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:45 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:45.827670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:45.828737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:45.858519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:45.859438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:45.860271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:45.861726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:45.869335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:45.870477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.255659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:46.274660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:46.283828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:46.286793 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a06a3bc-3f14-46b7-b7bf-44f750366630 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.463652 Aug 24 02:23:46.294616 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4499/5491] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:45 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:46.300084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:46.301011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:46.313856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.315360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.316256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.317397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.320177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.320945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4269907a-f035-4482-adb5-8c16c5a641a8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.295782 Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4500/5492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:46 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.804959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:46.821216 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7127e3f9-da93-4d1d-b65c-bf895d60e2d2 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.211524 Aug 24 02:23:46.822340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4501/5493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:46 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:46.837146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:46.837752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:46.869749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.871463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.873048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.875696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:46.876806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:46.880060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:46.958390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lazy-loading 'flavor' on Instance uuid 7b335e2c-68ca-463a-88cc-4a142b30bc1c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:23:47.138080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3efe70a-e115-4166-8173-44a7ece76426 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.312947 Aug 24 02:23:47.139707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4502/5494] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:23:46 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:23:47.174735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:47.175513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:47.244147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:47.244610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:47.257454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:47.258545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:47.259241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:47.259866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:47.760097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:48.018046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:48.031715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aeec55f2-55d1-4c92-b1c3-b6ed51417f38 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1677 microversion: 2.1 time: 0.866763 Aug 24 02:23:48.032310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4503/5495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:47 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1677 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:48.042713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "593521a6-1897-4a35-825b-46fc61e4e2bd", "tag": "8a75a0ad-c88a-40b3-9506-45dad4f4706f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:48.065940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:48.067099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:48.067771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:48.102456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] Creating event network-changed:8a75a0ad-c88a-40b3-9506-45dad4f4706f for instance 593521a6-1897-4a35-825b-46fc61e4e2bd on n-h2-854121-3 Aug 24 02:23:48.107345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77bbc570-b7a5-4ea6-aa4a-97e8d192542c req-84a51411-f185-47dc-97e3-538b3f835e75 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070236 Aug 24 02:23:48.107957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4504/5496] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:48.121561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:48.122592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:48.129388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:48.129959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:48.130365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:48.131814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:48.132300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:48.132808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:48.761641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:48.858871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:48.871899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:48.877300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:48.878695 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89db572d-e8f9-43ff-a3e0-68d01a45ec1d tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.769243 Aug 24 02:23:48.887754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4505/5497] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:48 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:48.894615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:48.895264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:48.905020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:48.907464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:48.908330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:48.909346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:48.910765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:48.913034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:48.913846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:49.320150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcee9ecc-a141-4f7d-b263-418a08baa461 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.430726 Aug 24 02:23:49.323997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4506/5498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:48 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:49.345563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:49.346559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:49.361450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:49.364673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:49.365390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:49.368133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:49.372885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:49.374467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:49.749661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:49.766603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d621d082-4378-4595-b1f7-e7b1c5d77648 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1660 microversion: 2.1 time: 0.423020 Aug 24 02:23:49.767878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4507/5499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:49 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1660 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:49.796676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:49.797846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:49.824439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:49.825597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:49.826325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:49.828756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:49.829843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:49.832521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.079308 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b21ec64-b5cf-4d52-87a1-c0c3cd6c39eb tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action" status: 202 len: 0 microversion: 2.1 time: 0.289720 Aug 24 02:23:50.102671 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4508/5500] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:23:49 2022] POST /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (3 switches on core 0) Aug 24 02:23:50.137561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:50.142721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:50.158754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.160473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.168091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.169447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.176272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.177253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.479193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:50.494413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:50.496317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:50.497960 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57d87f1e-b686-4c9d-a91e-2526b4c0a499 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.392316 Aug 24 02:23:50.498762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4509/5501] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:50 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:50.519846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:50.523210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:50.552889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.553882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.557790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.558894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.559402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.559855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.848752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:50.861823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1fda07e-1af7-40cb-825d-15e299a2d79c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1666 microversion: 2.1 time: 0.361254 Aug 24 02:23:50.877637 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4510/5502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:50 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1666 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:50.882991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:50.883903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:50.891727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.892321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.892817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:50.893571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:50.894054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:50.894505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:51.105340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-699c7e7f-bca6-43de-b61c-0521b4bb14fe tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.225701 Aug 24 02:23:51.106423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4511/5503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:50 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:51.526725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:51.528079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:51.536521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:51.537559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:51.538210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:51.539308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:51.539961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:51.540580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:51.777626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:51.786561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:51.788544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:51.789760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f785dfa-0f7a-4d28-988a-30202e2d3a52 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.267125 Aug 24 02:23:51.790337 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4512/5504] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:51 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:51.885484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:51.886295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:51.893653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:51.894456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:51.895078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:51.896008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:51.896686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:51.897334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:52.227690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:52.237583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acd12d5e-2780-44f3-9943-080f96f7a052 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1666 microversion: 2.1 time: 0.357570 Aug 24 02:23:52.252898 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4513/5505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:51 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1666 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:52.260310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:52.261415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:52.269969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:52.270824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:52.271575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:52.272957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:52.273659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:52.274322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:52.750776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-785ae5dd-0bdd-4225-9929-53c92599c41d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.495167 Aug 24 02:23:52.767257 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4514/5506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:52 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:52.816170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:52.817279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:52.823940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:52.824683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:52.825177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:52.825899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:52.826371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:52.826993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:53.051404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:53.065459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:53.070718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:53.072040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-918dd970-d803-44bd-b5ed-a97905c76eb2 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.260566 Aug 24 02:23:53.073049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4515/5507] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:52 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:23:53.262388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:53.263225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:53.273374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:53.276445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:53.277252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:53.278734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:53.280115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:53.285365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:53.293909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:23:53.577320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:53.586831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2206691b-2f27-4c25-b887-22e21ca72b1d tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1666 microversion: 2.1 time: 0.330660 Aug 24 02:23:53.601342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4516/5508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:53 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1666 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:53.785315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:53.786727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:53.795697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:53.796424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:53.797123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:53.798153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:53.799090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:53.799717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:54.040659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d678d2a-7016-4294-88d4-20f0fb9304be tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.259575 Aug 24 02:23:54.056060 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4517/5509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:53 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:54.097064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:54.097693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:54.105972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:54.106464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:54.108149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:54.108149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:54.108149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:54.108540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:54.359671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:54.368574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:54.370284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:54.371567 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3e336b95-86df-444e-8fc5-f35087bfc5de tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.279986 Aug 24 02:23:54.372222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4518/5510] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:54 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:54.609017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:54.609657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:54.620484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:54.621038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:54.621496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:54.622231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:54.622701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:54.629856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:54.855173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:54.864337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be1e8362-f3d0-4d41-9704-d551d289ca82 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1666 microversion: 2.1 time: 0.258995 Aug 24 02:23:54.869456 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4519/5511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:54 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1666 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:55.064085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:55.065223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:55.090162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.092132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.094282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.095294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.096122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.097002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.416784 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fded9b2a-4a3f-4183-9284-029371d921ed tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.357334 Aug 24 02:23:55.420455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4520/5512] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:55 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:55.425647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:55.426283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:55.444707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.447290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.449255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.450185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.452411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.453079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.778176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:55.788130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:55.790024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:55.791571 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-606a09df-8f0a-45e4-8f97-74f7ad011bd8 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.370086 Aug 24 02:23:55.792246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4521/5513] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:55 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:23:55.797378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "name": "network-vif-plugged", "status": "completed", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:23:55.820409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.821344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.821491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.837954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] Creating event network-vif-plugged:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:23:55.843354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bfb0ff40-0e71-4643-903d-9ae40505a0d0 req-cc0e2fa6-310f-4d3f-a72f-e3c147c60c7a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049649 Aug 24 02:23:55.844157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4522/5514] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:23:55.887035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:55.888173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:55.895038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.897024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.897719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:55.898479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:55.898965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:55.899412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:56.147937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:56.157962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdc8aae6-7c11-4f53-97dd-5b35524cdce7 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1666 microversion: 2.1 time: 0.275377 Aug 24 02:23:56.178829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4523/5515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:55 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1666 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:23:56.445112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:56.445840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:56.452251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:56.452786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:56.453238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:56.454139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:56.454612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:56.455054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:56.716961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e6446d5-b486-43a9-8e73-91582245b02f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.275855 Aug 24 02:23:56.731780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4524/5516] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:56 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:56.819133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:56.820118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:56.827991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:56.828549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:56.829041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:56.830363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:56.831046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:56.831502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.140859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:57.156045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:57.158468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:57.160085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb8328c3-fff9-42d4-b284-26f7b51532f7 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1729 microversion: 2.20 time: 0.348484 Aug 24 02:23:57.165532 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4525/5517] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:23:56 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1729 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 02:23:57.193594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:57.194693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:57.202485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.203146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.204365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.205577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.206121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.206767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.440800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:57.458373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81986487-ecd0-45d0-bd82-8d65dff72edf tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.273366 Aug 24 02:23:57.475561 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4526/5518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:57 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:23:57.480969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:57.481836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:57.488486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.489219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.489928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.491335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.500581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.501305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.750532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:23:57.760015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-766c4a2c-03c5-4041-bb27-1843f1c4a122 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1669 microversion: 2.1 time: 0.282781 Aug 24 02:23:57.761003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4527/5519] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:57 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:57.782782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:57.793864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:57.802344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.804166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.805869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:57.805869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:57.806835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:57.806835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:58.080895 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75b6ba1f-9071-47dc-ad4f-66b6cd3a7533 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.305971 Aug 24 02:23:58.090069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4528/5520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:23:57 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:23:58.106754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:23:58.106754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:23:58.106754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:58.106754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:58.107340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:58.108224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:58.108895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:58.109568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:58.144522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:23:58.153621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Working on deleting snapshot bf910ea8-a343-49cf-966e-aa8439b4dfa5 from shelved instance... Aug 24 02:23:59.131999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Doing local delete in cell 71301810-8efc-454b-bb1e-01e7f37efce0(cell1) {{(pid=128567) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 02:23:59.134161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:23:59.134891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:23:59.135556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:23:59.136248 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 02:23:59.141248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] deallocate_for_instance() {{(pid=128567) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 02:23:59.998368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Updating instance_info_cache with network_info: [] {{(pid=128567) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 02:24:00.327105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:00.453716 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1f25299-b833-4df1-af5a-5db3db6c0f6c tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 204 len: 0 microversion: 2.1 time: 2.360929 Aug 24 02:24:00.454784 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4529/5521] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:23:58 2022] DELETE /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 0 bytes in 2364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:24:00.460888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:00.461467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:00.473414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.488132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.489138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.490232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.490919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.491624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.658774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:00.673181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:00.675417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:00.676978 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0550065-f2f2-4806-a3a1-ff0cbbaa22b0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1716 microversion: 2.20 time: 0.220829 Aug 24 02:24:00.678169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4530/5522] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:24:00 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1716 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:24:00.682949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:00.683772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:00.690904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.691661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.692288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.694001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.694885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.695525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.869014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-791b7dcd-8823-4223-8423-3e4d5671476e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.183844 Aug 24 02:24:00.873129 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4531/5523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:00 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:00.878470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593521a6-1897-4a35-825b-46fc61e4e2bd", "name": "network-vif-plugged", "status": "completed", "tag": "8a75a0ad-c88a-40b3-9506-45dad4f4706f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:00.892492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.893141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.893668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.905329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] Creating event network-vif-plugged:8a75a0ad-c88a-40b3-9506-45dad4f4706f for instance 593521a6-1897-4a35-825b-46fc61e4e2bd on n-h2-854121-3 Aug 24 02:24:00.910998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-aa31242f-50d6-4c68-8030-969115b28ea9 req-08078763-9616-4de8-b17d-57a8d6599508 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036375 Aug 24 02:24:00.911780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4532/5524] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:00.918576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42c33-168f-4856-a6a6-9ea375ba92e5", "name": "network-vif-deleted", "tag": "474addcc-5215-44b7-ac64-a82256b8786b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:00.929019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.929820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.930485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.942367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_external_events [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] Unable to find a host for instance d4e42c33-168f-4856-a6a6-9ea375ba92e5. Dropping event network-vif-deleted {{(pid=128567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 02:24:00.944177 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-298cbe23-045a-4200-9ce7-d9178137db8d req-8cfc0c11-dea9-448c-b37c-213dd73c0d3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031060 Aug 24 02:24:00.945030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4533/5525] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 02:24:00.951222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:00.952340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: d4e42c33-168f-4856-a6a6-9ea375ba92e5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:00.964569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.965258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.965977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.966994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:00.967775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:00.969376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:00.989172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 HTTP/1.1 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd4e42c33-168f-4856-a6a6-9ea375ba92e5'} Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:00.991716 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 404 to user: Instance d4e42c33-168f-4856-a6a6-9ea375ba92e5 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c53e26a3-bc33-41ef-ac0c-aa7df6d7c5e3 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5" status: 404 len: 111 microversion: 2.1 time: 0.046990 Aug 24 02:24:00.997446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4534/5526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:00 2022] GET /compute/v2.1/servers/d4e42c33-168f-4856-a6a6-9ea375ba92e5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:24:01.001877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:01.002590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:01.010373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.011278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.012020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:01.012977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.013872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.014492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:01.075370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:01.197398 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a27c08e8-ecf7-4c48-9efc-c1762cff0d5a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 204 len: 0 microversion: 2.1 time: 0.198385 Aug 24 02:24:01.202478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4535/5527] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:00 2022] DELETE /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:24:01.221301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:01.222180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:01.231377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.231898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.232354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:01.233164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.233687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.234183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:01.387228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:01.397370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3ffa9cd-febb-4431-96d8-956dcb35a5a1 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1465 microversion: 2.1 time: 0.193137 Aug 24 02:24:01.398661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4536/5528] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:01 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:01.891616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:01.892489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:01.903763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.904557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.905251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:01.906923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:01.908194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:01.908876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:02.121094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7afbdc2-84db-43fb-b9ec-1728038b464c tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1464 microversion: 2.1 time: 0.233584 Aug 24 02:24:02.134785 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4537/5529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:01 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:02.418459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:02.419698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:02.438502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:02.439018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:02.439474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:02.449665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:02.450381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:02.450841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:02.570570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:02.579238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-406d99eb-b75e-4498-9580-17ae1a3e2082 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1465 microversion: 2.1 time: 0.164843 Aug 24 02:24:02.579824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4538/5530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:02 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:03.142257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:03.143347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:03.151490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.152519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.153178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.154088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.154730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.155366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.404424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90382aa9-2e19-43ae-b074-b7a205a9382b tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1649 microversion: 2.1 time: 0.266086 Aug 24 02:24:03.405606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4539/5531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:03 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1649 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:03.429587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:03.430750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:03.439021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.439615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.440836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.441591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.444059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.445272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.683974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c429cc12-aaa5-4fe5-969f-b9ee2e09940f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1649 microversion: 2.1 time: 0.261116 Aug 24 02:24:03.685738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4540/5532] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:03 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1649 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:03.694242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00e455b0-b9f4-42cd-9670-eed2f4e27d86", "name": "network-vif-deleted", "tag": "dc8fbfac-f0a7-45f4-b6f0-778a2086b32c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:03.710753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.712013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.713098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.738787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] Creating event network-vif-deleted:dc8fbfac-f0a7-45f4-b6f0-778a2086b32c for instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 on n-h1-854121-3 Aug 24 02:24:03.747328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-87033383-27b8-4c54-b3f3-6ae9ea4114f4 req-297b3a02-ce0e-49ef-8502-747c045d5528 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059271 Aug 24 02:24:03.748521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4541/5533] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:03.756606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:03.757641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:03.770120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.771545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.772257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.773378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.774070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.774890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.880799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:03.892356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a062a8b7-17d0-47f9-9132-3ed567788a95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 200 len: 1300 microversion: 2.1 time: 0.141930 Aug 24 02:24:03.894117 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4542/5534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:03 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:03.914770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:03.917273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:03.924913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.929086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.929865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:03.930837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:03.933185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:03.933857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.210015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f577fd8-75e4-44e2-9f60-d20fff364228 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1649 microversion: 2.1 time: 0.314397 Aug 24 02:24:04.210640 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4543/5535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:03 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1649 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:04.253141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:04.253665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:04.260128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.260631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.261118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.261841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.262313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.262753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.290647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:04.293029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:04.423190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f060e540-c09d-4564-8445-b0f5392aafe3 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 204 len: 0 microversion: 2.1 time: 0.195439 Aug 24 02:24:04.428067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4544/5536] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:04 2022] DELETE /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:24:04.435697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:04.436603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:04.452082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.453644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.457720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.460793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.461630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.462399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.744986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36fa362d-22ab-4fc5-8e50-05ff07a07a74 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1655 microversion: 2.1 time: 0.314488 Aug 24 02:24:04.768819 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4545/5537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:04 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1655 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:04.927846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:04.928594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 00e455b0-b9f4-42cd-9670-eed2f4e27d86] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:04.932813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:04.938537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.939490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.940165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.941147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.941843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.942506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.964347 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 HTTP/1.1 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '00e455b0-b9f4-42cd-9670-eed2f4e27d86'} Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:04.966852 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 404 to user: Instance 00e455b0-b9f4-42cd-9670-eed2f4e27d86 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1f5c4f4-1729-47b9-af00-ac531cde2d5b tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86" status: 404 len: 111 microversion: 2.1 time: 0.046002 Aug 24 02:24:04.971279 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4546/5538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:04 2022] GET /compute/v2.1/servers/00e455b0-b9f4-42cd-9670-eed2f4e27d86 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:24:04.978202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:04.978712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:04.985395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.985906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.986363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:04.987224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:04.987808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:04.988259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:05.018293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:05.127785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7885826-8d76-4090-bc80-93b3cde60d95 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 204 len: 0 microversion: 2.1 time: 0.153134 Aug 24 02:24:05.129951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4547/5539] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:04 2022] DELETE /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:24:05.143517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:05.144259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:05.155186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:05.155703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:05.157245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:05.157876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:05.159068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:05.159853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:05.336619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:05.349577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f782e685-0a0a-4b08-ba6a-c188f0e5b347 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1507 microversion: 2.1 time: 0.210223 Aug 24 02:24:05.358101 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4548/5540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:05 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:05.770563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:05.782458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:05.789981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:05.790712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:05.791170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:05.792048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:05.792528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:05.793118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:05.972648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d89418f8-d937-4168-8ef2-936466d26d01 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1655 microversion: 2.1 time: 0.206718 Aug 24 02:24:05.973263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4549/5541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:05 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1655 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:06.378113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:06.378719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:06.387291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:06.387640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:06.388165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:06.388935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:06.389401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:06.389903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:06.568568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:06.582992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7beb67e-2ef8-4b1e-9aea-4aea1bbc3921 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1507 microversion: 2.1 time: 0.215474 Aug 24 02:24:06.600322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4550/5542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:06 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:06.997558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:06.998192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:07.016980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:07.018576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:07.019905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:07.021025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:07.023767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:07.025334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:07.251661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-292e9038-efb1-4948-b43a-e914bb7f508f tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1613 microversion: 2.1 time: 0.258558 Aug 24 02:24:07.276974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4551/5543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:06 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1613 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:07.292658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "593521a6-1897-4a35-825b-46fc61e4e2bd", "name": "network-vif-deleted", "tag": "8a75a0ad-c88a-40b3-9506-45dad4f4706f"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:07.327975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:07.334000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:07.335772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:07.395677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] Creating event network-vif-deleted:8a75a0ad-c88a-40b3-9506-45dad4f4706f for instance 593521a6-1897-4a35-825b-46fc61e4e2bd on n-h2-854121-3 Aug 24 02:24:07.407573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dfdcf988-b368-4143-a086-0023b9dc42fc req-41fe2913-458b-465c-937f-e8f12ab7f462 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118627 Aug 24 02:24:07.415016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4552/5544] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:07.607607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:07.608602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:07.622737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:07.626085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:07.626570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:07.627336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:07.627825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:07.628274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:07.887319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:07.906939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eac41626-0f6e-4889-bf04-d1443d60a4f8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 200 len: 1300 microversion: 2.1 time: 0.305026 Aug 24 02:24:07.909243 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4553/5545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:07 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:08.274974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:08.275699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:08.283854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.284370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.284856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.285579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.291237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.292444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.354945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.355676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.356287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.356885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lazy-loading 'fault' on Instance uuid 593521a6-1897-4a35-825b-46fc61e4e2bd {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:24:08.429231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d89a6f03-13fb-4980-9649-9997d1e962d4 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 200 len: 1454 microversion: 2.1 time: 0.158974 Aug 24 02:24:08.437468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4554/5546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:08 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:08.931535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:08.932170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 793ddb6a-8a97-409b-814a-affbf1c5f889] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:08.938822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.939658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.940184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.941011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.941740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.942645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.958122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 HTTP/1.1 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '793ddb6a-8a97-409b-814a-affbf1c5f889'} Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:08.960275 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. Aug 24 02:24:08.966041 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:08.967899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 404 to user: Instance 793ddb6a-8a97-409b-814a-affbf1c5f889 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:08.968908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-453b7f46-7e39-40e0-9107-e2f5d2ab10c2 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889" status: 404 len: 111 microversion: 2.1 time: 0.041807 Aug 24 02:24:08.969573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4555/5547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:08 2022] GET /compute/v2.1/servers/793ddb6a-8a97-409b-814a-affbf1c5f889 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:24:08.985705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:08.986228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:08.993302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.993921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.994518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:08.995355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:08.995897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:08.996466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.029587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:09.155903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-899d2906-9599-411f-8c4d-d501aba8a5c8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 204 len: 0 microversion: 2.1 time: 0.174543 Aug 24 02:24:09.157095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4556/5548] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:08 2022] DELETE /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:24:09.168239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:09.169044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:09.176171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.177002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.177468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.178196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.178724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.179174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.352140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:09.361149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a90b3329-9d0d-447a-8f16-069fa0fc9402 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1493 microversion: 2.1 time: 0.199600 Aug 24 02:24:09.362278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4557/5549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:09 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1493 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:09.452369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:09.453094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: 593521a6-1897-4a35-825b-46fc61e4e2bd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:09.460867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.461384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.461870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.462799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.463273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.463722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.468882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:09.484761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] HTTP exception thrown: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Request method failure captured: Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd HTTP/1.1 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYuKWOd9IZ5_E3vqamJEzEXiWFoy9xEW6WDcXqkaaSJb2a55YLw8kZSi3svgUzNyAzjYjyJH_PJLSO2s0_8ceeKarbFFe9cgaBg5bnpzInqr6Ez4ca_0J8J2JrrXiEBYjhqXmsvcF-wrUSQqY4MLTBpAsiKOY7Qqru7DgmxDrr1CK2s Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a61c46db15544cde9a577e6eebabd877 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerMultinode-635100171 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a61c46db15544cde9a577e6eebabd877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerMultinode-635100171 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a61c46db15544cde9a577e6eebabd877 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerMultinode-635100171 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerMultinode-635100171-project-admin Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 8b5f13cd00cb4996ac0c134014a58b84 Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerMultinode-635100171-project-admin Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '593521a6-1897-4a35-825b-46fc61e4e2bd'} Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:09.486550 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Returning 404 to user: Instance 593521a6-1897-4a35-825b-46fc61e4e2bd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-73d9b21e-bf94-426c-be97-8312c43d604e tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd" status: 404 len: 111 microversion: 2.1 time: 0.040550 Aug 24 02:24:09.491911 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4558/5550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:09 2022] GET /compute/v2.1/servers/593521a6-1897-4a35-825b-46fc61e4e2bd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:24:09.509347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:09.511339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:09.533482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.533990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.534443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.535173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.535776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.536526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.569508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:09.733545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e303048b-7d13-483e-824e-7f5f85bcffc0 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "DELETE /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 204 len: 0 microversion: 2.1 time: 0.239558 Aug 24 02:24:09.737258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4559/5551] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:09 2022] DELETE /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:24:09.744438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "793ddb6a-8a97-409b-814a-affbf1c5f889", "name": "network-vif-deleted", "tag": "84069d17-6d17-4202-b186-3a042fa1e0a3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:09.765636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.766151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.766603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.792611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] Creating event network-vif-deleted:84069d17-6d17-4202-b186-3a042fa1e0a3 for instance 793ddb6a-8a97-409b-814a-affbf1c5f889 on n-h2-854121-3 Aug 24 02:24:09.819644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f9dc6187-a858-40d0-9e40-b394f7392fb6 req-bd5d5cba-2de6-4767-82bd-39e95f804ee7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081734 Aug 24 02:24:09.822333 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4560/5552] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:09.832569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:09.833790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:09.841055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.841866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.842540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:09.843554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:09.844106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:09.844627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:10.020478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8c9c913-6d93-4416-aff8-dd5a8ab26efd tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1655 microversion: 2.1 time: 0.194102 Aug 24 02:24:10.022991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4561/5553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:09 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1655 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:10.383375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:10.383934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:10.400893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:10.402105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:10.405774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:10.408518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:10.410582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:10.412434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:10.589431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:10.600438 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2512e54d-a130-442f-8068-7282b1e473f6 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1451 microversion: 2.1 time: 0.221777 Aug 24 02:24:10.601927 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4562/5554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:10 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:11.050387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:11.051335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:11.065385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.065936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.066335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.068054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.068522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.069312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.259356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6d006b2-d3dc-4493-9577-e47f99566e6d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1655 microversion: 2.1 time: 0.214264 Aug 24 02:24:11.260011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4563/5555] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:11 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1655 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:11.633902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:11.641550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:11.661868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.662379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.663024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.663982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.664610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.665377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.715203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.716005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.716608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.717984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lazy-loading 'fault' on Instance uuid 4d097c48-b1c3-495b-ae89-bdca18146f17 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:24:11.768348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:11.780554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7661a6b2-f718-433e-bf6e-c554975c2f14 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 200 len: 1304 microversion: 2.1 time: 0.155548 Aug 24 02:24:11.789070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4564/5556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:11 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:11.856363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d097c48-b1c3-495b-ae89-bdca18146f17", "name": "network-vif-deleted", "tag": "b39944f9-ef70-496c-bfa5-4f946117b8da"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:11.866990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:11.867717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:11.868255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:11.894588 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] Creating event network-vif-deleted:b39944f9-ef70-496c-bfa5-4f946117b8da for instance 4d097c48-b1c3-495b-ae89-bdca18146f17 on n-h1-854121-3 Aug 24 02:24:11.899609 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4c13c390-0349-4bcd-9cfb-06a48d5e0643 req-1df313ce-1aec-4136-a175-2832920e1639 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046971 Aug 24 02:24:11.900681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4565/5557] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:24:12.286770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:12.288232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:12.300441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.302821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.303523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.304510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.305091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.305574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.345171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.345952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.346411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.346878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lazy-loading 'fault' on Instance uuid adc5c738-c565-41f2-afa1-e33f4a62d3eb {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:24:12.426101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d137447-048c-4621-a99b-590d176ebc8d tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 200 len: 1454 microversion: 2.1 time: 0.148103 Aug 24 02:24:12.427519 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4566/5558] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:12 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:12.805396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:12.806115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 4d097c48-b1c3-495b-ae89-bdca18146f17] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:12.815779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.818996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.819734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.820821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.821526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.822936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.844407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 HTTP/1.1 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '4d097c48-b1c3-495b-ae89-bdca18146f17'} Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:12.849461 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. Aug 24 02:24:12.855313 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:12.861324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 404 to user: Instance 4d097c48-b1c3-495b-ae89-bdca18146f17 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:12.862503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3299485-9113-45eb-9045-03abb594e5ec tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17" status: 404 len: 111 microversion: 2.1 time: 0.062268 Aug 24 02:24:12.863559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4567/5559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:12 2022] GET /compute/v2.1/servers/4d097c48-b1c3-495b-ae89-bdca18146f17 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:24:12.888242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:12.899975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:12.918401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.919062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.920066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.921489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:12.922276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:12.923099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:12.966010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:13.087843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40d8cfb9-5ebe-4474-b93b-e0773296218a tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 204 len: 0 microversion: 2.1 time: 0.216494 Aug 24 02:24:13.092678 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4568/5560] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:12 2022] DELETE /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:24:13.116307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:13.117442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:13.133921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:13.134451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:13.134902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:13.136982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:13.139894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:13.140370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:13.354578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:13.371250 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f43412c-3277-4d0a-91ab-a533d93cafff tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1675 microversion: 2.1 time: 0.276643 Aug 24 02:24:13.372077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4569/5561] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:13 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:13.456969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:13.457521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] [instance: adc5c738-c565-41f2-afa1-e33f4a62d3eb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:13.477230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:13.477719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:13.478376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:13.479269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:13.479903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:13.480504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:13.496891 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] HTTP exception thrown: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Request method failure captured: Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb HTTP/1.1 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYuKWOd9IZ5_E3vqamJEzEXiWFoy9xEW6WDcXqkaaSJb2a55YLw8kZSi3svgUzNyAzjYjyJH_PJLSO2s0_8ceeKarbFFe9cgaBg5bnpzInqr6Ez4ca_0J8J2JrrXiEBYjhqXmsvcF-wrUSQqY4MLTBpAsiKOY7Qqru7DgmxDrr1CK2s Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: a61c46db15544cde9a577e6eebabd877 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerMultinode-635100171 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a61c46db15544cde9a577e6eebabd877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a61c46db15544cde9a577e6eebabd877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerMultinode-635100171 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: a61c46db15544cde9a577e6eebabd877 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerMultinode-635100171 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerMultinode-635100171-project-admin Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 8b5f13cd00cb4996ac0c134014a58b84 Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerMultinode-635100171-project-admin Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'adc5c738-c565-41f2-afa1-e33f4a62d3eb'} Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:13.498594 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] Returning 404 to user: Instance adc5c738-c565-41f2-afa1-e33f4a62d3eb could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:13.503599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca9d5168-234a-43e9-80bd-df67819ae757 tempest-TestServerMultinode-635100171 tempest-TestServerMultinode-635100171-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb" status: 404 len: 111 microversion: 2.1 time: 0.056228 Aug 24 02:24:13.504841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4570/5562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:13 2022] GET /compute/v2.1/servers/adc5c738-c565-41f2-afa1-e33f4a62d3eb => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:24:13.918925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adc5c738-c565-41f2-afa1-e33f4a62d3eb", "name": "network-vif-deleted", "tag": "26e0cad5-31ac-473f-8c4d-4049ebbe9c9e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:13.938434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:13.939508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:13.940186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:13.956646 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] Creating event network-vif-deleted:26e0cad5-31ac-473f-8c4d-4049ebbe9c9e for instance adc5c738-c565-41f2-afa1-e33f4a62d3eb on n-h1-854121-3 Aug 24 02:24:13.964388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cd316a48-4504-4367-b191-ed4cde1fb256 req-146c677f-70fb-4f21-88c3-1fe50af44595 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049915 Aug 24 02:24:13.965941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4571/5563] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:14.393595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:14.394839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:14.403349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:14.405573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:14.405573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:14.406404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:14.406781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:14.407783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:14.561358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:14.570276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9752d313-995d-47f9-9bf6-454d8de6c2de tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1675 microversion: 2.1 time: 0.182469 Aug 24 02:24:14.581615 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4572/5564] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:14 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:15.593861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:15.594734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:15.604555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:15.605376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:15.606082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:15.607480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:15.608161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:15.609169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:15.922775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:15.938831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13950c3a-5b15-4a06-95b0-31267a4b2fdc tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1675 microversion: 2.1 time: 0.341717 Aug 24 02:24:15.950890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4573/5565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:15 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1675 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:16.963049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:16.963875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:16.983102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:16.986942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:16.989303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:16.992123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:16.997735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:16.998501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:17.182511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edaba266e8b3458984461dcfed847166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c1c958062b4286b2a50983aa87e606', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:17.190533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:17.198816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7b9d49c-8c20-4169-8fa8-9d4c0f566247 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 200 len: 1608 microversion: 2.1 time: 0.240974 Aug 24 02:24:17.200096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4574/5566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:16 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 1608 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:17.221813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b335e2c-68ca-463a-88cc-4a142b30bc1c", "name": "network-vif-deleted", "tag": "0ccab713-388b-432c-bb44-cdec7f86df08"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:17.240070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:17.241435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:17.242227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:17.265876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] Creating event network-vif-deleted:0ccab713-388b-432c-bb44-cdec7f86df08 for instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c on n-h2-854121-3 Aug 24 02:24:17.278948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b98949fc-9e06-4cbf-a1c7-636aab0173f3 req-e0ec0a40-ddb3-46bc-a458-6a9fa42648cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063128 Aug 24 02:24:17.280275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4575/5567] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:18.228444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:18.229070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] [instance: 7b335e2c-68ca-463a-88cc-4a142b30bc1c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:18.253714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:18.255762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:18.256871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:18.261132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:18.262002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:18.262636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:18.287682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] HTTP exception thrown: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Request method failure captured: Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c HTTP/1.1 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYksGVv4rCN54JeaE4ntyRFoeorZqOnCDRV6eWcHk2AsH-BXou20E641G2PM7SwZfxuDLReyTFQriHCfE44oYRrYuXsh4L_lzCM8X0gVWEh48NI0Fgp4JdgVuw2J8qhDL2iDxGbC45j4f8tkNcJZOZatpTaBt0g2ya7oSWRxSwuc4B4 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/47c1c958062b4286b2a50983aa87e606"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_47c1c958062b4286b2a50983aa87e606"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 47c1c958062b4286b2a50983aa87e606 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2136848741 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: edaba266e8b3458984461dcfed847166 Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2136848741-project Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '7b335e2c-68ca-463a-88cc-4a142b30bc1c'} Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:24:18.290434 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Returning 404 to user: Instance 7b335e2c-68ca-463a-88cc-4a142b30bc1c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:24:18.295676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-684c5102-88b3-41cc-8900-134af3816df8 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c" status: 404 len: 111 microversion: 2.1 time: 0.070406 Aug 24 02:24:18.296448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4576/5568] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:18 2022] GET /compute/v2.1/servers/7b335e2c-68ca-463a-88cc-4a142b30bc1c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:24:18.301308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9617d0f6-305d-4ff9-9887-83e07556b855 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] Calling method '.version_select at 0x7f6b914e84c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:18.327551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9617d0f6-305d-4ff9-9887-83e07556b855 tempest-ServerActionsTestJSON-2136848741 tempest-ServerActionsTestJSON-2136848741-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097240845" status: 202 len: 0 microversion: 2.1 time: 0.030069 Aug 24 02:24:18.333304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4577/5569] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097240845 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:24:30.360598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:30.369029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:30.516063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da42a4d2-333c-495b-9739-3cded9ee6f68 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '.version_select at 0x7f6b926ceee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:30.586653 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da42a4d2-333c-495b-9739-3cded9ee6f68 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382/defaults" status: 200 len: 371 microversion: 2.1 time: 0.241361 Aug 24 02:24:30.587164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4578/5570] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:24:30 2022] GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382/defaults => generated 371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:30.600911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87ef8948-b81e-4dd1-93b7-08b58682723d tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '.version_select at 0x7f6b914a89d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:30.702601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87ef8948-b81e-4dd1-93b7-08b58682723d tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382" status: 200 len: 371 microversion: 2.1 time: 0.105956 Aug 24 02:24:30.703198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4579/5571] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 02:24:30 2022] GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:30.717680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5ca7675-4f2f-40b9-bb33-265799e3a6bf tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '.version_select at 0x7f6b914a81f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:30.837966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5ca7675-4f2f-40b9-bb33-265799e3a6bf tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382/defaults" status: 200 len: 371 microversion: 2.1 time: 0.124536 Aug 24 02:24:30.838552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4580/5572] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:24:30 2022] GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382/defaults => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:24:30.853386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a6462a9-3816-4825-9a01-c3bca7a22f88 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '.version_select at 0x7f6b926ce550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:31.025027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a6462a9-3816-4825-9a01-c3bca7a22f88 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382" status: 200 len: 371 microversion: 2.1 time: 0.175814 Aug 24 02:24:31.029266 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4581/5573] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 02:24:30 2022] GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382 => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:31.040190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '.version_select at 0x7f6b91756d30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:31.222543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382?user_id=1f6860db99e44af983e449cf2c9d0895" status: 200 len: 371 microversion: 2.1 time: 0.186847 Aug 24 02:24:31.232939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4582/5574] 10.222.0.49 () {58 vars in 1323 bytes} [Wed Aug 24 02:24:31 2022] GET /compute/v2.1/os-quota-sets/a5b753803ca24e40ac20347c2cb72382?user_id=1f6860db99e44af983e449cf2c9d0895 => generated 371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:24:33.124940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:33.125996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001457 Aug 24 02:24:33.126330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4583/5575] 10.222.0.49 () {56 vars in 886 bytes} [Wed Aug 24 02:24:33 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 02:24:33.134429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:33.135483 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001595 Aug 24 02:24:33.135869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4584/5576] 10.222.0.49 () {54 vars in 1035 bytes} [Wed Aug 24 02:24:33 2022] GET /compute/v2/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 24 02:24:33.142752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:33.143751 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001343 Aug 24 02:24:33.144176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4585/5577] 10.222.0.49 () {54 vars in 1041 bytes} [Wed Aug 24 02:24:33 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:24:33.154261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:33.155375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce23abd3-1afa-4a1d-9b0e-89120bed7002 tempest-QuotasTestJSON-1302733883 tempest-QuotasTestJSON-1302733883-project] 10.222.0.49 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001446 Aug 24 02:24:33.156072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4586/5578] 10.222.0.49 () {56 vars in 886 bytes} [Wed Aug 24 02:24:33 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 24 02:24:48.888592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:48.889377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=18 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:24:49.270868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:49.271922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:49.278855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:49.279554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:49.280169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:49.281081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:49.281717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:49.282349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:49.311738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:24:49.430399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6fca1b5-caa3-4c45-997a-127854ae1707 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 204 len: 0 microversion: 2.1 time: 0.548786 Aug 24 02:24:49.436179 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4587/5579] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:24:48 2022] DELETE /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:24:49.450230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:49.451358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:49.465317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:49.466175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:49.466879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:49.470729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:49.471830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:49.472602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:49.646224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:49.655415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df89e69e-7b62-45bb-92d4-db8b6731a714 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1577 microversion: 2.1 time: 0.217820 Aug 24 02:24:49.665221 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4588/5580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:49 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1577 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:50.680849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:50.682227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:50.695585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:50.696298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:50.697078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:50.697989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:50.698628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:50.699244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:50.895349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:50.903731 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-133a9d10-e030-47e9-b187-b5f4f62f4f3c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1577 microversion: 2.1 time: 0.228270 Aug 24 02:24:50.932929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4589/5581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:50 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:51.928880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:51.929655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:51.939324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:51.943702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:51.944448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:51.945522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:51.946172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:51.946786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:52.216056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:52.251253 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5903296-babc-4fa7-b40d-ba6bd6e7b598 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1577 microversion: 2.1 time: 0.327062 Aug 24 02:24:52.265355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4590/5582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:51 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1577 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:52.620464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a36351fd-229e-4c1e-9074-4ad4cd5fcaac", "name": "network-vif-deleted", "tag": "35339885-684f-4a23-ba58-54568d3329e8"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:24:52.640366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:52.649757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:52.649757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:52.678479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] Creating event network-vif-deleted:35339885-684f-4a23-ba58-54568d3329e8 for instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac on n-h2-854121-3 Aug 24 02:24:52.694854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-920bbd67-252f-4fa8-9d34-d2befc9a5bc7 req-13628ff2-ff3f-4e9c-9226-cb74bf47c8ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088377 Aug 24 02:24:52.695798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4591/5583] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:24:53.274475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:53.276473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:53.293337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:53.295116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:53.295683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:53.296534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:53.298547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:53.299356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:53.439495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:53.450087 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa5629b7-642b-4ce2-87a2-b9fdfbbcd944 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1225 microversion: 2.1 time: 0.179637 Aug 24 02:24:53.464214 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4592/5584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:53 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1225 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:54.475712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:54.476433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:54.497709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:54.498233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:54.498696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:54.499434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:54.499911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:54.500359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:54.637614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:54.655633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-434f5d8d-b3f0-4824-a371-ae57311c2cec tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1225 microversion: 2.1 time: 0.185557 Aug 24 02:24:54.660582 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4593/5585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:54 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1225 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:55.681141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:55.681836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:55.694308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:55.695126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:55.695856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:55.696594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:55.703164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:55.703823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:55.804176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:55.813732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6eb828b2-57d3-48ee-b1c2-2c62337e1377 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1225 microversion: 2.1 time: 0.136566 Aug 24 02:24:55.827011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4594/5586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:55 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:56.841002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:56.841661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:56.853068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:56.853580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:56.854068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:56.854801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:56.855461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:56.856938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:56.961767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:56.970836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a050f7c-0adf-4aa3-9ae7-31289de110e5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1225 microversion: 2.1 time: 0.139559 Aug 24 02:24:56.972442 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4595/5587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:56 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:24:57.991726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:57.993184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:58.005707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:58.006225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:58.006686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:58.007413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:58.007889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:58.008335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:58.157567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:58.169168 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37fe1e84-3176-4fba-a8d0-f975ba984530 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1225 microversion: 2.1 time: 0.181566 Aug 24 02:24:58.170841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4596/5588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:57 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1225 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:24:59.193319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:24:59.194113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:24:59.235397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:59.235992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:59.236462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:59.240510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:59.242684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:59.243963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:59.303221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:24:59.305284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:24:59.305959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:24:59.310703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lazy-loading 'fault' on Instance uuid a36351fd-229e-4c1e-9074-4ad4cd5fcaac {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:24:59.433118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:24:59.453693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbb2b844-ce2c-4d0f-b823-3b2d084653bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 200 len: 1230 microversion: 2.1 time: 0.263932 Aug 24 02:24:59.470001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4597/5589] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:24:59 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 1230 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:00.480055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:00.480528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:00.502232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:00.502886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:00.503449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:00.504247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:00.505124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:00.505952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:00.524336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac HTTP/1.1 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a36351fd-229e-4c1e-9074-4ad4cd5fcaac'} Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:00.526128 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bdf8233d-234a-46b8-beb3-3461537a46df tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 404 len: 111 microversion: 2.1 time: 0.052612 Aug 24 02:25:00.537822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4598/5590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:00 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:25:00.772785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1837799363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716469685", "security_groups": [{"name": "tempest-secgroup-smoke-1480869671"}], "block_device_mapping_v2": [{"uuid": "4f7dc634-efdc-46ce-8db1-9b15ea4b7061", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:00.995857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:25:01.715755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:25:01.717038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:25:01.717743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:25:01.718376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:25:01.719099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:25:01.735405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:01.739395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:01.739395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:01.739395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:01.739395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:01.739395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:01.814514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:25:01.830869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:25:02.012500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:25:02.014922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f7dc634-efdc-46ce-8db1-9b15ea4b7061',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:25:02.269796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95119cb2-587b-4eed-8fba-dd3c89ca260a tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.504526 Aug 24 02:25:02.271558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4599/5591] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:25:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:25:02.282192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca73f6d9-3ef0-4717-8313-2e3141be85e8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:02.284921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca73f6d9-3ef0-4717-8313-2e3141be85e8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:02.365296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca73f6d9-3ef0-4717-8313-2e3141be85e8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:02.373923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca73f6d9-3ef0-4717-8313-2e3141be85e8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1094 microversion: 2.1 time: 0.096017 Aug 24 02:25:02.376032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4600/5592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:02 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:03.396484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:03.397387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:03.421442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:03.423779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:03.425513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:03.465048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:03.465721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:03.466181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:03.638017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:03.689660 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb2385aa-214d-4923-b14c-09ff73de44b8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1136 microversion: 2.1 time: 0.297776 Aug 24 02:25:03.695201 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4601/5593] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:03 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1136 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:04.715650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:04.716296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:04.729626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:04.730300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:04.730775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:04.731531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:04.732012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:04.732459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:04.903103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:04.931453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89d2b98f-4b47-4c18-adc5-3d330b27b4f1 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1210 microversion: 2.1 time: 0.219806 Aug 24 02:25:04.932058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4602/5594] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:04 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1210 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:05.534133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:05.536696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:05.545553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:05.561474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:05.562095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:05.563080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:05.563663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:05.564210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:05.621363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bef07b06-6e8b-4c7c-ba3f-13d8b54b6cdf tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.091856 Aug 24 02:25:05.640562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4603/5595] 10.222.0.49 () {60 vars in 1343 bytes} [Wed Aug 24 02:25:05 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:05.724108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:05.725581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:05.741606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:05.742498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:05.743292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:05.744793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:05.745578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:05.746455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:05.808782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:05.849032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:25:06.146650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-023afedd-51d6-4428-b820-424c1b653208 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 204 len: 0 microversion: 2.20 time: 0.425051 Aug 24 02:25:06.152185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4604/5596] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:25:05 2022] DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:25:06.161355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:06.162084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:06.176085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:06.176599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:06.179897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:06.180852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:06.181196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:06.181651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:06.965625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:06.982855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82b09182-27ab-483b-9cce-15557da91cb8 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.830153 Aug 24 02:25:06.985219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4605/5597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:06 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:07.007665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:07.008951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:07.069298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:07.072151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:07.074917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:07.075814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:07.082040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:07.104447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:07.559329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:07.568493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:07.579227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:07.581839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97892198-7044-41c0-8fe6-8f6c26c09fe0 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.592059 Aug 24 02:25:07.582654 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4606/5598] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:06 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:25:07.854346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ece57a-7ce6-42aa-b82f-f771f4ac7943", "tag": "62f8e952-318e-4cf2-bfa6-667e348f5d90"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:07.924356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:07.925032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:07.925498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:07.962641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] Creating event network-changed:62f8e952-318e-4cf2-bfa6-667e348f5d90 for instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 on n-h1-854121-3 Aug 24 02:25:07.985473 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bd5aabf6-b81e-46af-918d-77823867b7e4 req-fbef5907-204d-4082-bc11-ab20497731ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134562 Aug 24 02:25:07.987463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4607/5599] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:25:08.014713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:08.016243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:08.032798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:08.033586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:08.034274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:08.035201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:08.036047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:08.037708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:08.589473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:08.605830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b437773f-8273-4080-b9eb-dd985fba7043 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.602759 Aug 24 02:25:08.624554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4608/5600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:08 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:08.629759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:08.635145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:08.647457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:08.647979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:08.648856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:08.649682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:08.650347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:08.650960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:09.013923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:09.027766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:09.030255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:09.032179 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-685d2433-1e14-4e55-92d9-cd4adbb038ce tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1722 microversion: 2.20 time: 0.405772 Aug 24 02:25:09.033151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4609/5601] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:08 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:25:09.628066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:09.629104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:09.640861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:09.652244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:09.653021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:09.653757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:09.654749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:09.655194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:09.883180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:09.892045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf7d4876-91bf-4163-8b6b-f4adbb810aa5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.268267 Aug 24 02:25:09.892553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4610/5602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:09 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:10.058133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:10.058743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:10.068390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:10.068998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:10.069454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:10.070176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:10.070667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:10.078016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:10.272065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:10.293640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:10.305063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:10.310204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62e54dbd-515f-4f1f-bbd9-ad1fb459955b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1655 microversion: 2.20 time: 0.255866 Aug 24 02:25:10.324644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4611/5603] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:10 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1655 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:25:10.917280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:10.918172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:10.975106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:10.975913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:10.976892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:10.978232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:10.978959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:10.979628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:11.301406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:11.323374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7920aca2-a593-46ed-9c5d-219206ee3615 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.403986 Aug 24 02:25:11.325338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4612/5604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:10 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:11.351620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:11.352183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:11.361582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:11.362833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:11.363700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:11.364587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:11.365388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:11.366457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:11.641671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:11.653026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:11.662326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd03ebf2c9274253a3e3bbb58ff122ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf582657bf485498c0ed06bc6fe49c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:11.663802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc4c7e24-1972-428c-87c8-1d3d97de9b0b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 200 len: 1655 microversion: 2.20 time: 0.334170 Aug 24 02:25:11.673824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4613/5605] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:11 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 1655 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 02:25:11.837481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2", "name": "network-vif-deleted", "tag": "3024ee38-127b-45bb-a6a4-26a4cbdb2e42"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:11.863244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:11.876289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:11.877413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:11.878354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:11.962172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] Creating event network-vif-deleted:3024ee38-127b-45bb-a6a4-26a4cbdb2e42 for instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 on n-h2-854121-3 Aug 24 02:25:11.975446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-95a2bdbf-69cf-40d5-aced-4832e97ed9db req-6cebe948-5253-4211-9dc8-599fb51fd3a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143490 Aug 24 02:25:11.998949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4614/5606] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:25:12.346043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:12.347605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:12.363674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:12.364442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:12.365107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:12.366023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:12.366654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:12.367255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:12.372170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:12.962926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:12.974237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe00880a-e24b-44a0-a148-1365283fc5e4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.632764 Aug 24 02:25:12.976256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4615/5607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:12 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:12.982851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:12.983593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:13.003793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:13.008929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:13.009528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:13.011216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:13.013437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:13.015594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:13.069363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 HTTP/1.1 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2'} Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:13.079854 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:13.085678 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:13.091901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:13.092823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61682d3d-cb50-4827-b1ee-6fa35262aee5 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 404 len: 111 microversion: 2.20 time: 0.113896 Aug 24 02:25:13.093603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4616/5608] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:12 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:25:13.120661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3452b2d-9f0e-4637-9bc6-e3aabc0f697b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '.version_select at 0x7f6b916e2af0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:13.199930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3452b2d-9f0e-4637-9bc6-e3aabc0f697b tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875903123" status: 204 len: 0 microversion: 2.20 time: 0.086445 Aug 24 02:25:13.214916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4617/5609] 10.222.0.49 () {60 vars in 1259 bytes} [Wed Aug 24 02:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875903123 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 02:25:13.999507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:14.001054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:14.024130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:14.024647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:14.025144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:14.025882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:14.026354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:14.026806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:14.587677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:14.617884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c6606d2-7c36-4724-a70c-9618837f4e9b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1278 microversion: 2.1 time: 0.610185 Aug 24 02:25:14.619157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4618/5610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:13 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1278 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:15.640083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:15.640585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:15.644759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:15.664133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:15.664658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:15.665145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:15.665888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:15.666360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:15.666802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:16.031462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:16.048953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4212f642-430e-400c-aa93-99d947799517 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.412901 Aug 24 02:25:16.055313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4619/5611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:15 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:17.075494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:17.076410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:17.093728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:17.094335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:17.094799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:17.095547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:17.096544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:17.097033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:17.313129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:17.323858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cfa4b3c-dd14-42e7-987c-69fc56eed3b7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.251965 Aug 24 02:25:17.327768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4620/5612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:17 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:18.353273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:18.354215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:18.363625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:18.365001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:18.365584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:18.366428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:18.378123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:18.379560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:18.744151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:18.761663 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72f7ed4b-71a7-4461-b740-a6b7a85dcb7e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.412738 Aug 24 02:25:18.762515 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4621/5613] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:18 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:19.118639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:19.119153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:19.134866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.135380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.135834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:19.136554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.137062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.137487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:19.187355 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 HTTP/1.1 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2'} Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:19.189265 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.195310 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.201669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:19.206363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9b96bff-bd89-430e-be09-50aacfa9de75 tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 404 len: 111 microversion: 2.20 time: 0.091018 Aug 24 02:25:19.211884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4622/5614] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:25:19 2022] DELETE /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:25:19.222357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:19.223005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:19.242089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.245506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.246007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:19.246765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.247244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.247685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:19.345291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:19.351390 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 HTTP/1.1 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2'} Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.358718 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. Aug 24 02:25:19.366780 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:19.376426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance 313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:19.379270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85693277-de88-42c3-b1b2-f6ca46e4bc8e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2" status: 404 len: 111 microversion: 2.20 time: 0.164519 Aug 24 02:25:19.381722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4623/5615] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:19 2022] GET /compute/v2.1/servers/313d56ce-8e5c-46bf-b8e9-8ab56e6cafb2 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:25:19.784365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:19.785111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:19.806278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.806821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.807291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:19.808037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:19.813553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:19.816147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:20.126227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:20.146026 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a17ca5e-76f3-4120-b97a-8b73052dc67b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.366229 Aug 24 02:25:20.163743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4624/5616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:19 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:21.170805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:21.171489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:21.189491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:21.191287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:21.192492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:21.193598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:21.195502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:21.196173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:21.551408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:21.570165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbd500be-1ba8-4c84-bb47-f3ffa97cc2c3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.403431 Aug 24 02:25:21.575109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4625/5617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:21 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:22.596486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:22.599241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:22.650484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:22.651973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:22.652782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:22.653784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:22.655565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:22.656511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:22.975261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:22.986101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e4873e7-7a9d-42c9-80ba-5132948958ee tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.394264 Aug 24 02:25:22.988635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4626/5618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:22 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:24.014175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:24.014943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:24.037136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:24.037649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:24.038278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:24.039018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:24.039488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:24.039974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:24.464213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:24.473322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1fbe36ec-71e5-46f3-b2b1-f09c383fe702 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.468997 Aug 24 02:25:24.480467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4627/5619] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:24 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:25.501891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:25.503369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:25.531213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:25.532123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:25.534227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:25.535376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:25.536152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:25.537709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:25.788116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:25.806381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20f8e58d-c0dc-4bc9-80d5-33d689d97e9e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.309077 Aug 24 02:25:25.809453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4628/5620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:25 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:26.390745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:26.391256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:26.402805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.403583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.405925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:26.406860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.408314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.426528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:26.487915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae HTTP/1.1 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fe0906a9-e31a-43da-8d82-b60ae4a9c4ae'} Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:26.496008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.501115 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.521958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:26.527922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99819a16-5d11-42fe-9c01-8362e52b1c7c tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 404 len: 111 microversion: 2.20 time: 0.140939 Aug 24 02:25:26.542288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4629/5621] 10.222.0.49 () {60 vars in 1280 bytes} [Wed Aug 24 02:25:26 2022] DELETE /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 02:25:26.556999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:26.557814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] [instance: fe0906a9-e31a-43da-8d82-b60ae4a9c4ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:26.581696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.583097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.583746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:26.584660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.590484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.591222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:26.620526 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] HTTP exception thrown: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Request method failure captured: Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae HTTP/1.1 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYmsD5X4cg32Y4fmtgZB6E5VdMI5P3U5bHU5ZPXCTIEhlTaBJLT2rxJtJjStJQITnaWF21z3cTQcWfhnRpGzf_sWiHRyc57-8djVo0RWGZkCZss8oQxhQTmqgWFhvM9TetEz4sYS80Av54xIcY5jRs7KJCMuwskfg_WHi4O-zDjg37w Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ecdf582657bf485498c0ed06bc6fe49c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ecdf582657bf485498c0ed06bc6fe49c Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498052622 Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: cd03ebf2c9274253a3e3bbb58ff122ef Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498052622-project Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fe0906a9-e31a-43da-8d82-b60ae4a9c4ae'} Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.622397 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. Aug 24 02:25:26.628099 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:25:26.633632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] Returning 404 to user: Instance fe0906a9-e31a-43da-8d82-b60ae4a9c4ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:25:26.634753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-135376c7-190a-481e-b278-91fa8f5c764e tempest-AttachVolumeShelveTestJSON-498052622 tempest-AttachVolumeShelveTestJSON-498052622-project] 10.222.0.49 "GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae" status: 404 len: 111 microversion: 2.20 time: 0.091237 Aug 24 02:25:26.635345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4630/5622] 10.222.0.49 () {60 vars in 1277 bytes} [Wed Aug 24 02:25:26 2022] GET /compute/v2.1/servers/fe0906a9-e31a-43da-8d82-b60ae4a9c4ae => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 02:25:26.835807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:26.836967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:26.853144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.855789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.856519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:26.859818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:26.860922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:26.863621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:27.198074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:27.213017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44016fd5-a690-4515-bd30-47952500d19b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.384986 Aug 24 02:25:27.213621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4631/5623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:26 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:27.431268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ece57a-7ce6-42aa-b82f-f771f4ac7943", "name": "network-vif-plugged", "status": "completed", "tag": "62f8e952-318e-4cf2-bfa6-667e348f5d90"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:27.447080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:27.449268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:27.449968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:27.486321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] Creating event network-vif-plugged:62f8e952-318e-4cf2-bfa6-667e348f5d90 for instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 on n-h1-854121-3 Aug 24 02:25:27.497367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1eafeb22-50f0-4c36-b601-aa096d1ac77f req-4cf8f445-3755-48e7-b734-1c4ee7536086 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069642 Aug 24 02:25:27.500316 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4632/5624] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:25:28.253945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:28.254798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:28.274369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:28.276134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:28.310093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:28.311324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:28.312065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:28.318724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:28.693034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:28.711563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3690fb06-db3b-45d1-8c69-750be1244bb0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.464988 Aug 24 02:25:28.748539 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4633/5625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:28 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:29.745616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:29.746257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:29.802261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:29.802815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:29.812214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:29.817145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:29.819255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:29.820951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:30.372828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:30.389427 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51995de2-d1b7-407f-9f67-ba99e677deac tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1266 microversion: 2.1 time: 0.647050 Aug 24 02:25:30.390066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4634/5626] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:29 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1266 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:31.411918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:31.413693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:31.424067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:31.424995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:31.425694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:31.426894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:31.427669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:31.428560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:31.953480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:31.963725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1e2dcb2-115c-4393-adaa-04d06476fba6 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1453 microversion: 2.1 time: 0.557162 Aug 24 02:25:31.964329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4635/5627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:31 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1453 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:31.989272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:31.989969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:32.000875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:32.002135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:32.002604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:32.004008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:32.008172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:32.008892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:32.492789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:32.509452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66b23d9a-4942-4411-85d7-20bbdcdd0154 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1453 microversion: 2.1 time: 0.517810 Aug 24 02:25:32.510718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4636/5628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:31 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1453 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:36.935844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ece57a-7ce6-42aa-b82f-f771f4ac7943", "tag": "62f8e952-318e-4cf2-bfa6-667e348f5d90"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:36.968079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:36.971341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:36.972491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:37.003690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] Creating event network-changed:62f8e952-318e-4cf2-bfa6-667e348f5d90 for instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 on n-h1-854121-3 Aug 24 02:25:37.019219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-925768df-eb55-4726-a50d-97dc91028671 req-fc8178cb-e3ee-4d7f-8293-ebdf25be16bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088153 Aug 24 02:25:37.019843 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4637/5629] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:25:45.658432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-070e8112-5ae7-4be6-8b3e-c1cec4d8d2b2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: .version_select at 0x7f6b91338310>, body: {"keypair": {"name": "tempest-keypair-96824736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHflHWtYRO1AcYOwT4IkNWjemBak7+IfSvho1yJzaHN5aYFKDM4PF1pOPN7KYQ9UbiUJxABgcEox7Wv2eAifH7ZBNDiUoKoNEBcdP3V1fKS6LhhFZjjpAcTxldXUOP098w=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:45.695591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-070e8112-5ae7-4be6-8b3e-c1cec4d8d2b2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for project 8091b155401c481e9b19412d742c9c4a. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:25:45.712626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-070e8112-5ae7-4be6-8b3e-c1cec4d8d2b2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for user 58c2285adcb64632b010b881ef8da1b7 and project 8091b155401c481e9b19412d742c9c4a. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:25:45.796284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-070e8112-5ae7-4be6-8b3e-c1cec4d8d2b2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.388564 Aug 24 02:25:45.797499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4638/5630] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:25:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:25:48.025077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-948608948", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5dfb378-510f-4150-9a2d-4f83a65b23ce"}], "security_groups": [{"name": "tempest-securitygroup--104672035"}], "key_name": "tempest-keypair-96824736", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:48.048958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=68 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:48.049693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:48.480896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] validate_networks() for [('a5dfb378-510f-4150-9a2d-4f83a65b23ce', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:25:49.033046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:25:49.033669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:25:49.033959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:25:49.034922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:25:49.035593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:25:49.072290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:49.075001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:49.077700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:49.079316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:49.082422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:49.083429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:49.133281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for project 8091b155401c481e9b19412d742c9c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:25:49.149260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for user 58c2285adcb64632b010b881ef8da1b7 and project 8091b155401c481e9b19412d742c9c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:25:49.222316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:25:49.230271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:25:49.403706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9954f5f5-353a-4916-899b-0421ba142f39 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.381363 Aug 24 02:25:49.405931 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4639/5631] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:25:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:25:49.418015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc5142f7-4414-43d0-89be-19ac7daaa1cc tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:49.418654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc5142f7-4414-43d0-89be-19ac7daaa1cc tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:49.551713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc5142f7-4414-43d0-89be-19ac7daaa1cc tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:49.559612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc5142f7-4414-43d0-89be-19ac7daaa1cc tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1235 microversion: 2.1 time: 0.145576 Aug 24 02:25:49.560192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4640/5632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:49 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1235 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:50.582286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:50.583103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:50.598606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:50.598983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:50.621354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:50.622452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:50.622959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:50.623785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:51.439233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:51.452048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd3deedd-5975-40a8-a7bd-6bbafa44671b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1231 microversion: 2.1 time: 0.874139 Aug 24 02:25:51.454815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4641/5633] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:50 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1231 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:52.474879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:52.475677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:52.509992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:52.512572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:52.519831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:52.520799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:52.534420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:52.539312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:52.831613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:52.846648 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e119e01d-ea96-4274-9c4e-dac6068698c8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1293 microversion: 2.1 time: 0.371003 Aug 24 02:25:52.851460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4642/5634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:52 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1293 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:53.884309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:53.891209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:53.918562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:53.919512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:53.921111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:53.924103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:53.929858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:53.933120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:54.488341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:54.503721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef65f3bf-86c1-4b8d-aea2-894aa21fe9d6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.623383 Aug 24 02:25:54.514935 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4643/5635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:53 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:55.530749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:55.531469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:55.550670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:55.552107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:55.554177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:55.557146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:55.557818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:55.559842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:56.478088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:56.496503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e46b282-ba17-45c8-94fe-2f6ff30783e8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.963365 Aug 24 02:25:56.497268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4644/5636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:55 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:25:56.530955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3056a1-ae75-47b1-a234-3df81405a87a", "tag": "695be22c-b8be-47c9-a7d3-2f389482a891"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:25:56.570215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:56.571446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:56.573627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:56.608596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] Creating event network-changed:695be22c-b8be-47c9-a7d3-2f389482a891 for instance ad3056a1-ae75-47b1-a234-3df81405a87a on n-h2-854121-3 Aug 24 02:25:56.625657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7b23a687-6238-4640-a293-cd0daf1811fc req-fed5c608-66a5-43aa-b1f3-f52cc9b9083a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108214 Aug 24 02:25:56.628190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4645/5637] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:25:57.520349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:57.521120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:57.531890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:57.533498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:57.547482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:57.549009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:57.550322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:57.550965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:57.994221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:58.003967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d540809-a782-4832-aa65-a11aef58356e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.489351 Aug 24 02:25:58.009873 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4646/5638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:57 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:25:59.031636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:25:59.032907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:25:59.043415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:59.063946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:59.065368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:59.067290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:25:59.071430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:25:59.073049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:25:59.133641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:25:59.484859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:25:59.512875 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea2e01ed-b53a-41c3-9d06-3aabad4e10a3 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.481144 Aug 24 02:25:59.514716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4647/5639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:25:59 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:00.536006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:00.536835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:00.539008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:26:00.551269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:00.553675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:00.555010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:00.556485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:00.561131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:00.561854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:00.939602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:00.949659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7f32cd6-e913-453c-8939-d3237532dd58 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.417903 Aug 24 02:26:00.953171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4648/5640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:00 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:01.979114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:01.980820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:02.009293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:02.015049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:02.015430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:02.018774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:02.019675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:02.023489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:02.398778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:02.407419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1bbf661-cf9c-42bc-a27b-383a41f09b0a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.434136 Aug 24 02:26:02.410957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4649/5641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:01 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:03.428211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:03.429845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:03.445691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:03.446201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:03.446820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:03.447546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:03.448015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:03.448458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:03.638460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:03.651285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1e62c8d-69eb-4f03-bbbc-e0d574dcd8a2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.227070 Aug 24 02:26:03.657248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4650/5642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:03 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:04.452146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3056a1-ae75-47b1-a234-3df81405a87a", "name": "network-vif-plugged", "status": "completed", "tag": "695be22c-b8be-47c9-a7d3-2f389482a891"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:26:04.465937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:04.466694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:04.467336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:04.482277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] Creating event network-vif-plugged:695be22c-b8be-47c9-a7d3-2f389482a891 for instance ad3056a1-ae75-47b1-a234-3df81405a87a on n-h2-854121-3 Aug 24 02:26:04.489307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6af1b942-4d2b-4a38-9d0d-0722fc7f07dc req-bb5c1d51-734c-4cf8-bb7f-fe0b80b47566 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042702 Aug 24 02:26:04.490459 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4651/5643] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:26:04.677566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:04.678591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:04.688212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:04.693506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:04.697753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:04.698543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:04.699047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:04.699485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:04.929720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:04.949373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3ae3293-36f5-476e-a504-871795071bb9 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.278881 Aug 24 02:26:04.950253 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4652/5644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:04 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:05.975218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:05.975852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:05.986667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:05.987174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:05.987630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:05.992619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:05.993146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:05.993599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:06.279526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:06.291726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8209c9db-42f7-4377-b3af-ada022c96b1f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1360 microversion: 2.1 time: 0.320767 Aug 24 02:26:06.297467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4653/5645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:05 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1360 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:07.318829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:07.319608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:07.327988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:07.328823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:07.329575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:07.330772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:07.331684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:07.332337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:07.753125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:07.788380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0eb75ac0-e233-416b-87aa-b478f83470bd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1546 microversion: 2.1 time: 0.471198 Aug 24 02:26:07.791596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4654/5646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:07 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1546 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:07.814114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:07.814881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:07.823294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:07.824027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:07.824771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:07.825660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:07.826277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:07.826861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:08.061820 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49039312-37ac-49e9-97be-a415eeb67c49 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250770 Aug 24 02:26:08.071837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4655/5647] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:26:07 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:26:09.994419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3056a1-ae75-47b1-a234-3df81405a87a", "tag": "695be22c-b8be-47c9-a7d3-2f389482a891"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:26:10.008381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:10.014407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:10.015356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:10.047925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] Creating event network-changed:695be22c-b8be-47c9-a7d3-2f389482a891 for instance ad3056a1-ae75-47b1-a234-3df81405a87a on n-h2-854121-3 Aug 24 02:26:10.058022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-21d2f90f-acb6-47cf-be32-c7d620bfa05b req-2069f679-d3b0-4520-80e3-9679bea7f15b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066898 Aug 24 02:26:10.059068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4656/5648] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:26:47.405163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:26:47.406841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=84 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:26:47.412864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72c0d1b0-5f40-4367-8479-ab4c77c2ae0a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: .version_select at 0x7f6b913380d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-968544842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnpKp4WXuivFKEGy55E/aOVsFGa6ftoEk4muA1cjAxd09dNrU3Kjz/g2sL/zlO9fSwzNKlJutqF1qJMRYEhQfqPKF3e65MoO8GKvYqKgdGZIzi7KIrsfzZlfA3Ui7hPSA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:26:47.436492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-72c0d1b0-5f40-4367-8479-ab4c77c2ae0a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:26:47.444632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-72c0d1b0-5f40-4367-8479-ab4c77c2ae0a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:26:47.478785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72c0d1b0-5f40-4367-8479-ab4c77c2ae0a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.075195 Aug 24 02:26:47.480405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4657/5649] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:26:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:26:49.505113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2074686703", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "3b080dd5-880b-4ec4-aeb5-c36e69bdb5bc"}], "key_name": "tempest-TestNetworkBasicOps-968544842", "security_groups": [{"name": "tempest-secgroup-smoke-467190680"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:26:49.739858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] validate_networks() for [('3b080dd5-880b-4ec4-aeb5-c36e69bdb5bc', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:26:50.622641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:26:50.624360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:26:50.629998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:26:50.630755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:26:50.631378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:26:50.648603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:50.649451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:50.651650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:50.653453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:50.654562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:50.655435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:50.696428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:26:50.706279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:26:50.722233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:26:50.727717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:26:50.793685 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ef3f978-797a-4002-89fd-605eda48a5f2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.294059 Aug 24 02:26:50.797223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4658/5650] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:26:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:26:50.808393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3358133-312d-4d6b-b496-d513d76781e5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:50.809419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3358133-312d-4d6b-b496-d513d76781e5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:50.970645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3358133-312d-4d6b-b496-d513d76781e5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:50.978830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3358133-312d-4d6b-b496-d513d76781e5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1248 microversion: 2.1 time: 0.175049 Aug 24 02:26:50.979415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4659/5651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:50 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1248 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:52.003702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:52.004347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:52.021673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:52.022250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:52.022710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:52.023444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:52.023914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:52.040598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:52.163114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:52.178828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad068bb4-18ec-4736-af34-74117c61536f tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1244 microversion: 2.1 time: 0.179029 Aug 24 02:26:52.193754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4660/5652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:51 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1244 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:53.206775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:53.208047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:53.218389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:53.219272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:53.219916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:53.220820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:53.235503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:53.237874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:53.393254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:53.409622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29e84219-ef33-4df6-a7c0-c5c0a7885bf0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1306 microversion: 2.1 time: 0.209153 Aug 24 02:26:53.424883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4661/5653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:53 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:54.440328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:54.443894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:54.480467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:54.481600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:54.485926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:54.488036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:54.491325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:54.496036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:54.781151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:54.791938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d7aa317-cfd3-42d4-b7d6-f8322adee015 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.364292 Aug 24 02:26:54.793533 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4662/5654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:54 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:26:55.830982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:55.839522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:55.921960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:55.922932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:55.923618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:55.927032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:55.927807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:55.928948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:56.297325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:56.310159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e937907-d9ce-4c10-9b8a-39a3f8bb9dd1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.494563 Aug 24 02:26:56.314597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4663/5655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:55 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:56.322547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d77ff23-0ee6-466e-a465-5821badb5971", "tag": "464a51f2-8885-46fa-883d-4fafeaefbc74"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:26:56.348103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:56.348609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:56.351850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:56.375697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] Creating event network-changed:464a51f2-8885-46fa-883d-4fafeaefbc74 for instance 2d77ff23-0ee6-466e-a465-5821badb5971 on n-h1-854121-3 Aug 24 02:26:56.388245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-426a8ee1-e3c6-4d58-b385-a55ba3dbf71c req-577b5ec5-7ae7-4076-8138-804d9c35097c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072171 Aug 24 02:26:56.388898 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4664/5656] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:26:57.337075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:57.338578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:57.348086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:57.348950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:57.349556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:57.350462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:57.351349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:57.351952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:57.552462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:57.585499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e085b990-5259-4158-8be4-a3f739e2cf90 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.253300 Aug 24 02:26:57.586089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4665/5657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:57 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:58.608248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:58.610199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:58.621236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:58.621962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:58.622603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:58.624031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:58.624739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:58.625327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:58.869372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:26:58.884553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae3727d0-fc3b-4ada-b388-6557e57ba4d2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.278909 Aug 24 02:26:58.885713 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4666/5658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:58 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:26:59.906088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:26:59.906871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:26:59.922320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:59.923161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:59.923823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:26:59.924774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:26:59.925488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:26:59.926275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:00.132785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:00.141417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd149912-6ffc-4f7b-9ee3-4bffcf4a6d05 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.239145 Aug 24 02:27:00.155275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4667/5659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:26:59 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:01.164031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:01.166077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:01.172605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:01.174732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:01.177197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:01.177993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:01.178728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:01.179810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:01.180392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:01.181078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:01.424290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:01.438404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59176fac-8249-41aa-9219-4e8e5016adb9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.278872 Aug 24 02:27:01.438995 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4668/5660] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:01 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:02.469133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:02.470435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:02.484067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:02.484575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:02.486976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:02.487911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:02.488579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:02.489204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:02.809421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:02.820559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19f04607-689e-489e-a8f9-eb1e19a31444 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.355299 Aug 24 02:27:02.826637 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4669/5661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:02 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:03.851118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:03.853060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:03.867270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:03.868052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:03.868674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:03.870028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:03.870718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:03.871361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:04.119606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:04.128707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7920e49-b7bc-457b-9a52-33bc24ff5904 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.284164 Aug 24 02:27:04.129870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4670/5662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:03 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:04.135711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d77ff23-0ee6-466e-a465-5821badb5971", "name": "network-vif-plugged", "status": "completed", "tag": "464a51f2-8885-46fa-883d-4fafeaefbc74"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:04.148689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:04.151091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:04.151561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:04.164870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] Creating event network-vif-plugged:464a51f2-8885-46fa-883d-4fafeaefbc74 for instance 2d77ff23-0ee6-466e-a465-5821badb5971 on n-h1-854121-3 Aug 24 02:27:04.178767 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-17149fa6-b71d-4456-89a2-2c571f64f0ea req-9714f817-ed8f-4157-a325-8cb287e88558 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046631 Aug 24 02:27:04.181015 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4671/5663] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:05.156951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:05.158397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:05.165884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:05.166485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:05.166840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:05.167658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:05.168148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:05.168590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:05.322827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:05.333061 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20a2bc75-6376-4258-9380-72f85aa6b1f6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1373 microversion: 2.1 time: 0.181271 Aug 24 02:27:05.333960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4672/5664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:05 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:06.354529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:06.355866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:06.366559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:06.367237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:06.367825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:06.370287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:06.370950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:06.371571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:06.535388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:06.543614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d3755b8-4cc9-4f2e-8879-2188b9602b12 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1545 microversion: 2.1 time: 0.192843 Aug 24 02:27:06.544198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4673/5665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:06 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1545 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:06.564630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:06.565494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:06.572330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:06.573075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:06.573709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:06.574573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:06.575188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:06.575773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:06.742987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:06.751769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44126201-c29a-40ac-a9aa-70966a91340d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1545 microversion: 2.1 time: 0.190932 Aug 24 02:27:06.752351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4674/5666] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:06 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1545 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:09.286760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d77ff23-0ee6-466e-a465-5821badb5971", "tag": "464a51f2-8885-46fa-883d-4fafeaefbc74"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:09.308321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:09.308995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:09.309536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:09.338107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] Creating event network-changed:464a51f2-8885-46fa-883d-4fafeaefbc74 for instance 2d77ff23-0ee6-466e-a465-5821badb5971 on n-h1-854121-3 Aug 24 02:27:09.353498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d8bfc090-8691-41b4-8fbf-4714e6ffc746 req-f21461ac-240b-46b3-8f33-8220cfea894c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070688 Aug 24 02:27:09.354380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4675/5667] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:27:13.537843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:13.538534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:13.548326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:13.549245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:13.549926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:13.550835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:13.551534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:13.552205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:13.609287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3bab8d4-d3e9-4ec3-901e-4cbdc6019405 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/ips" status: 200 len: 146 microversion: 2.1 time: 0.078253 Aug 24 02:27:13.611256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4676/5668] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:27:13 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/ips => generated 146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:19.311421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0f18948-fc00-441a-8a0d-1f3777e5569b"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:19.313927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:19.318951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:19.339421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:19.342263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:19.342263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:19.342263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:19.342263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:19.342643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:19.355222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=91 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:19.850874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0da2304-ec7b-437d-8e14-4fa447da8cc1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544276 Aug 24 02:27:19.879794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4677/5669] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:27:19 2022] POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:22.036973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552514015", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-716469685", "security_groups": [{"name": "tempest-secgroup-smoke-1480869671"}], "block_device_mapping_v2": [{"uuid": "6b3e3f41-e1ad-422a-8867-c27bc22ee8ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "19a3159b-fe22-4f3d-a13c-d46ca84d4f97"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:22.224401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] validate_networks() for [('19a3159b-fe22-4f3d-a13c-d46ca84d4f97', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:27:22.981286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:27:22.981876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:27:22.982499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:27:22.983179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:27:22.984232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:27:23.016432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:23.017670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:23.020124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:23.021102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:23.028008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:23.028638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:23.102071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:27:23.117265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Getting quotas for user ad30acec65db4e9995475d54eaec8220 and project d493bf6b7c3648c498ea22eba0684418. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:27:23.220581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:27:23.230565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b3e3f41-e1ad-422a-8867-c27bc22ee8ab',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:27:23.693958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3246ced-b74a-4330-b657-152570789961 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.658648 Aug 24 02:27:23.697147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4678/5670] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:27:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:27:23.709894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99dceaef-c139-467b-a6b5-ddc0c3527e65 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:23.712214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99dceaef-c139-467b-a6b5-ddc0c3527e65 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:23.882858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99dceaef-c139-467b-a6b5-ddc0c3527e65 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:23.897876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99dceaef-c139-467b-a6b5-ddc0c3527e65 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1094 microversion: 2.1 time: 0.192894 Aug 24 02:27:23.898625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4679/5671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:23 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1094 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:24.924814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:24.926084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:24.940804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:24.947485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:24.957434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:24.958735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:24.958907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:24.959349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:25.109944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:25.122832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-129436ab-0b03-40ea-a0d1-467195153b30 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1192 microversion: 2.1 time: 0.206344 Aug 24 02:27:25.126618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4680/5672] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:24 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1192 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:26.156543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:26.158353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:26.178988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:26.180631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:26.181618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:26.183083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:26.184266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:26.185769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:26.410056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:26.428628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e4b3c9d-570e-4bce-8cf4-b1dde02f9b42 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1210 microversion: 2.1 time: 0.283152 Aug 24 02:27:26.431088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4681/5673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:26 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1210 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:27.454200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:27.456926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:27.489157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:27.489682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:27.490145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:27.491011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:27.491453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:27.492218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:27.838829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:27.849187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb9832f2-a892-48b8-b970-cc34e17259bb tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1278 microversion: 2.1 time: 0.401780 Aug 24 02:27:27.855520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4682/5674] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:27 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1278 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:28.409753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae372df5-01d7-4f69-86bf-495ce963c5ae", "tag": "c4abe509-0153-49b3-8ce0-6b6f06dcd688"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:28.431460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:28.433235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:28.433862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:28.461637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] Creating event network-changed:c4abe509-0153-49b3-8ce0-6b6f06dcd688 for instance ae372df5-01d7-4f69-86bf-495ce963c5ae on n-h2-854121-3 Aug 24 02:27:28.469571 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-76a78a55-09bd-4ea5-acc1-8155ebf7677d req-8a0d6cea-324b-4037-b839-ee7993a087e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410177 Aug 24 02:27:28.481515 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4683/5675] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:27:28.877219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:28.878015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:28.890683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:28.891307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:28.891853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:28.892655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:28.902701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:28.903246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:29.142354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:29.155431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c487ffa8-d0ed-442f-bdda-5caafa32cf8e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1278 microversion: 2.1 time: 0.283367 Aug 24 02:27:29.162323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4684/5676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:28 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1278 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:30.180417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:30.181406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:30.191842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:30.192757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:30.193736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:30.194839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:30.196100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:30.197513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:30.835666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:30.845347 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7087d75c-f604-41ac-a066-8c17eef6083b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1278 microversion: 2.1 time: 0.669263 Aug 24 02:27:30.864800 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4685/5677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:30 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1278 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:31.872488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:31.875086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:31.882979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:31.883704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:31.884340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:31.885385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:31.886009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:31.886602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:32.114588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:32.126912 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74140426-5190-4ae3-9cfd-fc975bbe3e07 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1278 microversion: 2.1 time: 0.258830 Aug 24 02:27:32.131499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4686/5678] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:31 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:33.157168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:33.158460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:33.161370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:33.167126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:33.167598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:33.168275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:33.169052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:33.169752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:33.170372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:33.381684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:33.392430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-669d10e1-74f2-44df-ac0e-8fe335beb39c tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1278 microversion: 2.1 time: 0.239206 Aug 24 02:27:33.393063 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4687/5679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:33 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:33.897805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:33.899793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:33.905787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:33.906296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:33.906757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:33.929846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:27:33.976945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39e5a4df-ae88-467b-9c43-5f5c52afc028 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action" status: 202 len: 0 microversion: 2.1 time: 0.082799 Aug 24 02:27:33.977668 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4688/5680] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:27:33 2022] POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:27:33.983674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1550891718", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "bfee6b73-4057-4764-92d1-168f0bf2b683"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:34.040933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] validate_networks() for [('bfee6b73-4057-4764-92d1-168f0bf2b683', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:27:34.462585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:27:34.463195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:27:34.463481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:27:34.463927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:27:34.464368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:27:34.474351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.474846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.475292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.476247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.476741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.477176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.494121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Getting quotas for project 44fa64d0d9a1447c9e5f8d815f444cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:27:34.500509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Getting quotas for user dd4f0336d3c7448bb89f929506afc9d0 and project 44fa64d0d9a1447c9e5f8d815f444cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:27:34.514847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:27:34.517663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:27:34.564922 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a941de0-fd79-4b1b-9d77-dbfb3dfb0961 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585699 Aug 24 02:27:34.565639 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4689/5681] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:27:34.570072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:34.570886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:34.578940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.579632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.580482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.581387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.581990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.582575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.735113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:34.748867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e48f78f7-52d0-41c5-98d7-528c72eae978 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.182232 Aug 24 02:27:34.757397 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4690/5682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:34 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:34.764661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:34.765503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:34.779545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.780069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.784926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.786085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:34.786858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:34.787213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:34.958250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:34.966422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bf239ff-4a56-4a21-957c-83657c627cf3 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.207684 Aug 24 02:27:34.967647 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4691/5683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:34 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:34.972442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-989fcfb3-b379-44d2-a19e-be71ff9f93d1 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:34.973204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-989fcfb3-b379-44d2-a19e-be71ff9f93d1 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:35.037735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-989fcfb3-b379-44d2-a19e-be71ff9f93d1 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:35.046462 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-989fcfb3-b379-44d2-a19e-be71ff9f93d1 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1214 microversion: 2.1 time: 0.077444 Aug 24 02:27:35.046985 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4692/5684] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:34 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:35.779988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:35.780633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:35.787581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:35.788334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:35.788969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:35.789902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:35.790364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:35.790781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:35.965156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:35.975958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ce05b23-e6a2-420a-be33-be0a16f47ef6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.200517 Aug 24 02:27:35.977540 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4693/5685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:35 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:35.991181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:35.992046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:35.999939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:36.000443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:36.000943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:36.001684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:36.002308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:36.002886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:36.208727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:36.217055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8855e8af-5a14-4723-a6bb-c686a893b962 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.230604 Aug 24 02:27:36.217953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4694/5686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:35 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:36.222482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:36.223116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:36.229209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:36.229729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:36.230190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:36.230920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:36.231396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:36.232250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:36.248989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:36.300291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:36.308534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99f8f6a9-84ec-4a8f-a86e-abe36cc3dfd0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1272 microversion: 2.1 time: 0.089541 Aug 24 02:27:36.309159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4695/5687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:36 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:36.998263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:36.999519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:37.010622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.011354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.012048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.013155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.013784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.014384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.214637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:37.223703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-965f6eb6-9b4b-47f1-aeab-cccf4ef8153b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.229329 Aug 24 02:27:37.224281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4696/5688] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:36 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:37.243345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:37.243977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:37.251047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.251556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.252045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.252824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.253301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.253750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.395445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:37.404457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a3891f1-cc37-4ef8-8eb7-6a72f5b34b40 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.168627 Aug 24 02:27:37.405082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4697/5689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:37 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:37.409715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:37.410340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:37.416542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.417081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.417533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.418251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:37.418719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:37.419158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:37.553971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:37.566925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f9bdad8-8b86-4dbc-9df0-6686e85909dd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.160436 Aug 24 02:27:37.573172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4698/5690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:37 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:38.182379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ead2dc-45c3-4b9e-aa42-71fd82982f13", "tag": "5e01fdcb-163b-4b3c-ab69-2b719bd61238"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:38.195354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.195992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.196547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.209459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] Creating event network-changed:5e01fdcb-163b-4b3c-ab69-2b719bd61238 for instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 on n-h1-854121-3 Aug 24 02:27:38.215403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cb5fd3bd-1747-4465-933a-852f33a31b17 req-03749632-e450-44b7-84e5-72f477e23660 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038243 Aug 24 02:27:38.216181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4699/5691] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:38.245838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:38.246710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:38.255797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.256637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.257232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.258099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.258675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.259225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.451412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:38.463945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-385842f8-d46e-4f0a-8c0e-1c9197725e75 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.222912 Aug 24 02:27:38.465050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4700/5692] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:38 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:38.471231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:38.472232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:38.479190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.479814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.480414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.481909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.482486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.483069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.690620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:38.698613 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ca58a962-0bee-493b-a843-5141930e4532 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.231438 Aug 24 02:27:38.699179 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4701/5693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:38 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:38.704495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:38.705582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:38.723229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.723934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.724465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.725291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:38.725871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:38.726415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:38.880268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:38.889342 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b97aab52-de45-49a4-9e88-d3bbb865f636 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.188978 Aug 24 02:27:38.890038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4702/5694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:38 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:39.488004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:39.488793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:39.495898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:39.496329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:39.496813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:39.497518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:39.497995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:39.498457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:39.648196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:39.657803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-891cbc76-9ff8-45d6-b6cc-164743f5d4d4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.173760 Aug 24 02:27:39.665199 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4703/5695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:39 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:39.671676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:39.674613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:39.681280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:39.681884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:39.682416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:39.683220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:39.683771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:39.684330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:40.756607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96ce54e7-a617-495e-8807-b0f4547717b2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971/action" status: 200 len: 24567 microversion: 2.1 time: 1.089970 Aug 24 02:27:40.757474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4704/5696] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:27:39 2022] POST /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971/action => generated 24567 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:27:40.763738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:40.764766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:40.771677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:40.772406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:40.773118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:40.773967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:40.774510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:40.775177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:40.913369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:40.921711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cd1449f-2a39-492b-b59c-570c347f93aa tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.162951 Aug 24 02:27:40.924759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4705/5697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:40 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:40.927385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:40.928010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:40.933903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:40.934401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:40.934852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:40.935743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:40.936246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:40.936684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:41.070085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:41.078391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65363fb6-c317-410e-b90a-91b92fab1a5e tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.154819 Aug 24 02:27:41.078967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4706/5698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:40 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:41.229373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae372df5-01d7-4f69-86bf-495ce963c5ae", "name": "network-vif-plugged", "status": "completed", "tag": "c4abe509-0153-49b3-8ce0-6b6f06dcd688"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:41.239701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:41.240543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:41.241241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:41.255965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] Creating event network-vif-plugged:c4abe509-0153-49b3-8ce0-6b6f06dcd688 for instance ae372df5-01d7-4f69-86bf-495ce963c5ae on n-h2-854121-3 Aug 24 02:27:41.263249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c124b7cd-ce65-4e0b-af7f-ebb341031316 req-e028446b-8637-41d7-81fb-e87ee941f421 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182292 Aug 24 02:27:41.264182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4707/5699] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:41.272984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:41.273906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:41.280538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:41.281077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:41.281530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:41.282998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:41.283709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:41.284195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:41.471952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:41.481075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d0e2026-bc57-4899-8d50-549b09f2f8db tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.212130 Aug 24 02:27:41.481991 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4708/5700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:41 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:41.942604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:41.943981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:41.956455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:41.957462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:41.957608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:41.958345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:41.958880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:41.959547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:42.099728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:42.108740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ab475dc-c8b0-4c0a-8b7a-9b2b43c3bb67 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1266 microversion: 2.1 time: 0.170203 Aug 24 02:27:42.109594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4709/5701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:41 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:42.115231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:42.115856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:42.117788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:42.123639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:42.124163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:42.124666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:42.125418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:42.125878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:42.126309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:42.273714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:42.289034 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8b78c22-dcee-4dda-894c-1a543792cd8c tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.176970 Aug 24 02:27:42.295308 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4710/5702] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:42 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:42.502933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:42.503567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:42.509723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:42.510244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:42.510665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:42.511447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:42.511853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:42.512294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:42.646485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:42.655163 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77ec76de-17c5-468e-bcc3-c7760013b719 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.156060 Aug 24 02:27:42.655744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4711/5703] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:42 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:43.130163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:43.130896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:43.138457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.139033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.139554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.140333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.140838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.141280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.312222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:43.322186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cea66780-7a75-4195-a61b-3acf8d0d3eb2 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1453 microversion: 2.1 time: 0.195933 Aug 24 02:27:43.322859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4712/5704] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:43 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:43.328054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:43.328775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:43.334945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.335656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.336184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.337002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.338159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.338764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.531412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:43.539623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:43.549076 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58e5a228-740b-4102-8c3f-e3d3d07f9a57 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.225086 Aug 24 02:27:43.549662 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4713/5705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:43 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:43.554949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:43.555669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:43.562265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.562846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.563375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.564160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.564698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.565351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.727165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:43.735716 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1935c90-6466-4e38-a205-2c49de7d74bc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1453 microversion: 2.1 time: 0.184229 Aug 24 02:27:43.742557 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4714/5706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:43 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:43.742557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:43.742557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:43.749674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.750425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.751041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.752072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.752908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.753352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.941364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:43.951048 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c1931d7-8be5-4815-8ac5-5b89fecb2286 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.213156 Aug 24 02:27:43.951643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4715/5707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:43 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:43.958487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ead2dc-45c3-4b9e-aa42-71fd82982f13", "name": "network-vif-plugged", "status": "completed", "tag": "5e01fdcb-163b-4b3c-ab69-2b719bd61238"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:43.968423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:43.968959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:43.969421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:43.980897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] Creating event network-vif-plugged:5e01fdcb-163b-4b3c-ab69-2b719bd61238 for instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 on n-h1-854121-3 Aug 24 02:27:43.986333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0dd03b11-81ef-453c-a806-3f1758a0ece7 req-d7902f04-6c17-46e2-83ae-337204fb0cfc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Aug 24 02:27:43.987086 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4716/5708] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:44.568787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:44.574424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:44.575413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:44.583668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:44.584187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:44.584836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:44.585629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:44.586026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:44.586757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:44.875678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:44.890730 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e679012e-d342-486d-b09c-82ff6687f6d3 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1314 microversion: 2.1 time: 0.319883 Aug 24 02:27:44.904743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4717/5709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:44 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:44.972771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:44.973718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:44.980690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:44.981591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:44.982224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:44.983148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:44.983834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:44.984506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:45.043654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:45.201169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:45.210419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-712bdf30-c35f-4bd9-a7c6-3a9ce1212d51 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1721 microversion: 2.1 time: 0.241627 Aug 24 02:27:45.212244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4718/5710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:44 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:45.916637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:45.917293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:45.925303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:45.925907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:45.926453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:45.927239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:45.927930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:45.928534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.171455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:46.180429 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98948969-469b-4d8c-b618-1a8ea9d6b733 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1498 microversion: 2.1 time: 0.267736 Aug 24 02:27:46.191933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4719/5711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:45 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:46.236608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:46.237328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:46.245820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.246059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.246592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.247672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.248364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.248843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.482592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:46.494286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdd6cd7d-9868-42a9-8f6e-43e25c51a8fb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1698 microversion: 2.1 time: 0.265061 Aug 24 02:27:46.507193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4720/5712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:46 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:46.517762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:46.532106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.532624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.533299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.571373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 02:27:46.633538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-594a9cd3-5cf5-4716-8129-066e12b42c08 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action" status: 202 len: 0 microversion: 2.1 time: 0.120583 Aug 24 02:27:46.638966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4721/5713] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:27:46 2022] POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:27:46.939656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae372df5-01d7-4f69-86bf-495ce963c5ae", "tag": "c4abe509-0153-49b3-8ce0-6b6f06dcd688"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:46.951058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.951941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.952604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.969418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] Creating event network-changed:c4abe509-0153-49b3-8ce0-6b6f06dcd688 for instance ae372df5-01d7-4f69-86bf-495ce963c5ae on n-h2-854121-3 Aug 24 02:27:46.976253 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ac4650e7-d344-4ffe-94b7-12859397adc6 req-175b414f-a3df-4b7b-b493-4520d406aa32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.334419 Aug 24 02:27:46.978068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4722/5714] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:46.985481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:46.986555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:46.993555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.994442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.995128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:46.996117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:46.998697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:46.999634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:47.192533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:47.201861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e2f07a0-ec93-47b9-86b8-cc13e131f13e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1707 microversion: 2.1 time: 0.222195 Aug 24 02:27:47.202894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4723/5715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:46 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1707 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:47.208629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:47.209167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:47.216371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:47.216987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:47.217439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:47.218153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:47.218617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:47.219049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:47.252656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:27:47.386868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5109b83-2bf6-40dc-8415-6185cb257a15 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 204 len: 0 microversion: 2.1 time: 0.182712 Aug 24 02:27:47.392262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4724/5716] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:27:47 2022] DELETE /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:27:47.399349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:47.400277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:47.408820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:47.409612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:47.410071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:47.411251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:47.411726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:47.412167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:47.603496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:47.612538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-073ec59c-3788-40b5-95e2-19bc12d15aab tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1504 microversion: 2.1 time: 0.218654 Aug 24 02:27:47.624776 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4725/5717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:47 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:48.223431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:48.224058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:48.231610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:48.232114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:48.232567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:48.233310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:48.233783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:48.234257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:48.364221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:48.372499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9dfa7b5-d3b1-4063-8329-70e36d2d4f69 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1707 microversion: 2.1 time: 0.153004 Aug 24 02:27:48.373103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4726/5718] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:48 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:48.634186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:48.634719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:48.641286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:48.641780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:48.642223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:48.642915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:48.643377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:48.643837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:48.771792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:48.779538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-210206c5-1fc6-4706-840f-a4f69b9042c4 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1504 microversion: 2.1 time: 0.149313 Aug 24 02:27:48.780111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4727/5719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:48 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:49.394903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:49.396538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:49.404984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.405498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.406009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.407071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.407555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.408044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.630232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:49.639934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ff133dd-c510-4c52-adf1-cb4fa6221521 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1711 microversion: 2.1 time: 0.250135 Aug 24 02:27:49.640517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4728/5720] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:49 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1711 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:49.648887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ead2dc-45c3-4b9e-aa42-71fd82982f13", "name": "network-vif-deleted", "tag": "5e01fdcb-163b-4b3c-ab69-2b719bd61238"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:49.660533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.661057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.661534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.665852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:27:49.676421 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] Creating event network-vif-deleted:5e01fdcb-163b-4b3c-ab69-2b719bd61238 for instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 on n-h1-854121-3 Aug 24 02:27:49.682088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-63e66547-b5b6-4bd4-abba-1781279ba14a req-59f6af8b-3574-433d-9fa2-fe4839fa5694 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040427 Aug 24 02:27:49.682901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4729/5721] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:49.808690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:49.809455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:49.816486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.816989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.817470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.818175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.818635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.819071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.851370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:49.851784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:49.852229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:49.852685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lazy-loading 'fault' on Instance uuid 80ead2dc-45c3-4b9e-aa42-71fd82982f13 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:27:49.895102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:49.903600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39485877-8e18-4807-b282-45156b08f8a0 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 200 len: 1304 microversion: 2.1 time: 0.099351 Aug 24 02:27:49.904169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4730/5722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:49 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:50.923978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:50.924912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 80ead2dc-45c3-4b9e-aa42-71fd82982f13] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:50.931743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:50.932249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:50.932703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:50.933438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:50.934526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:50.934998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:50.948387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] HTTP exception thrown: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Request method failure captured: Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 HTTP/1.1 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYyUCS-OBdQ4idXwIJsskXaukxsWS_IE1cRbIFxwDsrnCNkwe_y0jQLEdoUkB9pIQETcdxX_cCM06UuC2pPsX-h3mllLplqyiEMsSnC_7mGgj7-aCYyPI-VRM2dtouk_pVcPAX_DbZYAKID4rg3kzcVlpM4EjTsHXOjRNV-a7sbwFD4 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 44fa64d0d9a1447c9e5f8d815f444cdc Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesActionsTest-1527637113 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesActionsTest-1527637113 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 44fa64d0d9a1447c9e5f8d815f444cdc Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesActionsTest-1527637113 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesActionsTest-1527637113-project Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: dd4f0336d3c7448bb89f929506afc9d0 Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesActionsTest-1527637113-project Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '80ead2dc-45c3-4b9e-aa42-71fd82982f13'} Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:27:50.950215 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Returning 404 to user: Instance 80ead2dc-45c3-4b9e-aa42-71fd82982f13 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22a04a99-a061-420f-8aa8-196202999585 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13" status: 404 len: 111 microversion: 2.1 time: 0.031606 Aug 24 02:27:50.954406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4731/5723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:50 2022] GET /compute/v2.1/servers/80ead2dc-45c3-4b9e-aa42-71fd82982f13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:27:51.051969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1298472618", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "bfee6b73-4057-4764-92d1-168f0bf2b683"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:51.105053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] validate_networks() for [('bfee6b73-4057-4764-92d1-168f0bf2b683', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:27:51.469649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:27:51.470091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:27:51.470579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:27:51.471006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:27:51.471433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:27:51.480349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:51.480886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:51.481339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:51.482100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:51.482571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:51.483011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:51.499732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Getting quotas for project 44fa64d0d9a1447c9e5f8d815f444cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:27:51.505040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Getting quotas for user dd4f0336d3c7448bb89f929506afc9d0 and project 44fa64d0d9a1447c9e5f8d815f444cdc. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:27:51.517895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:27:51.520336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:27:51.565810 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d54d2600-21a1-436b-846b-2fb6546e7d30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517713 Aug 24 02:27:51.566650 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4732/5724] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:27:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:27:51.577553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8ba2449-4ef7-4cdf-b55b-413e5b31281a tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:51.578180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8ba2449-4ef7-4cdf-b55b-413e5b31281a tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:51.631484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8ba2449-4ef7-4cdf-b55b-413e5b31281a tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:51.651715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8ba2449-4ef7-4cdf-b55b-413e5b31281a tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1214 microversion: 2.1 time: 0.078288 Aug 24 02:27:51.652608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4733/5725] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:51 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:52.673713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:52.674425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:52.681708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:52.682214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:52.682667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:52.683380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:52.683850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:52.684321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:52.752356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:52.761003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8d0f4b2-5a16-41b2-8b80-7ec9bc664ec2 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1266 microversion: 2.1 time: 0.091301 Aug 24 02:27:52.761673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4734/5726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:52 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:53.782595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:53.783823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:53.791616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:53.792211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:53.792754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:53.794027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:53.794682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:53.795127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:53.944192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:53.953099 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-174394d9-3e6f-4273-a1dc-735f3e5aeebe tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.174669 Aug 24 02:27:53.956958 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4735/5727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:53 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:54.074165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60201d64-3231-4198-a2a9-51c5be0fd633", "tag": "37bce4aa-6275-451e-b162-3f18c4aa0784"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:54.084930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:54.085652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:54.086172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:54.099580 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] Creating event network-changed:37bce4aa-6275-451e-b162-3f18c4aa0784 for instance 60201d64-3231-4198-a2a9-51c5be0fd633 on n-h1-854121-3 Aug 24 02:27:54.106758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3b74e26f-7bdb-45ef-960a-4bc6be338ae3 req-eb7737b0-dad5-4886-bbee-e6a96c612acd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036032 Aug 24 02:27:54.108110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4736/5728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:27:54.977167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:54.977879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:54.984579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:54.985091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:54.985540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:54.986240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:54.986835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:54.987273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:55.118667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:55.127287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15f06162-0b70-424e-81bd-9d3a59344e72 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.155677 Aug 24 02:27:55.127848 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4737/5729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:54 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:56.147828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:56.148469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:56.156079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:56.156611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:56.157092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:56.157812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:56.158286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:56.158729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:56.295044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:56.303228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22e091b8-dc13-4f52-b9d6-0620a1fbc7cf tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.159157 Aug 24 02:27:56.303693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4738/5730] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:56 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:57.326752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:57.328401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:57.336557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:57.337490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:57.338075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:57.339074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:57.339666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:57.340161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:57.491965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:57.500228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36be9bd9-5de6-46ae-aac6-33409c4375cd tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.180608 Aug 24 02:27:57.501111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4739/5731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:57 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:27:58.521740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:58.522383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:58.529460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:58.530129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:58.530583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:58.531280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:58.531749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:58.532175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:58.668832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:58.677106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0b445d4-4d9e-4211-ad47-13307a6a6355 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.160589 Aug 24 02:27:58.677736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4740/5732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:58 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:59.698724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:27:59.699437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:27:59.707081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:59.707783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:59.708792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:59.709508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:59.709993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:59.710622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:59.858446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:27:59.868941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47b92e1f-dd31-4e05-b943-e1705840db30 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.173796 Aug 24 02:27:59.869543 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4741/5733] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:27:59 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:27:59.949796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60201d64-3231-4198-a2a9-51c5be0fd633", "name": "network-vif-plugged", "status": "completed", "tag": "37bce4aa-6275-451e-b162-3f18c4aa0784"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:27:59.960490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:27:59.962325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:27:59.962325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:27:59.985431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] Creating event network-vif-plugged:37bce4aa-6275-451e-b162-3f18c4aa0784 for instance 60201d64-3231-4198-a2a9-51c5be0fd633 on n-h1-854121-3 Aug 24 02:27:59.991945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a71c07f2-641f-450b-8339-d2d98c6cb81b req-c2f13675-b0cb-4ce3-a04b-abcca649f67f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045990 Aug 24 02:27:59.992569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4742/5734] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:28:00.892057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:00.892741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:00.900012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:00.900580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:00.901152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:00.903216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:00.903216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:00.903411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:01.039735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:01.048309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7a031cf-ee7c-46b0-9f28-b5a8788d4fb5 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1314 microversion: 2.1 time: 0.162308 Aug 24 02:28:01.048899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4743/5735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:00 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:02.069664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:02.070306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:02.072275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:02.073128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:02.080250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.080774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.081229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.081941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.082412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.082852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.219700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:02.234892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85fa433f-2fef-4a81-9074-8e28db874045 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1499 microversion: 2.1 time: 0.163236 Aug 24 02:28:02.234892 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4744/5736] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:02 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:02.667129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:02.667644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:02.674374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.674866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.675309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.676006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.676466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.676936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.703686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:28:02.775724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:02.780213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6cda790d-ca8a-45ba-9fbc-f6fd34c0d133 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "DELETE /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 204 len: 0 microversion: 2.1 time: 0.115981 Aug 24 02:28:02.781405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4745/5737] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:28:02 2022] DELETE /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:28:02.790107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:02.790824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:02.798092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.798597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.799057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.799820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:02.800234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:02.800673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:02.935664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:02.943713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44220985-de4d-4aa5-8aa4-870ad8bdfafc tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1505 microversion: 2.1 time: 0.158041 Aug 24 02:28:02.944297 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4746/5738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:02 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:03.965502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:03.966920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:03.974277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:03.974795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:03.975251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:03.975997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:03.976547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:03.977026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:04.135929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:04.151596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79d657f1-b5fb-4d57-8d29-eb312113c404 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1505 microversion: 2.1 time: 0.189987 Aug 24 02:28:04.153188 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4747/5739] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:03 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:04.793130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60201d64-3231-4198-a2a9-51c5be0fd633", "name": "network-vif-deleted", "tag": "37bce4aa-6275-451e-b162-3f18c4aa0784"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:04.803515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:04.804015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:04.804470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:04.807251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:04.819356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] Creating event network-vif-deleted:37bce4aa-6275-451e-b162-3f18c4aa0784 for instance 60201d64-3231-4198-a2a9-51c5be0fd633 on n-h1-854121-3 Aug 24 02:28:04.829118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-791ab42f-0af6-4797-882a-7d4e68cf8570 req-5c3665f8-5c93-43ca-964f-356906726001 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039727 Aug 24 02:28:04.830648 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4748/5740] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:28:05.178687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:05.179515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:05.187458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:05.187956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:05.188402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:05.189132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:05.189632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:05.190050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:05.222513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:05.223001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:05.223446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:05.223899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lazy-loading 'fault' on Instance uuid 60201d64-3231-4198-a2a9-51c5be0fd633 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:28:05.266927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd4f0336d3c7448bb89f929506afc9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44fa64d0d9a1447c9e5f8d815f444cdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:05.274782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3907d696-08e4-4cb5-b63f-14abf56d71fa tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 200 len: 1304 microversion: 2.1 time: 0.101851 Aug 24 02:28:05.275346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4749/5741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:05 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:06.296354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:06.297121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] [instance: 60201d64-3231-4198-a2a9-51c5be0fd633] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:06.304326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:06.304863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:06.305323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:06.306043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:06.306521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:06.306969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:06.321417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] HTTP exception thrown: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Request method failure captured: Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 HTTP/1.1 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYyUCS-OBdQ4idXwIJsskXaukxsWS_IE1cRbIFxwDsrnCNkwe_y0jQLEdoUkB9pIQETcdxX_cCM06UuC2pPsX-h3mllLplqyiEMsSnC_7mGgj7-aCYyPI-VRM2dtouk_pVcPAX_DbZYAKID4rg3kzcVlpM4EjTsHXOjRNV-a7sbwFD4 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 44fa64d0d9a1447c9e5f8d815f444cdc Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesActionsTest-1527637113 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44fa64d0d9a1447c9e5f8d815f444cdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesActionsTest-1527637113 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 44fa64d0d9a1447c9e5f8d815f444cdc Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesActionsTest-1527637113 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesActionsTest-1527637113-project Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: dd4f0336d3c7448bb89f929506afc9d0 Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesActionsTest-1527637113-project Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '60201d64-3231-4198-a2a9-51c5be0fd633'} Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:28:06.323196 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] Returning 404 to user: Instance 60201d64-3231-4198-a2a9-51c5be0fd633 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-830ad857-3a2b-48ff-9016-fc08446d9d32 tempest-VolumesActionsTest-1527637113 tempest-VolumesActionsTest-1527637113-project] 10.222.0.49 "GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633" status: 404 len: 111 microversion: 2.1 time: 0.033263 Aug 24 02:28:06.327847 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4750/5742] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:06 2022] GET /compute/v2.1/servers/60201d64-3231-4198-a2a9-51c5be0fd633 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:28:14.954343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32088c54-8d0c-41e4-8732-81fa7760214d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: .version_select at 0x7f6b9126d0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1170284781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNETGXUcMOPyRj5Ni1uvHWgEpT4yzT61VxJntf5/Q+iheUbgCZKQi3NqaW5k72TtqdoP0B1YTzM3t1Mhf05sFoiVDZULYjAuB+z9+5MEYCt5i9DwLmuhyx4ZbDhEZ9h9lg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:14.973639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-32088c54-8d0c-41e4-8732-81fa7760214d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:28:14.980486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-32088c54-8d0c-41e4-8732-81fa7760214d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:28:15.011370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32088c54-8d0c-41e4-8732-81fa7760214d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.060380 Aug 24 02:28:15.017299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4751/5743] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:28:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:28:16.637531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-303851815", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "09b14729-1493-48a1-b0b9-b0ce5c9e8d65"}], "key_name": "tempest-TestNetworkBasicOps-1170284781", "security_groups": [{"name": "tempest-secgroup-smoke-1089677030"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:16.673170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=11 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:16.847326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] validate_networks() for [('09b14729-1493-48a1-b0b9-b0ce5c9e8d65', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:28:17.621899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:28:17.622615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:28:17.623853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:28:17.624894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:28:17.625642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:28:17.636273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:17.636802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:17.637381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:17.638301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:17.639373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:17.639974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:17.662567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:28:17.669108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:28:17.686054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:28:17.689093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:28:17.760007 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49f04afe-ee78-405d-bf4b-80770f763dd6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.126755 Aug 24 02:28:17.767846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4752/5744] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:28:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:28:17.773872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efbab206-0641-4dd2-bbe4-d882ebae2aa3 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:17.774772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efbab206-0641-4dd2-bbe4-d882ebae2aa3 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:17.863395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-efbab206-0641-4dd2-bbe4-d882ebae2aa3 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:17.874612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efbab206-0641-4dd2-bbe4-d882ebae2aa3 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1248 microversion: 2.1 time: 0.105596 Aug 24 02:28:17.876562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4753/5745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:17 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1248 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:18.902974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:18.903626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:18.916871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:18.918394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:18.919195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:18.920118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:18.920915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:18.921512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:19.036411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:19.048644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-242818fd-74da-473d-a0a2-e0de3c50c4d6 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1300 microversion: 2.1 time: 0.152280 Aug 24 02:28:19.050463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4754/5746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:18 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:20.071079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:20.071748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:20.088642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:20.094474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:20.095304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:20.103784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:20.117486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:20.126860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:20.340535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:20.352877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7c4558d-388f-4855-accd-b23fd8acf8da tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1306 microversion: 2.1 time: 0.285668 Aug 24 02:28:20.354064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4755/5747] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:20 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1306 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:21.375316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:21.375943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:21.398545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:21.399076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:21.399533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:21.402101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:21.405166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:21.405862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:21.661387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:21.681616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f445d1c-1ee0-48ad-b6b6-ccdc97a9e61d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.308062 Aug 24 02:28:21.688908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4756/5748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:21 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:21.879545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2da612f8-8bd4-4ecf-8902-bbdc6e6155a1", "tag": "5d47cc9e-3277-433c-9b1d-d3260fbf7b04"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:21.899921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:21.902819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:21.903500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:21.929089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] Creating event network-changed:5d47cc9e-3277-433c-9b1d-d3260fbf7b04 for instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 on n-h1-854121-3 Aug 24 02:28:21.940687 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8eed4951-0320-4d5c-94d4-2ca4a0fbbf1f req-e5ea59a0-916f-438b-9710-af93877e0c06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063223 Aug 24 02:28:21.942236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4757/5749] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:28:22.710158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:22.713762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:22.726639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:22.727379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:22.728058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:22.729823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:22.730723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:22.731495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:22.895203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:22.903530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a3feeac-5fe8-4018-9245-8954dedc6f63 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.201961 Aug 24 02:28:22.913964 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4758/5750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:22 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:23.925744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:23.926629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:23.940901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:23.942643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:23.944661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:23.945538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:23.948592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:23.949307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:24.162981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:24.173757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b6b6af6-6ef2-41d6-8575-735942bf83e7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.250628 Aug 24 02:28:24.184795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4759/5751] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:23 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:25.194927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:25.195555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:25.207372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:25.210249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:25.210944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:25.212373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:25.213320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:25.214787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:25.453801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:25.471056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77270c99-5ea7-42cb-9804-153714a76872 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.279201 Aug 24 02:28:25.473396 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4760/5752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:25 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:26.497181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:26.498463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:26.507282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:26.507876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:26.508404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:26.509248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:26.509792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:26.510304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:26.777450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:26.785661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-939117d9-6ac5-4b02-8897-4d93350ff03c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.294029 Aug 24 02:28:26.790918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4761/5753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:26 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:27.807185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:27.807900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:27.810635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:27.816617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:27.817148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:27.817613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:27.818337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:27.818811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:27.819265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:27.868314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:27.955871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:27.965221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5dcf5e2a-98af-4313-b0ab-1c00091642ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.161818 Aug 24 02:28:27.966061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4762/5754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:27 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:28.236201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da612f8-8bd4-4ecf-8902-bbdc6e6155a1", "name": "network-vif-plugged", "status": "completed", "tag": "5d47cc9e-3277-433c-9b1d-d3260fbf7b04"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:28.248287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:28.248836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:28.249580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:28.261561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] Creating event network-vif-plugged:5d47cc9e-3277-433c-9b1d-d3260fbf7b04 for instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 on n-h1-854121-3 Aug 24 02:28:28.266626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-793931aa-cb0f-444d-9761-69f729df6551 req-5e5ed1b4-d10a-4a23-94c4-9d097bdb388c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Aug 24 02:28:28.267606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4763/5755] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:28:28.988274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:28.989012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:28.997024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:28.997509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:28.997942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:28.998649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:28.999113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:28.999550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:29.150360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:29.158511 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07a5db79-5a05-4193-9531-77a30f75a91a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1374 microversion: 2.1 time: 0.175137 Aug 24 02:28:29.159095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4764/5756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:28 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:30.179751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:30.180394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:30.189489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:30.190332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:30.191529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:30.192732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:30.193421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:30.194066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:30.376252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:30.386684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92c4bae2-0285-4db3-9a3f-7a8459bfb715 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1547 microversion: 2.1 time: 0.209734 Aug 24 02:28:30.387834 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4765/5757] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:30 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:30.410550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:30.411181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:30.418481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:30.418986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:30.419436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:30.420145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:30.420613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:30.421076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:30.590146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:30.599654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12e928a2-7d5d-4361-a223-89d426119478 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1547 microversion: 2.1 time: 0.194541 Aug 24 02:28:30.612815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4766/5758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:30 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1547 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:45.162852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:45.163518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:45.165948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:45.166909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=72 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:28:45.186021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:45.186688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:45.187187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:45.188073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:45.188684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:45.189221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:45.316065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lazy-loading 'services' on Instance uuid ad3056a1-ae75-47b1-a234-3df81405a87a {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:28:45.399953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b6ace49-a9a1-45fb-a0ac-fc3004138f5f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments/e0f18948-fc00-441a-8a0d-1f3777e5569b" status: 202 len: 0 microversion: 2.1 time: 0.241335 Aug 24 02:28:45.400604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4767/5759] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:28:45 2022] DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments/e0f18948-fc00-441a-8a0d-1f3777e5569b => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:28:50.855693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:28:50.863997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:50.864520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:50.865029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:50.892986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 02:28:50.952844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4791ab7e-64ce-4d69-965d-c7ec0ea90538 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action" status: 202 len: 0 microversion: 2.1 time: 0.104964 Aug 24 02:28:50.954125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4768/5760] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:28:50 2022] POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:28:50.970628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:50.971689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:50.979941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:50.980458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:50.980948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:50.981902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:50.982576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:50.983217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:51.171023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:51.194274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41a36adb-c226-4ebf-9555-526ac97036b1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.231707 Aug 24 02:28:51.195626 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4769/5761] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:50 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:52.218413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:52.219478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:52.226721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:52.227295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:52.227859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:52.228691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:52.229263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:52.229791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:52.371246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:52.379039 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f6485254-0156-4197-bc80-9cd9ff868d3a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.166079 Aug 24 02:28:52.379605 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4770/5762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:52 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:53.404597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:53.406659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:53.416406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:53.417380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:53.418501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:53.419781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:53.420556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:53.421372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:53.593252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:53.603877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24789cac-3bf9-4fb4-8d37-1eed25bd7500 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.203344 Aug 24 02:28:53.604546 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4771/5763] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:53 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:54.627403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:54.628069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:54.637371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:54.637889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:54.640099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:54.640888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:54.641377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:54.641831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:55.068008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:55.077004 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb715c2f-bdfe-4c71-acf0-8fa862a7400b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.453484 Aug 24 02:28:55.091097 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4772/5764] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:54 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:28:56.098591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:56.099223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:56.106848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:56.107356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:56.107822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:56.108567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:56.109077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:56.109515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:56.249108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:56.257211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf1cfb05-37fb-48f0-bbc0-c9646b67504e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.162582 Aug 24 02:28:56.257780 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4773/5765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:56 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:57.279064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:57.279696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:57.286673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:57.287179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:57.287638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:57.288355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:57.288890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:57.289337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:57.425328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:57.436242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71b5a16b-0155-429d-9f82-7e4a84d736dd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.161263 Aug 24 02:28:57.437863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4774/5766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:57 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:58.458597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:58.459257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:58.466871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:58.467374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:58.467828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:58.468533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:58.469030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:58.469474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:58.599951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:58.608147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95c9c6fc-68b4-4819-8343-5e7f827c333b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.153617 Aug 24 02:28:58.608765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4775/5767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:58 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:28:59.629954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:28:59.630640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:28:59.637231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:59.637953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:59.638404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:59.639103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:28:59.639569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:28:59.640002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:28:59.786450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:28:59.795419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dff3a0f3-22ae-4f2f-b59a-94d48dfcba84 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.169229 Aug 24 02:28:59.796218 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4776/5768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:28:59 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:00.817067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:00.817714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:00.826089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:00.827601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:00.828316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:00.829176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:00.830157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:00.830825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:00.976883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:00.987127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeeedfba-7e59-4118-a46e-23a7bd2af95b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1675 microversion: 2.1 time: 0.173915 Aug 24 02:29:00.987711 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4777/5769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:00 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:02.010807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:02.012321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:02.024660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:02.025910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:02.026370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:02.027084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:02.027547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:02.028017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:02.172134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:02.181343 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14199ec3-63c8-4c92-b5da-7af309469c2c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1652 microversion: 2.1 time: 0.176220 Aug 24 02:29:02.182015 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4778/5770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:02 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1652 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:02.202120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:02.208525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:02.209064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:02.209513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:02.241416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 02:29:02.296081 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9295734-757f-45bb-a0e1-032d8c5ecae7 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action" status: 202 len: 0 microversion: 2.1 time: 0.097362 Aug 24 02:29:02.297229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4779/5771] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:29:02 2022] POST /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:29:02.312795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:02.313821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:02.322398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:02.323046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:02.323690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:02.324443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:02.325467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:02.326081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:02.480639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:02.484195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:02.488987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1c89fa4-704e-4901-af43-6407bd2deaa8 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1661 microversion: 2.1 time: 0.182717 Aug 24 02:29:02.489765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4780/5772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:02 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1661 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:03.511136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:03.512656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:03.536426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:03.538627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:03.539632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:03.542343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:03.543837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:03.544586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:03.725649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:03.734259 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8881b4bb-9c9e-4252-8c4c-dd5eb61fb02c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1661 microversion: 2.1 time: 0.227131 Aug 24 02:29:03.734824 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4781/5773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:03 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1661 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:03.865638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-196973267", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "06875dd5-81db-4623-bf9a-b294b29542aa"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:03.922678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] validate_networks() for [('06875dd5-81db-4623-bf9a-b294b29542aa', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:29:04.649049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:29:04.650515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:29:04.651026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:29:04.651460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:29:04.651895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:29:04.663947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:04.664553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:04.665124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:04.666018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:04.666514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:04.667101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:04.690659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Getting quotas for project dbff1ed3808c4c3294ed5888aa5e5ef5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:29:04.698533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Getting quotas for user 162374233a8f433fb1e267febfd142d0 and project dbff1ed3808c4c3294ed5888aa5e5ef5. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:29:04.713114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:29:04.715441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:29:04.762365 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a9ff3f3-2a85-4175-a80b-c0ebfa71a86a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026124 Aug 24 02:29:04.762914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4782/5774] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:29:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:29:04.773475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:04.774106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:04.781868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:04.782376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:04.782829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:04.783721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:04.783997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:04.784549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:04.999525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:05.008234 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-810bd1a3-3c0e-4b5d-966c-831435c85349 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1665 microversion: 2.1 time: 0.244242 Aug 24 02:29:05.008870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4783/5775] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:04 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1665 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:05.030035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62c9ecd6-2f21-4aa1-9fbe-9ceecd007a57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:05.030664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62c9ecd6-2f21-4aa1-9fbe-9ceecd007a57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:05.100055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62c9ecd6-2f21-4aa1-9fbe-9ceecd007a57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:05.108309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62c9ecd6-2f21-4aa1-9fbe-9ceecd007a57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1214 microversion: 2.1 time: 0.082860 Aug 24 02:29:05.109000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4784/5776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:05 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:06.070066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:06.070649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:06.088037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.088551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.089041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.089768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.090422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.091052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.131744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:06.221167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51c5db37-201a-477f-b170-6b34bb534e5e tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 204 len: 0 microversion: 2.1 time: 0.155017 Aug 24 02:29:06.225625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4785/5777] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:06 2022] DELETE /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:29:06.232371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:06.233235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:06.244220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.245099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.245706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.247310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.248129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.249225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.331792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:06.340938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-972c0434-0bf9-4065-879e-0dd0385d1626 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1272 microversion: 2.1 time: 0.113910 Aug 24 02:29:06.341522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4786/5778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:06 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:06.347048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:06.348124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:06.361425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.362208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.362819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.363714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:06.364185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:06.364871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:06.523396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:06.531706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58419c16-e7da-44ed-93dd-42e23b5f6aaf tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1553 microversion: 2.1 time: 0.188976 Aug 24 02:29:06.538003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4787/5779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:06 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:07.363430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:07.364801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:07.373382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:07.374085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:07.374631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:07.375451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:07.375937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:07.376399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:07.543450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:07.573818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9b64035-9350-4262-9a14-cd874510fb57 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.215188 Aug 24 02:29:07.574757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4788/5780] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:07 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:07.589839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858a04b5-72dc-473e-b77a-aaa951912d2d", "tag": "05d9b4d4-3152-42e5-aeb1-039b76003bb1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:07.618826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:07.619771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:07.620881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:07.644418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] Creating event network-changed:05d9b4d4-3152-42e5-aeb1-039b76003bb1 for instance 858a04b5-72dc-473e-b77a-aaa951912d2d on n-h2-854121-3 Aug 24 02:29:07.649821 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2b42a83c-8bf8-4a73-bbd7-276d672938d7 req-41cfec50-f356-4673-8da9-2cfb0b1036b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073696 Aug 24 02:29:07.650513 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4789/5781] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:07.656278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:07.657203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:07.665245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:07.665858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:07.666461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:07.667725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:07.668215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:07.669019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:07.814065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:07.822735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5cbe07a8-0c00-46f9-97dc-72fbaed2102a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1553 microversion: 2.1 time: 0.170864 Aug 24 02:29:07.823515 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4790/5782] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:07 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:08.594747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:08.596017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:08.603613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:08.604435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:08.604939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:08.605665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:08.606193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:08.606647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:08.818247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:08.841451 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f4253ec-1702-4e4a-bb7e-5aa4ebca201a tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.250522 Aug 24 02:29:08.842069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4791/5783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:08 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:08.853780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:08.861135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:08.877332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:08.878018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:08.878549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:08.879336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:08.879967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:08.880652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:08.937449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:08.938285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:08.939108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:08.939970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lazy-loading 'fault' on Instance uuid 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:29:09.004251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:09.012581 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2c190cf-55a0-4713-bfd9-2f27861e6d0c tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 200 len: 1338 microversion: 2.1 time: 0.169480 Aug 24 02:29:09.013643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4792/5784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:08 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:09.678896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2da612f8-8bd4-4ecf-8902-bbdc6e6155a1", "name": "network-vif-deleted", "tag": "5d47cc9e-3277-433c-9b1d-d3260fbf7b04"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:09.689075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:09.689561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:09.690005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:09.701745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] Creating event network-vif-deleted:5d47cc9e-3277-433c-9b1d-d3260fbf7b04 for instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 on n-h1-854121-3 Aug 24 02:29:09.706814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3982f8c4-8b4f-49c9-bb0d-6d4be9e74383 req-0be3eed9-fd5f-4dce-9283-207b614a5694 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Aug 24 02:29:09.707569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4793/5785] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:29:09.863458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:09.864213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:09.871517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:09.872012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:09.872460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:09.873183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:09.873648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:09.874080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:10.004438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:10.013197 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1ce12aa-f12b-43a9-b4b2-b7c12483a86b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.153840 Aug 24 02:29:10.013781 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4794/5786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:09 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:10.034844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:10.035477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:10.041761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:10.042269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:10.042723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:10.043445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:10.043914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:10.044353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:10.058864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] HTTP exception thrown: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Request method failure captured: Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 HTTP/1.1 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYxazDCGLGfJev0bDITB1R-8_LFZDYlO-UTXklCZuT0yRtsrMjP6K4gvRHKKAL04w537Or8POTjumsnSgnYf4nDpwn2ubFukvh0KKGHVbg_98kGiy3ViALyqFY74FMVQ6vRUW5h9k-qe_7Cjg4MQkp3VFew1R8PJ2Np42IQFCT67a3I Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_03814fdd9db4476a95a2299793fecec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ec976f1cfd264aa4b3a04130a743e19e Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2da612f8-8bd4-4ecf-8902-bbdc6e6155a1'} Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:10.060671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Returning 404 to user: Instance 2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71a2363f-0f5b-4791-aacb-8445515820f9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1" status: 404 len: 111 microversion: 2.1 time: 0.031199 Aug 24 02:29:10.064917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4795/5787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:10 2022] GET /compute/v2.1/servers/2da612f8-8bd4-4ecf-8902-bbdc6e6155a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:29:10.228534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-001a839c-718c-424f-b0ba-fdfce08e5e7d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '.version_select at 0x7f6b904993a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:10.265974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-001a839c-718c-424f-b0ba-fdfce08e5e7d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1170284781" status: 202 len: 0 microversion: 2.1 time: 0.042324 Aug 24 02:29:10.266676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4796/5788] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 02:29:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1170284781 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:29:11.033637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:11.034825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:11.047851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:11.051116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:11.052120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:11.053985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:11.056926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:11.058044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:11.369782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:11.378414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df6f9987-9b54-428d-93ce-d51abf0f286b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.348514 Aug 24 02:29:11.379328 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4797/5789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:11 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:12.400269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:12.401109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:12.408776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:12.409505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:12.410176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:12.410952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:12.411591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:12.412190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:12.641978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:12.651402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9d1e199-8c0f-43b9-a8c0-65d559f5288e tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.254987 Aug 24 02:29:12.652966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4798/5790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:12 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:12.853604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:12.854792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:12.862730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:12.863242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:12.863700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:12.864421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:12.864929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:12.865372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:12.891382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:12.908105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:12.996075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a84bf315-9386-457a-ac88-35ecb76a71ee tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 204 len: 0 microversion: 2.1 time: 0.148041 Aug 24 02:29:12.997037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4799/5791] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:12 2022] DELETE /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:29:13.002543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d77ff23-0ee6-466e-a465-5821badb5971", "tag": "464a51f2-8885-46fa-883d-4fafeaefbc74"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:13.009183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:13.013568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:13.014064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:13.014674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:13.027577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] Creating event network-changed:464a51f2-8885-46fa-883d-4fafeaefbc74 for instance 2d77ff23-0ee6-466e-a465-5821badb5971 on n-h1-854121-3 Aug 24 02:29:13.033935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9ed80dae-0646-44e5-9783-8c0c191f9784 req-5819dacd-5231-4fd8-b41e-a12eb7ce7091 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035217 Aug 24 02:29:13.034759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4800/5792] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:13.042155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:13.042865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:13.050232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:13.050990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:13.051639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:13.052560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:13.053215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:13.053991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:13.222123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:13.230990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc094773-6fce-4c14-9a78-38723ae28886 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1669 microversion: 2.1 time: 0.194814 Aug 24 02:29:13.231769 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4801/5793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:13 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:13.673427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:13.674321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:13.681866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:13.682504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:13.683066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:13.683940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:13.684522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:13.686616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:13.835994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:13.846963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92720564-8b00-4831-b641-2728a3731236 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.176426 Aug 24 02:29:13.848042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4802/5794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:13 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:14.253320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:14.254264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:14.263113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.263779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.264298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:14.265280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.265754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.266201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:14.409225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:14.417736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d166380a-f379-4d11-9270-42df1dac86a4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1669 microversion: 2.1 time: 0.168986 Aug 24 02:29:14.418353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4803/5795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:14 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:14.422846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1322055653", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:14.473963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:29:14.683041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:14.812950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:29:14.813463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:29:14.814027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:29:14.814521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:29:14.815016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:29:14.826590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.827326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.827775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:14.828518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.829002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.829621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:14.849878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Getting quotas for project fdb5a44d9a3443de9f33425b1e1693db. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:29:14.856396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Getting quotas for user 8d1c6abbbf1c425c84651e8c50a9adf4 and project fdb5a44d9a3443de9f33425b1e1693db. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:29:14.874116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:29:14.878117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:29:14.930679 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a11af458-6a7a-4b4d-946b-2d9597e9f6c9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510757 Aug 24 02:29:14.936517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4804/5796] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:29:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:29:14.936517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:14.936813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:14.943048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.943556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.944013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:14.944776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:14.945256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:14.945701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:15.150791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:15.158873 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a02c4b1-355e-487e-be94-bdb2d951de0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.226610 Aug 24 02:29:15.171988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4805/5797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:14 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:15.175691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c9e7370-d20e-43ff-a3af-3a519d4c2ccf tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:15.176564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c9e7370-d20e-43ff-a3af-3a519d4c2ccf tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:15.246248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c9e7370-d20e-43ff-a3af-3a519d4c2ccf tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:15.254201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c9e7370-d20e-43ff-a3af-3a519d4c2ccf tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1215 microversion: 2.1 time: 0.093177 Aug 24 02:29:15.254787 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4806/5798] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:15 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:15.259946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858a04b5-72dc-473e-b77a-aaa951912d2d", "name": "network-vif-plugged", "status": "completed", "tag": "05d9b4d4-3152-42e5-aeb1-039b76003bb1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:15.271302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:15.272002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:15.273232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:15.285846 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] Creating event network-vif-plugged:05d9b4d4-3152-42e5-aeb1-039b76003bb1 for instance 858a04b5-72dc-473e-b77a-aaa951912d2d on n-h2-854121-3 Aug 24 02:29:15.292023 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1db49f28-cae8-4f45-9f20-994b29e5c557 req-e2419d35-1462-49ae-9ac5-e5626144d843 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035809 Aug 24 02:29:15.292919 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4807/5799] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:15.364395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d77ff23-0ee6-466e-a465-5821badb5971", "name": "network-vif-deleted", "tag": "464a51f2-8885-46fa-883d-4fafeaefbc74"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:15.377809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:15.378416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:15.378861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:15.392476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] Creating event network-vif-deleted:464a51f2-8885-46fa-883d-4fafeaefbc74 for instance 2d77ff23-0ee6-466e-a465-5821badb5971 on n-h1-854121-3 Aug 24 02:29:15.399906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-54ed3dfb-d3e1-4c72-b6f8-207bd460cbaf req-a508b0ee-3b06-4860-969d-ea4b45401bc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040682 Aug 24 02:29:15.401882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4808/5800] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:29:15.442388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:15.443451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:15.453419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:15.454280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:15.455248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:15.456354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:15.457097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:15.457756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:15.530048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:15.538093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23cc4cf1-b70f-4346-8b28-55beb6a2326b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 200 len: 1333 microversion: 2.1 time: 0.101736 Aug 24 02:29:15.538866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4809/5801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:15 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:16.179472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:16.180129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:16.187671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.188168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.188618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.189351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.189817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.190251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.321660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:16.330089 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03d167c0-c37b-49aa-89c2-2ad774f80c28 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1314 microversion: 2.1 time: 0.154190 Aug 24 02:29:16.330710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4810/5802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:16 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:16.335188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:16.335962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:16.342065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.342560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.343004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.343743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.344176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.344612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.433989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:16.441878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0dbc13f6-648d-49d5-bb80-b93dca83f3b6 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1275 microversion: 2.1 time: 0.110187 Aug 24 02:29:16.442445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4811/5803] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:16 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:16.560348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:16.561012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: 2d77ff23-0ee6-466e-a465-5821badb5971] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:16.569843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.570379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.570914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.571657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:16.572549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:16.572947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:16.591117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] HTTP exception thrown: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Request method failure captured: Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 HTTP/1.1 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYxazDCGLGfJev0bDITB1R-8_LFZDYlO-UTXklCZuT0yRtsrMjP6K4gvRHKKAL04w537Or8POTjumsnSgnYf4nDpwn2ubFukvh0KKGHVbg_98kGiy3ViALyqFY74FMVQ6vRUW5h9k-qe_7Cjg4MQkp3VFew1R8PJ2Np42IQFCT67a3I Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_03814fdd9db4476a95a2299793fecec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ec976f1cfd264aa4b3a04130a743e19e Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2d77ff23-0ee6-466e-a465-5821badb5971'} Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:16.592814 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Returning 404 to user: Instance 2d77ff23-0ee6-466e-a465-5821badb5971 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-852054e1-8187-4f30-bc13-e0b6b4095d57 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971" status: 404 len: 111 microversion: 2.1 time: 0.037939 Aug 24 02:29:16.600482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4812/5804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:16 2022] GET /compute/v2.1/servers/2d77ff23-0ee6-466e-a465-5821badb5971 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:29:16.881623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f61b5086-44db-4bdf-ba5e-4f3656ca9eab tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '.version_select at 0x7f6b90d34040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:16.903651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f61b5086-44db-4bdf-ba5e-4f3656ca9eab tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-968544842" status: 202 len: 0 microversion: 2.1 time: 0.026857 Aug 24 02:29:16.904552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4813/5805] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 24 02:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-968544842 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:29:17.352218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:17.354026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:17.364578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.365480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.366132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:17.367035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.367684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.371949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:17.610900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:17.619110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7186b17-33cc-4795-a127-f364b5df953b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1500 microversion: 2.1 time: 0.271557 Aug 24 02:29:17.619998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4814/5806] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:17 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1500 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:17.624912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:17.625642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:17.639682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.640283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.642207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:17.642602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.643181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.643722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:17.906230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:17.914747 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e1fc84b-5cc3-4437-9084-d2da90a96a1f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.293428 Aug 24 02:29:17.915935 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4815/5807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:17 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:17.920741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:17.921338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:17.927400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.928037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.928490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:17.929222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:17.929689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:17.930127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.199806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:18.208901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4554b39b-2b3b-4fc4-a46f-2ed6aa14dae2 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1500 microversion: 2.1 time: 0.291890 Aug 24 02:29:18.209547 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4816/5808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:17 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1500 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:18.229328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:18.229882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.239642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.275095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lazy-loading 'flavor' on Instance uuid 858a04b5-72dc-473e-b77a-aaa951912d2d {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:29:18.351519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f343ce1-3d19-4e31-a4d6-004410f38874 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.125921 Aug 24 02:29:18.355989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4817/5809] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:29:18 2022] POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:29:18.362818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:18.364539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:18.376479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.377117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.377725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.378950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.380301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.380874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.617655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:18.622057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:18.629122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-276d181f-3570-4a8f-8151-e9b89b014d42 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1508 microversion: 2.1 time: 0.271559 Aug 24 02:29:18.630162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4818/5810] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:18 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:18.649345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "969897b7-7551-43e3-aa28-bbd528b5d02e", "tag": "d8edcc69-0018-42e4-90d1-b2c8860bd16d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:18.661072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.661931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.662899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.681369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] Creating event network-changed:d8edcc69-0018-42e4-90d1-b2c8860bd16d for instance 969897b7-7551-43e3-aa28-bbd528b5d02e on n-h1-854121-3 Aug 24 02:29:18.686676 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-09603d33-9c9c-411d-a537-3e261dfa6a2f req-da3080b9-eb8d-4d8d-870e-848f80da22fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042318 Aug 24 02:29:18.688058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4819/5811] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:18.937761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:18.939133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:18.946262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.947104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.947644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:18.948502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:18.949348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:18.949859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.110509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:19.125295 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29aa2b03-3911-4edc-be87-17539221f549 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.192171 Aug 24 02:29:19.126109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4820/5812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:18 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:19.650959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:19.651570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:19.658440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.658948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.659404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.660125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.660601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.661071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.803542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:19.811973 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d895a3a-4342-4ca4-ad8c-17e0118124d3 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1491 microversion: 2.1 time: 0.165438 Aug 24 02:29:19.812565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4821/5813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:19 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1491 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:19.833799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:19.834555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:19.845191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.846050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.846726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.847618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.848191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.848871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.927968 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dab8a1f9-c97e-4abe-844b-b9547cba8ccd tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.099073 Aug 24 02:29:19.932026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4822/5814] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:29:19 2022] POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:29:19.937660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:19.938469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:19.945591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.946708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.947219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:19.948028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:19.948549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:19.949097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:20.096543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:20.107036 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdc10289-2d36-41da-b49c-4c058de53707 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1497 microversion: 2.1 time: 0.173504 Aug 24 02:29:20.108380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4823/5815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:19 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:20.145850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:20.146775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:20.153774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:20.154391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:20.154933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:20.155740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:20.156517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:20.157088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:20.314026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:20.322604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99645b65-0e94-447c-b150-b2e0f3733464 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.180638 Aug 24 02:29:20.323565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4824/5816] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:20 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:21.127580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:21.128258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:21.135512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:21.136023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:21.136477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:21.137231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:21.137700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:21.138142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:21.608007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:21.616347 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-568c0a1a-b9c4-4791-84a3-8e8764001f0d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1497 microversion: 2.1 time: 0.492657 Aug 24 02:29:21.617073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4825/5817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:21 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1497 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:21.628870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:21.628870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:21.628870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:21.629414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:21.629661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:21.630387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:21.630841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:21.631290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:21.977976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:21.988054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-875a52b4-8777-4927-9965-91a0fe4f7867 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.369066 Aug 24 02:29:22.001481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4826/5818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:21 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:22.640087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:22.640708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:22.647488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:22.647983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:22.648431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:22.649191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:22.649657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:22.650091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:22.862747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:22.871903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-604f57de-a33d-4f57-89a3-e2719966a36d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1500 microversion: 2.1 time: 0.235633 Aug 24 02:29:22.872488 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4827/5819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:22 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:22.893761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:22.894406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:22.901570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:22.902122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:22.902531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:22.903383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:22.903862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:22.904311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:22.927755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lazy-loading 'flavor' on Instance uuid 858a04b5-72dc-473e-b77a-aaa951912d2d {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:29:23.010598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be189bb2-c253-41f7-a3aa-ecf819a61df1 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.120615 Aug 24 02:29:23.014292 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4828/5820] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:29:22 2022] POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:29:23.016708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:23.017442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:23.024661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:23.025222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:23.025671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:23.026600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:23.026848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:23.027292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:23.192682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:23.201472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae7f5f42-9648-42ac-9dae-90f9b71d718b tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.188730 Aug 24 02:29:23.202273 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4829/5821] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:23 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:23.207231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:23.207951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:23.214573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:23.215156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:23.215679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:23.216478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:23.217042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:23.217615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:23.375559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:23.387341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfe39495-b541-4fa7-9e98-9881320f967b tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1508 microversion: 2.1 time: 0.183872 Aug 24 02:29:23.388185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4830/5822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:23 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:24.225580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:24.226617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:24.240645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:24.241354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:24.242209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:24.244827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:24.245719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:24.246576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:24.839479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:24.882194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:24.891683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80406fc7-8fd0-41c9-84ae-a38c27b76a6f tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.672498 Aug 24 02:29:24.893660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4831/5823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:24 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:24.900674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:24.905699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:24.915877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:24.916569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:24.917221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:24.918119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:24.918898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:24.919497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.218505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:25.226612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2ca000b1-303c-44c3-8bc9-d840f318d904 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1491 microversion: 2.1 time: 0.331598 Aug 24 02:29:25.241705 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4832/5824] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:24 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1491 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:25.241705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969897b7-7551-43e3-aa28-bbd528b5d02e", "name": "network-vif-plugged", "status": "completed", "tag": "d8edcc69-0018-42e4-90d1-b2c8860bd16d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:25.255224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:25.257416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.257972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.259611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.276819 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] Creating event network-vif-plugged:d8edcc69-0018-42e4-90d1-b2c8860bd16d for instance 969897b7-7551-43e3-aa28-bbd528b5d02e on n-h1-854121-3 Aug 24 02:29:25.286770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-22939e5e-605e-4c68-94c7-b01bedaf0fe7 req-a15c14f5-1e1d-479e-856d-080dca02a1b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054473 Aug 24 02:29:25.287567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4833/5825] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:25.296910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:25.297975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:25.309695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.310428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.311062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.311950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.312570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.313182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.320539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:25.404998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e84b7254-6f92-4ca5-9ee9-cf927f92db5d tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.115660 Aug 24 02:29:25.405743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4834/5826] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:29:25 2022] POST /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:29:25.416667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:25.417402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:25.424512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.425152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.425663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.426595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.427135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.427619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.729539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:25.738737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ec6b67e-61e6-4954-a061-44377a83fdbe tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1497 microversion: 2.1 time: 0.326670 Aug 24 02:29:25.741290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4835/5827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:25 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:25.918018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:25.918989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:25.925224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.925930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.926683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:25.927590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:25.928211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:25.928827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:26.153929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:26.164285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07ad11f7-3e6d-43a5-80a2-f574a2a6e3a9 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1315 microversion: 2.1 time: 0.251002 Aug 24 02:29:26.165822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4836/5828] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:25 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:26.761467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:26.762101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:26.770653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:26.771667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:26.772338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:26.776110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:26.777020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:26.777689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.103374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:27.114623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3ce7edb-04b0-499d-86b6-735406f194bb tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1497 microversion: 2.1 time: 0.356489 Aug 24 02:29:27.115463 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4837/5829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:26 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:27.187313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:27.187945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:27.194568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.195590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.196879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.197981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.198725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.199505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.443670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:27.451729 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8b4b055-dfed-484f-b056-180421a1c12a tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1465 microversion: 2.1 time: 0.268860 Aug 24 02:29:27.452433 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4838/5830] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:27 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:27.457059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72b9c771-80e3-417a-815f-6a502fd64b8a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: .version_select at 0x7f6b90d34820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1144089847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAu+mzplzeMPhO/p63AJG+rbXpF9r7S1j0cd1qfuUPYdyI8mt0fvwIGbAPaABllaR0nUYvcMa2A6JNjdroqd1sVyBg1EPxyl0P/ONI6SAN1diebcY6pgUt7tDKMrc/Mqg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:27.473079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-72b9c771-80e3-417a-815f-6a502fd64b8a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:29:27.475405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:27.479988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-72b9c771-80e3-417a-815f-6a502fd64b8a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:29:27.507628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72b9c771-80e3-417a-815f-6a502fd64b8a tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.054253 Aug 24 02:29:27.508276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4839/5831] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:29:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:27.513160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:27.513453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:27.519771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.520415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.520754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.521503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.521979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.522418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.550556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:27.646866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27ee4223-0391-4bb1-b1c2-ceaffbcd7006 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "DELETE /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 204 len: 0 microversion: 2.1 time: 0.136868 Aug 24 02:29:27.648358 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4840/5832] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:27 2022] DELETE /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:29:27.657750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:27.658763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:27.667660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.668491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.669303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.670885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:27.671647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:27.672351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:27.831112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:27.840543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ffeb2c3-eab0-4357-a192-2b7b1c6cdcce tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1471 microversion: 2.1 time: 0.187990 Aug 24 02:29:27.841710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4841/5833] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:27 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:28.136121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:28.136768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:28.142888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.143593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.143846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.144560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.145060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.145499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.350854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:28.360103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b263a262-30da-44e0-9800-f85f6d468806 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1500 microversion: 2.1 time: 0.228332 Aug 24 02:29:28.360817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4842/5834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:28 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1500 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:28.382880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:28.383923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:28.411784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.414339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.416253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.418486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.419689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.420585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.464179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:28.550652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-347f031d-1859-4700-8d43-09c27cad4d85 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "DELETE /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 204 len: 0 microversion: 2.1 time: 0.172954 Aug 24 02:29:28.551759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4843/5835] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:28 2022] DELETE /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:29:28.561444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:28.562316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:28.569152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.570209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.571547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.575461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:28.576207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:28.576672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:28.735516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:28.744147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5afc2f58-8028-45f7-8fb4-c2220b1f6788 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1506 microversion: 2.1 time: 0.187096 Aug 24 02:29:28.744862 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4844/5836] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:28 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:28.755417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-740840743", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "95122772-618f-4323-adbf-1c2faccfc951"}], "key_name": "tempest-TestNetworkBasicOps-1144089847", "security_groups": [{"name": "tempest-secgroup-smoke-701848244"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:28.879903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] validate_networks() for [('95122772-618f-4323-adbf-1c2faccfc951', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:29:29.652448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:29:29.652919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:29:29.653432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:29:29.653855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:29:29.654309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:29:29.663603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:29.664188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:29.665241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:29.666072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:29.666604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:29.667104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:29.684378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:29:29.689694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Getting quotas for user ec976f1cfd264aa4b3a04130a743e19e and project 03814fdd9db4476a95a2299793fecec4. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:29:29.702183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:29:29.704469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:29:29.751608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ecb65eec-c148-4ff6-adae-4355335f78e0 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.000276 Aug 24 02:29:29.756878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4845/5837] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:29:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:29:29.764437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:29.765331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:29.774663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:29.775357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:29.776210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:29.776869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:29.777639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:29.778102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:29.994545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d1c6abbbf1c425c84651e8c50a9adf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb5a44d9a3443de9f33425b1e1693db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:30.004000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-234cc334-ccf5-4764-b2cd-ddbb678dfe19 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 200 len: 1471 microversion: 2.1 time: 0.244509 Aug 24 02:29:30.014638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4846/5838] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:29 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:30.014638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-340405c2-34ac-447b-93da-702187fbd436 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:30.014638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-340405c2-34ac-447b-93da-702187fbd436 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:30.088811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-340405c2-34ac-447b-93da-702187fbd436 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:30.099318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-340405c2-34ac-447b-93da-702187fbd436 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1248 microversion: 2.1 time: 0.093211 Aug 24 02:29:30.100144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4847/5839] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:30 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:30.116982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:30.118851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:30.125491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:30.125992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:30.126436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:30.127515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:30.127645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:30.128432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:30.311310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:30.320417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-312df1a9-2660-494a-bafb-10f3fe4da3d4 tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1506 microversion: 2.1 time: 0.219265 Aug 24 02:29:30.321415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4848/5840] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:30 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:30.327379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "969897b7-7551-43e3-aa28-bbd528b5d02e", "name": "network-vif-deleted", "tag": "d8edcc69-0018-42e4-90d1-b2c8860bd16d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:30.338220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:30.338728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:30.339171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:30.344016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:30.354282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] Creating event network-vif-deleted:d8edcc69-0018-42e4-90d1-b2c8860bd16d for instance 969897b7-7551-43e3-aa28-bbd528b5d02e on n-h1-854121-3 Aug 24 02:29:30.359997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-93c121f1-6527-4f64-9e89-7d1dae24342c req-c055b8f1-c39b-4f4b-81ae-33f446486fd6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Aug 24 02:29:30.360844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4849/5841] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:31.027224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:31.028055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] [instance: 969897b7-7551-43e3-aa28-bbd528b5d02e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:31.035534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.036128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.036677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.037596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.038138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.038803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.054563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] HTTP exception thrown: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Request method failure captured: Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e HTTP/1.1 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYz4dToogPBSfSPlfpKGsJ-fIqDuV4aY4zcyZoewCZn_JNQxqN_mnmwhwmT3nquFk_REcVUDhbQYVD57Q6dnHbZrpR236RwlfrPoStZy6TEGUc2QYofOup_fGMaLW6bflD7Q3alO31qu1ejYog3m_MIdiE3pcfZ10ut1jAlxUZsgtZE Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: fdb5a44d9a3443de9f33425b1e1693db Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesNegativeTest-512586556 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdb5a44d9a3443de9f33425b1e1693db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdb5a44d9a3443de9f33425b1e1693db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdb5a44d9a3443de9f33425b1e1693db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdb5a44d9a3443de9f33425b1e1693db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesNegativeTest-512586556 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: fdb5a44d9a3443de9f33425b1e1693db Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesNegativeTest-512586556 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesNegativeTest-512586556-project Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 8d1c6abbbf1c425c84651e8c50a9adf4 Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesNegativeTest-512586556-project Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '969897b7-7551-43e3-aa28-bbd528b5d02e'} Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:31.056282 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] Returning 404 to user: Instance 969897b7-7551-43e3-aa28-bbd528b5d02e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8eb68379-5646-46d0-a553-08005fb5c335 tempest-VolumesNegativeTest-512586556 tempest-VolumesNegativeTest-512586556-project] 10.222.0.49 "GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e" status: 404 len: 111 microversion: 2.1 time: 0.036478 Aug 24 02:29:31.060200 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4850/5842] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:31 2022] GET /compute/v2.1/servers/969897b7-7551-43e3-aa28-bbd528b5d02e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:29:31.123709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:31.125663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:31.132336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.132879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.134074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.135018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.135530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.136194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.251444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:31.262523 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03ae4e0c-fcc9-4b2e-b387-8b37e39252cc tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1308 microversion: 2.1 time: 0.146174 Aug 24 02:29:31.263377 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4851/5843] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:31 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1308 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:31.344068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:31.345744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:31.353714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.354513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.355191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.357108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.357703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.358256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.451468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '162374233a8f433fb1e267febfd142d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbff1ed3808c4c3294ed5888aa5e5ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:31.461096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8eb6dc56-fe59-4f46-b58f-27027f0a74ac tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 200 len: 1464 microversion: 2.1 time: 0.121809 Aug 24 02:29:31.475511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4852/5844] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:31 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 1464 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:31.480373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858a04b5-72dc-473e-b77a-aaa951912d2d", "name": "network-vif-deleted", "tag": "05d9b4d4-3152-42e5-aeb1-039b76003bb1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:31.490719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:31.491586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:31.492202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:31.507837 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] Creating event network-vif-deleted:05d9b4d4-3152-42e5-aeb1-039b76003bb1 for instance 858a04b5-72dc-473e-b77a-aaa951912d2d on n-h2-854121-3 Aug 24 02:29:31.514055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-36c18509-3dc2-453c-bf8e-6c086d72570b req-e62f7b0b-b025-4b38-bdb7-8927deb64ad4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037187 Aug 24 02:29:31.515182 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4853/5845] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:32.289853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:32.291316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:32.319270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:32.320111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:32.321146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:32.322220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:32.322904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:32.323555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:32.915226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:32.926384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5e53fb6-32dd-41bb-9be7-f5ce04557a7b tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.645303 Aug 24 02:29:32.927381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4854/5846] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:32 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:32.934515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:32.935150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] [instance: 858a04b5-72dc-473e-b77a-aaa951912d2d] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:32.944000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:32.945212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:32.946220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:32.947199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:32.947901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:32.948623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:32.978192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] HTTP exception thrown: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Request method failure captured: Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d HTTP/1.1 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYzuHVuRSZf0X6A3Tdksa4KGdA04dNXJmweLISUtmL2JJFokaGupKqLcx-OycYbXL446FSATERqpE9ohfbQXNxKec0Kf4sI5-Ie9bxNdKrEJ7U8NhwIkyup2r22IDkQ8eiXRu70WWNyJv4GEfDV59c2k85CrOmxaVdPXL4DoEQQisR0 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: dbff1ed3808c4c3294ed5888aa5e5ef5 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerAdvancedOps-497742981 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dbff1ed3808c4c3294ed5888aa5e5ef5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbff1ed3808c4c3294ed5888aa5e5ef5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dbff1ed3808c4c3294ed5888aa5e5ef5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dbff1ed3808c4c3294ed5888aa5e5ef5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerAdvancedOps-497742981 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: dbff1ed3808c4c3294ed5888aa5e5ef5 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerAdvancedOps-497742981 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerAdvancedOps-497742981-project Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 162374233a8f433fb1e267febfd142d0 Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerAdvancedOps-497742981-project Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '858a04b5-72dc-473e-b77a-aaa951912d2d'} Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:32.982245 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. Aug 24 02:29:32.986970 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:32.989171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] Returning 404 to user: Instance 858a04b5-72dc-473e-b77a-aaa951912d2d could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:29:32.990362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a062a41a-dbe0-494a-b481-0a88b495087c tempest-TestServerAdvancedOps-497742981 tempest-TestServerAdvancedOps-497742981-project] 10.222.0.49 "GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d" status: 404 len: 111 microversion: 2.1 time: 0.061893 Aug 24 02:29:32.991791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4855/5847] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:32 2022] GET /compute/v2.1/servers/858a04b5-72dc-473e-b77a-aaa951912d2d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:29:33.094535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6d3a498-c508-4f85-a93e-5ea3d40b558f", "tag": "5c458afe-b099-41ba-b1d8-fb8e844d019d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:33.111286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:33.112048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:33.112869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:33.149840 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] Creating event network-changed:5c458afe-b099-41ba-b1d8-fb8e844d019d for instance b6d3a498-c508-4f85-a93e-5ea3d40b558f on n-h1-854121-3 Aug 24 02:29:33.155407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-76cd30cb-c33a-4222-98ed-04dc586b6b39 req-0203e886-1133-402e-85ba-f0cde98bdfd8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064744 Aug 24 02:29:33.156021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4856/5848] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:29:33.948462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:33.949206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:33.955876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:33.956357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:33.956856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:33.957566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:33.960907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:33.960907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:34.200736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:34.211990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2b2f1a52-0306-41b6-bd0e-a5fd98bbf0a7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.266944 Aug 24 02:29:34.212994 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4857/5849] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:33 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:35.233446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:35.234895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:35.243035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:35.244384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:35.245113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:35.245923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:35.246610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:35.247120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:35.386403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:35.398332 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a400e3da-b549-4ee2-9e9e-74e031540fb1 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.168585 Aug 24 02:29:35.399735 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4858/5850] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:35 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:36.423894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:36.425653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:36.441127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:36.441924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:36.442385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:36.443460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:36.444180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:36.444861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:36.644317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:36.655175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2104a3bc-0ab5-44fc-875c-3de249dbf473 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.237568 Aug 24 02:29:36.656305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4859/5851] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:36 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:37.679412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:37.681302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:37.698607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:37.699981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:37.701993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:37.705547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:37.706091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:37.707171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:38.077096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:38.086781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-861a4300-51f9-4a4b-a728-8fec7c066ef7 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.411906 Aug 24 02:29:38.087038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4860/5852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:37 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:38.656436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6d3a498-c508-4f85-a93e-5ea3d40b558f", "name": "network-vif-plugged", "status": "completed", "tag": "5c458afe-b099-41ba-b1d8-fb8e844d019d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:38.671893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:38.672431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:38.672911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:38.688745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] Creating event network-vif-plugged:5c458afe-b099-41ba-b1d8-fb8e844d019d for instance b6d3a498-c508-4f85-a93e-5ea3d40b558f on n-h1-854121-3 Aug 24 02:29:38.697265 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5ec146e8-c314-422c-9770-656bd53a4245 req-19e5bc7c-e215-4764-9caf-59d624855f11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048228 Aug 24 02:29:38.713061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4861/5853] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:29:39.109781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:39.110759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:39.125677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:39.126371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:39.132137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:39.136247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:39.138088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:39.141908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:39.674722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:39.955556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:39.978319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44d1c903-4ddb-4bec-9d02-1f97e9dd91db tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1373 microversion: 2.1 time: 0.870278 Aug 24 02:29:39.979395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4862/5854] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:39 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1373 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:39.986454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:39.986974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:40.004348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:40.004902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:40.005359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:40.006085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:40.006559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:40.007001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:40.061962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:40.147127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:40.294509 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86b935be-e31b-425b-92eb-fac03f958ba0 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 204 len: 0 microversion: 2.1 time: 0.313053 Aug 24 02:29:40.295591 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4863/5855] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:39 2022] DELETE /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:29:40.303750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae372df5-01d7-4f69-86bf-495ce963c5ae", "tag": "c4abe509-0153-49b3-8ce0-6b6f06dcd688"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:40.320647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:40.322013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:40.322131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:40.340935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] Creating event network-changed:c4abe509-0153-49b3-8ce0-6b6f06dcd688 for instance ae372df5-01d7-4f69-86bf-495ce963c5ae on n-h2-854121-3 Aug 24 02:29:40.348027 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d8ffed90-ce6e-43a6-87e9-c1414c378daf req-c13f9b02-d8ce-4784-a86e-cb462e7c8cbe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049942 Aug 24 02:29:40.349347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4864/5856] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:40.356631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:40.357470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:40.364868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:40.365601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:40.366189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:40.367031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:40.367586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:40.368453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:40.660437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:40.678983 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-531a7cc9-9af5-433f-adcb-a76a1ddeb781 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1577 microversion: 2.1 time: 0.327965 Aug 24 02:29:40.681798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4865/5857] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:40 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1577 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:41.002419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:41.003852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:41.013412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.014183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.014872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:41.015890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.016984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.018186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:41.271068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:41.290056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c057684-2a8c-49ab-beea-445b605745a9 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1543 microversion: 2.1 time: 0.290424 Aug 24 02:29:41.290635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4866/5858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:40 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1543 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:41.325371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:41.325995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:41.346105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.347199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.347728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:41.349239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.349826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.350405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:41.679106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:41.687306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd104a2d-4900-4614-9489-658a47c74bfd tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1543 microversion: 2.1 time: 0.366289 Aug 24 02:29:41.688261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4867/5859] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:41 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1543 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:41.717052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:41.717806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:41.731028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:41.733569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.734435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.735136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:41.738833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:41.739481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:41.740045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:42.117868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:42.123504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:29:42.134111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6b9e46f-24bf-45eb-8f6e-6fc0ac8d6c91 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1577 microversion: 2.1 time: 0.420715 Aug 24 02:29:42.136516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4868/5860] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:41 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1577 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:43.165838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:43.167666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:43.178911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:43.180032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:43.180501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:43.181629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:43.182560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:43.184054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:43.322142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:43.330878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-074064b1-6be3-4e41-9580-1084db35af9f tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1391 microversion: 2.1 time: 0.174243 Aug 24 02:29:43.331461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4869/5861] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:43 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:43.364646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae372df5-01d7-4f69-86bf-495ce963c5ae", "name": "network-vif-deleted", "tag": "c4abe509-0153-49b3-8ce0-6b6f06dcd688"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:43.377228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:43.378611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:43.379429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:43.393070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] Creating event network-vif-deleted:c4abe509-0153-49b3-8ce0-6b6f06dcd688 for instance ae372df5-01d7-4f69-86bf-495ce963c5ae on n-h2-854121-3 Aug 24 02:29:43.399044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4ecbf026-2095-473a-af4c-83a3d18920ec req-3ec78526-213e-41c5-86a1-766a23b5c27f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041571 Aug 24 02:29:43.399741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4870/5862] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:44.352707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:44.353366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:44.364318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:44.368532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:44.369494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:44.371175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:44.373783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:44.374405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:44.599200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:44.619726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-393d99a6-9596-48b3-a310-44dda9b28f39 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1225 microversion: 2.1 time: 0.271305 Aug 24 02:29:44.621813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4871/5863] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:44 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1225 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:45.325395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6d3a498-c508-4f85-a93e-5ea3d40b558f", "tag": "5c458afe-b099-41ba-b1d8-fb8e844d019d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:45.339988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:45.340635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:45.341342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:45.356985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] Creating event network-changed:5c458afe-b099-41ba-b1d8-fb8e844d019d for instance b6d3a498-c508-4f85-a93e-5ea3d40b558f on n-h1-854121-3 Aug 24 02:29:45.364362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1d4e96ff-09b4-4228-b52e-c4987e705594 req-913092c6-2afb-47bf-a299-7d4a09d6f166 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053441 Aug 24 02:29:45.369569 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4872/5864] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:45.644527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:45.645530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:45.686307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:45.687120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:45.687829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:45.689051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:45.689848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:45.690820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:46.100933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:46.118887 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7d6f29e-b29e-451e-90f8-3199d1220ba7 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1225 microversion: 2.1 time: 0.480562 Aug 24 02:29:46.136537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4873/5865] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:45 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1225 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:47.144864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:47.147199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:47.158125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:47.158935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:47.159557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:47.160562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:47.161346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:47.161957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:47.284260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:47.312169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-742d6f55-329b-4a83-a555-f13b8a551c52 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1225 microversion: 2.1 time: 0.171505 Aug 24 02:29:47.314141 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4874/5866] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:47 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:48.334906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:48.340063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:48.367948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:48.368464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:48.376523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:48.378960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:48.381682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:48.384361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:48.544163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:48.552318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-09490dba-12e6-4daa-a79f-221b64d46914 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1225 microversion: 2.1 time: 0.222153 Aug 24 02:29:48.552858 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4875/5867] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:48 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:49.814949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:49.815615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:49.822931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:49.824239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:49.824962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:49.825964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:49.826683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:49.827343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:49.902306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:49.903017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:49.903765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:49.905927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lazy-loading 'fault' on Instance uuid ae372df5-01d7-4f69-86bf-495ce963c5ae {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:29:49.993046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:50.000974 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c13a923c-74f2-4f83-b6ff-922b071d540e tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 200 len: 1230 microversion: 2.1 time: 0.430761 Aug 24 02:29:50.001562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4876/5868] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:49 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 1230 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:51.024457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:51.026060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: ae372df5-01d7-4f69-86bf-495ce963c5ae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:51.033751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:51.034402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:51.034861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:51.035598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:51.036073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:51.036519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:51.051235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae HTTP/1.1 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ae372df5-01d7-4f69-86bf-495ce963c5ae'} Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:29:51.053085 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance ae372df5-01d7-4f69-86bf-495ce963c5ae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2ae3b14-9ce9-40f2-b512-7d3343d0ba79 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae" status: 404 len: 111 microversion: 2.1 time: 0.035704 Aug 24 02:29:51.057778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4877/5869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:51 2022] GET /compute/v2.1/servers/ae372df5-01d7-4f69-86bf-495ce963c5ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:29:57.415438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:57.416609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:57.423922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:57.424434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:57.424936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:57.425658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:57.426137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:57.426586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:57.452929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:29:57.545351 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9393c9b-5227-4f24-a09f-b5a2b2798397 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 204 len: 0 microversion: 2.1 time: 0.133076 Aug 24 02:29:57.547106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4878/5870] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:29:57 2022] DELETE /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:29:57.554804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ece57a-7ce6-42aa-b82f-f771f4ac7943", "tag": "62f8e952-318e-4cf2-bfa6-667e348f5d90"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:57.565823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:57.566542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:57.567146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:57.580525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] Creating event network-changed:62f8e952-318e-4cf2-bfa6-667e348f5d90 for instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 on n-h1-854121-3 Aug 24 02:29:57.586649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c2cd4c4f-0b54-4b67-a74b-a0176b0996ba req-23c6da97-4db6-4e68-b0e9-c3183abf4732 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037980 Aug 24 02:29:57.587534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4879/5871] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:57.595771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:57.596812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:57.603851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:57.604476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:57.605698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:57.606056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:57.606634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:57.607196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:57.750189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:57.759041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2fa1968-4c7a-4c71-a92a-9883e9db7824 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1578 microversion: 2.1 time: 0.167610 Aug 24 02:29:57.759948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4880/5872] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:57 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:29:58.779578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:58.780295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:58.787351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:58.787945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:58.788832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:58.789843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:58.790473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:58.791083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:58.949676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:29:58.957802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a89c92f-7c17-4aaa-ac60-c48a45fc8063 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1578 microversion: 2.1 time: 0.182240 Aug 24 02:29:58.958376 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4881/5873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:58 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:29:59.917756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ece57a-7ce6-42aa-b82f-f771f4ac7943", "name": "network-vif-deleted", "tag": "62f8e952-318e-4cf2-bfa6-667e348f5d90"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:29:59.928914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:59.929528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:59.930071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:59.946133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] Creating event network-vif-deleted:62f8e952-318e-4cf2-bfa6-667e348f5d90 for instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 on n-h1-854121-3 Aug 24 02:29:59.951651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-667768d2-389f-4c7b-8f0c-f7dd892a94dc req-4da5689a-9efa-4502-95f8-fc8160629ae7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037336 Aug 24 02:29:59.952534 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4882/5874] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:29:59.983759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:29:59.984560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:29:59.990937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:59.992085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:59.992608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:29:59.993433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:29:59.993973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:29:59.994482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:00.058620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:00.066501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9db4535d-599a-429a-81b0-a2a5d06feb90 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1225 microversion: 2.1 time: 0.087111 Aug 24 02:30:00.080477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4883/5875] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:29:59 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:01.088399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:01.089074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:01.095996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:01.096535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:01.097015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:01.097736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:01.098211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:01.098654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:01.161743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:01.169729 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39c334ac-73a0-437d-b521-fdeb7d650cdf tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1225 microversion: 2.1 time: 0.086039 Aug 24 02:30:01.170401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4884/5876] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:01 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:02.195286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:02.196748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:02.205545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:02.206429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:02.207148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:02.208257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:02.208967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:02.209868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:02.294325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:02.303489 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12ae60a9-e691-4899-b49f-012eefd6ea11 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1225 microversion: 2.1 time: 0.114535 Aug 24 02:30:02.304909 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4885/5877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:02 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:03.324095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:03.328072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:03.342792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:03.343494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:03.343942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:03.344683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:03.346928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:03.347662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:03.421320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:03.425292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:03.430324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51c8305c-58fb-49be-82b0-d1097327f9b4 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1225 microversion: 2.1 time: 0.110277 Aug 24 02:30:03.431310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4886/5878] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:03 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:04.452879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:04.453648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:04.473173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:04.474223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:04.474519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:04.475182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:04.476377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:04.477304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:04.544252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad30acec65db4e9995475d54eaec8220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd493bf6b7c3648c498ea22eba0684418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:04.552774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-328e2a2a-ad51-4e52-add4-86bd35d87ccc tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 200 len: 1225 microversion: 2.1 time: 0.105719 Aug 24 02:30:04.554187 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4887/5879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:04 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:05.574637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:05.575267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: b3ece57a-7ce6-42aa-b82f-f771f4ac7943] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:05.582407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:05.582911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:05.583360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:05.584065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:05.584535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:05.585004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:05.598043 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 HTTP/1.1 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b3ece57a-7ce6-42aa-b82f-f771f4ac7943'} Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:05.599698 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance b3ece57a-7ce6-42aa-b82f-f771f4ac7943 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:30:05.605100 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-175948e9-19cd-437f-b1a2-f0da9ff19917 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943" status: 404 len: 111 microversion: 2.1 time: 0.030983 Aug 24 02:30:05.605856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4888/5880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:05 2022] GET /compute/v2.1/servers/b3ece57a-7ce6-42aa-b82f-f771f4ac7943 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:30:06.370410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:06.370957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:06.377413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:06.377916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:06.378368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:06.379141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:06.379609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:06.380047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:06.394417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac HTTP/1.1 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a36351fd-229e-4c1e-9074-4ad4cd5fcaac'} Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:30:06.395973 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93d01ec5-af95-43c7-92f0-3b7118d3303b tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 404 len: 111 microversion: 2.1 time: 0.031018 Aug 24 02:30:06.400768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4889/5881] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:30:06 2022] DELETE /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:30:06.406737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:06.407360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] [instance: a36351fd-229e-4c1e-9074-4ad4cd5fcaac] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:06.413340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:06.413833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:06.414476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:06.415321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:06.415946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:06.416385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:06.432476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] HTTP exception thrown: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Request method failure captured: Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac HTTP/1.1 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYkuaT7BXatyR7z1H9Og327Pu4yDEZxeXI5x0kEe2j4ppug2PqS-tgvNkwCJw0nfvWRe6bKaJeTKki85RFf_czeHQfoCr8Ta4d2PwWtrvOxBjbEesvwjcsN-Epeag5JNoCKkknB-c4aOXvVCi-OuQ9jM3qfYOHI2-QpR-D5U5YxdDNY Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d493bf6b7c3648c498ea22eba0684418"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d493bf6b7c3648c498ea22eba0684418 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBootPattern-1548194349 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ad30acec65db4e9995475d54eaec8220 Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBootPattern-1548194349-project Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'a36351fd-229e-4c1e-9074-4ad4cd5fcaac'} Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:06.434064 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Returning 404 to user: Instance a36351fd-229e-4c1e-9074-4ad4cd5fcaac could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59589233-16b3-4cc3-b5cb-121e7f974588 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac" status: 404 len: 111 microversion: 2.1 time: 0.032300 Aug 24 02:30:06.438680 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4890/5882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:06 2022] GET /compute/v2.1/servers/a36351fd-229e-4c1e-9074-4ad4cd5fcaac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:30:08.235858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:08.240394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:08.248547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.249097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.249558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.250285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.250939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.251391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.283357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-839cf186-d559-4ded-ba7b-341f19ee499a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051934 Aug 24 02:30:08.283934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4891/5883] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:30:08 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 02:30:08.350647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:08.351158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:08.357330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.357828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.358278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.358983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.359451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.359891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.385634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:30:08.466868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dec5ab5e-4811-44d2-9d7e-cfdbc259326e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 204 len: 0 microversion: 2.1 time: 0.119723 Aug 24 02:30:08.467481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4892/5884] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:30:08 2022] DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:30:08.476693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:08.477438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:08.483675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.484191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.484655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.485438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:08.485910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:08.486383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:08.632170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:08.641986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a565a48f-db7a-4249-a558-aa3272a6cfdf tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1671 microversion: 2.1 time: 0.169510 Aug 24 02:30:08.642496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4893/5885] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:08 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:09.663217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:09.664064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:09.671319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:09.671918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:09.672969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:09.673777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:09.674319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:09.674824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:09.842698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:09.858094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-410591af-38b5-4126-b6ac-082e6fad2721 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1671 microversion: 2.1 time: 0.198711 Aug 24 02:30:09.858916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4894/5886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:09 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:09.924836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e473d22-2ec1-4e2b-bfa8-08c6e041b4a5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] Calling method '.version_select at 0x7f6b90db2310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:09.956491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e473d22-2ec1-4e2b-bfa8-08c6e041b4a5 tempest-TestVolumeBootPattern-1548194349 tempest-TestVolumeBootPattern-1548194349-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716469685" status: 202 len: 0 microversion: 2.1 time: 0.035953 Aug 24 02:30:09.957437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4895/5887] 10.222.0.49 () {58 vars in 1260 bytes} [Wed Aug 24 02:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-716469685 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:30:10.879575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:10.880197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:10.888090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:10.888597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:10.889079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:10.890006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:10.890483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:10.890930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:11.034626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:11.047884 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c24a7c40-0812-4f15-89c8-6e4632b0c6f1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1671 microversion: 2.1 time: 0.172045 Aug 24 02:30:11.048476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4896/5888] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:10 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:12.073815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:12.074425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:12.084388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:12.095951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:12.096749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:12.097200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:12.097981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:12.098453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:12.098892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:12.172798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:12.181937 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8671cc7-fd30-493d-a26e-a9117a55dd90 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1604 microversion: 2.1 time: 0.112096 Aug 24 02:30:12.182868 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4897/5889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:12 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:12.311992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3056a1-ae75-47b1-a234-3df81405a87a", "name": "network-vif-deleted", "tag": "695be22c-b8be-47c9-a7d3-2f389482a891"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:12.322327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:12.323075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:12.323676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:12.348235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] Creating event network-vif-deleted:695be22c-b8be-47c9-a7d3-2f389482a891 for instance ad3056a1-ae75-47b1-a234-3df81405a87a on n-h2-854121-3 Aug 24 02:30:12.354069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3df4e30d-8bf5-4afe-bbba-55655b517240 req-20f85e3e-fcf0-434a-99ef-a88ff438734c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045887 Aug 24 02:30:12.355228 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4898/5890] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:30:13.206348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:13.207129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:13.234369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:13.236294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:13.237511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:13.239337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:13.241473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:13.242928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:13.285806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:13.286321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:13.286810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:13.287280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lazy-loading 'fault' on Instance uuid ad3056a1-ae75-47b1-a234-3df81405a87a {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:30:13.411442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:13.424887 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83050626-8ced-4009-89df-c396945eb026 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 200 len: 1325 microversion: 2.1 time: 0.222437 Aug 24 02:30:13.427757 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4899/5891] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:13 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:14.449837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:14.450477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:14.463960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:14.464774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:14.465383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:14.466695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:14.470810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:14.471240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:14.502783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a HTTP/1.1 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ad3056a1-ae75-47b1-a234-3df81405a87a'} Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:14.506231 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:30:14.511471 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27ab5c36-c1bd-4a57-aa67-8ea375e4810c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 404 len: 111 microversion: 2.1 time: 0.064301 Aug 24 02:30:14.512794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4900/5892] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:14 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:30:14.535780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb5ffdc7-4a97-42c9-92dd-9ee03aa0ceb4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '.version_select at 0x7f6b9045ad30>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:14.570364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb5ffdc7-4a97-42c9-92dd-9ee03aa0ceb4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96824736" status: 202 len: 0 microversion: 2.1 time: 0.050100 Aug 24 02:30:14.571739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4901/5893] 10.222.0.49 () {58 vars in 1215 bytes} [Wed Aug 24 02:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96824736 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:30:15.424010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b2b62f9-a39c-44d8-b21c-c84f04d30272 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: .version_select at 0x7f6b91314790>, body: {"keypair": {"name": "tempest-keypair-2060441459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqYHNMsh7JFYBWNifcpzAlujB+fZ0k5pxeePYguh9F198tATkWrv9Csu2M74Dk6VBqVWsZILbgotgalufpi8D/f39hXxubfcTfQcMbDFciPcReHNQYKtbcBidMor4iWRw=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:15.441805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8b2b62f9-a39c-44d8-b21c-c84f04d30272 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for project 8091b155401c481e9b19412d742c9c4a. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:30:15.451348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-8b2b62f9-a39c-44d8-b21c-c84f04d30272 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for user 58c2285adcb64632b010b881ef8da1b7 and project 8091b155401c481e9b19412d742c9c4a. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:30:15.476328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b2b62f9-a39c-44d8-b21c-c84f04d30272 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056246 Aug 24 02:30:15.477791 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4902/5894] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:30:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:30:15.895724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:15.898581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:15.930211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:15.948152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:15.949954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:15.950918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:15.953092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:15.953934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:16.042186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d7b4e18-40bd-4001-af57-6470bcc0eec5 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f/action" status: 200 len: 24572 microversion: 2.1 time: 0.150357 Aug 24 02:30:16.048766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4903/5895] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:30:15 2022] POST /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f/action => generated 24572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:30:17.251831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1288807805", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5dfb378-510f-4150-9a2d-4f83a65b23ce"}], "security_groups": [{"name": "tempest-securitygroup--1016846198"}], "key_name": "tempest-keypair-2060441459", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:17.462743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] validate_networks() for [('a5dfb378-510f-4150-9a2d-4f83a65b23ce', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:30:17.958498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:30:17.959060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:30:17.959654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:30:17.960152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:30:17.960815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:30:17.973510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:17.974014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:17.974473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:17.975783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:17.976256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:17.976698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:18.003974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for project 8091b155401c481e9b19412d742c9c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:30:18.016807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Getting quotas for user 58c2285adcb64632b010b881ef8da1b7 and project 8091b155401c481e9b19412d742c9c4a. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:30:18.041165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:30:18.046132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:30:18.119378 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-60369e68-2a95-4b01-9964-7a5e64e4d758 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.872337 Aug 24 02:30:18.119699 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4904/5896] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:30:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:30:18.130847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6933dd90-8477-4967-a2a0-c0c7e6f29077 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:18.131507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6933dd90-8477-4967-a2a0-c0c7e6f29077 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:18.189841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6933dd90-8477-4967-a2a0-c0c7e6f29077 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:18.199531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6933dd90-8477-4967-a2a0-c0c7e6f29077 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1238 microversion: 2.1 time: 0.072350 Aug 24 02:30:18.217450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4905/5897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:18 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:19.221800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:19.223242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:19.231987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:19.232499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:19.233044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:19.233770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:19.237261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:19.237982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:19.305863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:19.314006 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-268b7d08-6295-499b-9397-9cc39a1e615e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1290 microversion: 2.1 time: 0.096198 Aug 24 02:30:19.314581 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4906/5898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:19 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:20.339946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:20.344356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:20.353297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:20.354209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:20.354929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:20.356305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:20.357078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:20.357948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:20.527656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:20.536711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97c0587e-fa60-45b4-b202-1c297ad61e24 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.203101 Aug 24 02:30:20.538756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4907/5899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:20 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:21.085688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4de2bae-fadf-4764-a954-df2df9d1fbd6", "tag": "80d6f367-57d3-4c70-8d34-5e5edbd9c9f3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:21.099595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:21.101088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:21.101864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:21.114182 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] Creating event network-changed:80d6f367-57d3-4c70-8d34-5e5edbd9c9f3 for instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 on n-h2-854121-3 Aug 24 02:30:21.119103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6d7c5449-a64e-4818-a77c-5e4aaa7bdaae req-bccffa09-42dc-49d0-a74a-d7225a5f1a11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037619 Aug 24 02:30:21.120248 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4908/5900] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:30:21.561573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:21.562244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:21.569168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:21.569697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:21.570142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:21.570843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:21.571306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:21.571740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:21.749500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:21.758045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07c7acb8-90e4-46f6-ab72-20abe00d3de1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.201812 Aug 24 02:30:21.758850 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4909/5901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:21 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:22.778723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:22.779360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:22.786488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:22.786999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:22.788023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:22.788893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:22.789363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:22.789801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:22.809770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:22.920944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:22.928752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e31a79fe-a9cf-4fee-ae65-9d1d27671cfd tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.153919 Aug 24 02:30:22.929324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4910/5902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:22 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:23.948969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:23.949883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:23.957261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:23.957887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:23.958449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:23.959233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:23.959793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:23.960229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:24.097539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:24.106212 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3304648-3db4-4efc-a09b-177d9b8b291c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.161147 Aug 24 02:30:24.106790 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4911/5903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:23 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:25.126558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:25.127225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:25.134126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:25.134621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:25.135070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:25.135770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:25.136235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:25.136670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:25.280365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:25.289437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aba62b18-43b9-4c2c-97c1-90ab0f9bb0f6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.166466 Aug 24 02:30:25.290230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4912/5904] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:25 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:26.310598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:26.311488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:26.319420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:26.319933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:26.320393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:26.321323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:26.321811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:26.322259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:26.450638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:26.458583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1217b389-feca-46c5-b2e3-89e0966b91b6 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.152030 Aug 24 02:30:26.459153 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4913/5905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:26 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:27.216258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4de2bae-fadf-4764-a954-df2df9d1fbd6", "name": "network-vif-plugged", "status": "completed", "tag": "80d6f367-57d3-4c70-8d34-5e5edbd9c9f3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:27.226762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:27.227405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:27.228034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:27.246739 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] Creating event network-vif-plugged:80d6f367-57d3-4c70-8d34-5e5edbd9c9f3 for instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 on n-h2-854121-3 Aug 24 02:30:27.254138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c0b4105f-65dd-4ab6-93fa-fe4f4e68c459 req-caa99bbb-034b-422e-b973-749697dbecc3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041773 Aug 24 02:30:27.255006 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4914/5906] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:30:27.486312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:27.487027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:27.493916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:27.494415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:27.494869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:27.495574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:27.496039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:27.496481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:27.631670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:27.639812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a2a0cce-51e6-4a04-b2ce-1bd153bb6666 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.158480 Aug 24 02:30:27.640402 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4915/5907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:27 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:28.662086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:28.662912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:28.665061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:28.665763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:28.673413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:28.674142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:28.674602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:28.675330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:28.675809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:28.676254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:28.812709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:28.821106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22986599-b305-4e57-9779-95def5506892 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1364 microversion: 2.1 time: 0.163016 Aug 24 02:30:28.821672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4916/5908] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:28 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:29.842136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:29.842896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:29.849914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:29.850485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:29.850940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:29.851644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:29.852109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:29.852546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:30.007244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:30.015142 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02f252bb-4a7d-40d8-b364-7ec15d30a18b tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1550 microversion: 2.1 time: 0.176936 Aug 24 02:30:30.015724 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4917/5909] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:29 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1550 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:30.035119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:30.035624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:30.041578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:30.042079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:30.042533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:30.043236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:30.043709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:30.044148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:30.124989 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5792b5d7-32e9-4af1-bb59-c47c69962e21 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093372 Aug 24 02:30:30.125872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4918/5910] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:30:30 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:30:31.383907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4de2bae-fadf-4764-a954-df2df9d1fbd6", "tag": "80d6f367-57d3-4c70-8d34-5e5edbd9c9f3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:31.395612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:31.396202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:31.397440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:31.409532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] Creating event network-changed:80d6f367-57d3-4c70-8d34-5e5edbd9c9f3 for instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 on n-h2-854121-3 Aug 24 02:30:31.415045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5178db59-3af6-4f65-b77f-168c8d1156b2 req-5e09e7a0-64bb-4d23-9470-1839cdc09027 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036979 Aug 24 02:30:31.415857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4919/5911] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:30:40.437757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-891063302", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f379370f-b026-4d3d-8c10-3aab7d71bf5a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:40.489326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] validate_networks() for [('f379370f-b026-4d3d-8c10-3aab7d71bf5a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:30:40.827695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:30:40.828135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:30:40.828658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:30:40.829254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:30:40.829708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:30:40.839322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:40.839817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:40.840271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:40.841082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:40.841551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:40.841994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:40.859155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Getting quotas for project afe6d9009c2f4187a8bb41eed7e459c1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:30:40.864668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Getting quotas for user e0ee15124f9b4dbf86fd562bb1296bc5 and project afe6d9009c2f4187a8bb41eed7e459c1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:30:40.876967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:30:40.879325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:30:40.923880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02081865-2986-490f-94a4-ba7faa86f356 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491565 Aug 24 02:30:40.924536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4920/5912] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:30:40.934920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-914bb107-4233-4d5e-9b87-ea86ccc93859 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:40.935547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-914bb107-4233-4d5e-9b87-ea86ccc93859 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:40.992314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-914bb107-4233-4d5e-9b87-ea86ccc93859 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:40.999146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-914bb107-4233-4d5e-9b87-ea86ccc93859 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1218 microversion: 2.1 time: 0.067889 Aug 24 02:30:40.999716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4921/5913] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:40 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:42.020217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:42.021494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:42.028586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:42.029123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:42.029583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:42.030296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:42.030798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:42.031239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:42.096322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:42.107111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10b7bce2-9bfc-4126-9e3d-8b2f2afdd933 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1278 microversion: 2.1 time: 0.090798 Aug 24 02:30:42.120777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4922/5914] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:42 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:43.128834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:43.129506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:43.132459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:43.137740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:43.138249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:43.138707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:43.139425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:43.139898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:43.140483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:43.274200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:43.281924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d64adb4-221a-410d-935b-338fd9f5f640 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.157607 Aug 24 02:30:43.282502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4923/5915] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:43 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:43.322033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86ff880-1c15-4a4b-8b38-8ef773ed2566", "tag": "88fc9323-edeb-48a0-93af-0892d3d4c42d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:43.332701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:43.333186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:43.333917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:43.344756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] Creating event network-changed:88fc9323-edeb-48a0-93af-0892d3d4c42d for instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 on n-h2-854121-3 Aug 24 02:30:43.350070 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8c857db3-8227-4d67-8bd0-39308408edd8 req-ceba140a-ace9-445f-a856-329da359b481 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031989 Aug 24 02:30:43.350694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4924/5916] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:30:44.305667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:44.306374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:44.312577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:44.313105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:44.313552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:44.314246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:44.314713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:44.315146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:44.445229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:44.452971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4cc6f1a-61f4-44b6-88c9-95a037c9de80 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.153047 Aug 24 02:30:44.453538 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4925/5917] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:44 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:45.473637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:45.474806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:45.481647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:45.482149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:45.482603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:45.483309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:45.483780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:45.484222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:45.612011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:45.620240 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abb98074-99bc-4a69-8cd6-0de3e5c9f5a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.150519 Aug 24 02:30:45.620902 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4926/5918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:45 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:46.361395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:46.363639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:46.369714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:46.370216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:46.370676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:46.371382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:46.371854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:46.372296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:46.441314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aae3a822-562c-4ea8-bea5-dd0664019c76 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "POST /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f/action" status: 200 len: 32637 microversion: 2.1 time: 0.083606 Aug 24 02:30:46.441871 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4927/5919] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:30:46 2022] POST /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f/action => generated 32637 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:30:46.640732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:46.641475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:46.648997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:46.649493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:46.649948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:46.650654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:46.651115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:46.651554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:46.858265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:46.866784 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4756c04f-7061-48cd-851d-1f2fd6a3acfa tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.230454 Aug 24 02:30:46.867361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4928/5920] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:46 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:47.506766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:47.507399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:47.514380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.514954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.515470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.516241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.516800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.517239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.545810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:30:47.598086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:47.635772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-306b31da-5eb7-4699-bf1a-85f0a3cf5d91 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 204 len: 0 microversion: 2.1 time: 0.131319 Aug 24 02:30:47.636464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4929/5921] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:30:47 2022] DELETE /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:30:47.647113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6d3a498-c508-4f85-a93e-5ea3d40b558f", "tag": "5c458afe-b099-41ba-b1d8-fb8e844d019d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:47.657530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.658017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.658680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.670933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] Creating event network-changed:5c458afe-b099-41ba-b1d8-fb8e844d019d for instance b6d3a498-c508-4f85-a93e-5ea3d40b558f on n-h1-854121-3 Aug 24 02:30:47.676242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c9769df9-5888-4b4d-8e6b-de78c0c95ad6 req-341f5491-f083-42fe-91a4-747063386594 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035022 Aug 24 02:30:47.677559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4930/5922] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:30:47.682666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:47.683371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:47.691367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.691966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.692419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.693224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.693695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.694132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.831937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:47.840352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6bd9fe0-d83d-410a-afdc-adebb85d43b4 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1668 microversion: 2.1 time: 0.161467 Aug 24 02:30:47.840975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4931/5923] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:47 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:47.887701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:47.888368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:47.894672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.895186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.895717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:47.896479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:47.896977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:47.897424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:48.030579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:48.039192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-babe164f-fb1b-4541-b671-ed74f92c00df tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.155457 Aug 24 02:30:48.039882 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4932/5924] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:47 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:48.864927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:48.865606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:48.872386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:48.873020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:48.873481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:48.874196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:48.874671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:48.875116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:49.186062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:49.194431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d3b2897-9fb2-47d6-9bf1-2000cbfcbeb2 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1668 microversion: 2.1 time: 0.333901 Aug 24 02:30:49.195014 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4933/5925] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:48 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:49.199502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:49.200253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:49.211986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:49.212501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:49.212984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:49.213702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:49.214241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:49.214687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:49.452185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:49.461224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8edbab2f-228c-4cbb-9dff-db28ceff8cda tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.265134 Aug 24 02:30:49.461798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4934/5926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:49 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:49.466812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86ff880-1c15-4a4b-8b38-8ef773ed2566", "name": "network-vif-plugged", "status": "completed", "tag": "88fc9323-edeb-48a0-93af-0892d3d4c42d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:49.480502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:49.481032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:49.481481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:49.494015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] Creating event network-vif-plugged:88fc9323-edeb-48a0-93af-0892d3d4c42d for instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 on n-h2-854121-3 Aug 24 02:30:49.498802 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0062cc5d-67ae-4dfa-afdf-6a4daeed68ff req-eb3e13d8-d309-49f3-93fa-c05c9066945a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035586 Aug 24 02:30:49.499345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4935/5927] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:30:49.777877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6d3a498-c508-4f85-a93e-5ea3d40b558f", "name": "network-vif-deleted", "tag": "5c458afe-b099-41ba-b1d8-fb8e844d019d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:30:49.788176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:49.788675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:49.789148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:49.805943 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] Creating event network-vif-deleted:5c458afe-b099-41ba-b1d8-fb8e844d019d for instance b6d3a498-c508-4f85-a93e-5ea3d40b558f on n-h1-854121-3 Aug 24 02:30:49.810804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-077b06b8-d49c-4282-ad9a-1cbfd119ec40 req-bbce150a-c585-4260-ad9d-1209ac004e60 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037415 Aug 24 02:30:49.811411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4936/5928] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:30:50.216948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:50.217655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:50.224416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:50.224937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:50.225382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:50.226082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:50.226548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:50.227006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:50.263682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:50.264243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:50.264806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:50.265276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lazy-loading 'fault' on Instance uuid b6d3a498-c508-4f85-a93e-5ea3d40b558f {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:30:50.309132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec976f1cfd264aa4b3a04130a743e19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03814fdd9db4476a95a2299793fecec4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:50.317253 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2992bc4b-e651-4215-92bc-c8a773b28016 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 200 len: 1338 microversion: 2.1 time: 0.105441 Aug 24 02:30:50.317875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4937/5929] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:50 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:30:50.482228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:50.482861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:50.489021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:50.489527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:50.489982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:50.490694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:50.491165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:50.491610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:50.626304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:50.634596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44a163dd-501b-4d02-b96d-ba3a5606421a tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1318 microversion: 2.1 time: 0.156295 Aug 24 02:30:50.635164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4938/5930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:50 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:30:51.338969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:51.339627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] [instance: b6d3a498-c508-4f85-a93e-5ea3d40b558f] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:51.341665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:51.342428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:30:51.349935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:51.350439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:51.350896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:51.351606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:51.352077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:51.352523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:51.366633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] HTTP exception thrown: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Request method failure captured: Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f HTTP/1.1 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYxazDCGLGfJev0bDITB1R-8_LFZDYlO-UTXklCZuT0yRtsrMjP6K4gvRHKKAL04w537Or8POTjumsnSgnYf4nDpwn2ubFukvh0KKGHVbg_98kGiy3ViALyqFY74FMVQ6vRUW5h9k-qe_7Cjg4MQkp3VFew1R8PJ2Np42IQFCT67a3I Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/03814fdd9db4476a95a2299793fecec4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_03814fdd9db4476a95a2299793fecec4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 03814fdd9db4476a95a2299793fecec4 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkBasicOps-1224987377 Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: ec976f1cfd264aa4b3a04130a743e19e Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkBasicOps-1224987377-project Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b6d3a498-c508-4f85-a93e-5ea3d40b558f'} Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:30:51.368280 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Returning 404 to user: Instance b6d3a498-c508-4f85-a93e-5ea3d40b558f could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-434e49cd-3897-4e6f-b8de-ec8eeda13f0d tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f" status: 404 len: 111 microversion: 2.1 time: 0.034778 Aug 24 02:30:51.373111 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4939/5931] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:51 2022] GET /compute/v2.1/servers/b6d3a498-c508-4f85-a93e-5ea3d40b558f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:30:51.528261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91292bd7-b8be-485c-976d-407c34fe2a98 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] Calling method '.version_select at 0x7f6b9045a160>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:51.550147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91292bd7-b8be-485c-976d-407c34fe2a98 tempest-TestNetworkBasicOps-1224987377 tempest-TestNetworkBasicOps-1224987377-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1144089847" status: 202 len: 0 microversion: 2.1 time: 0.026294 Aug 24 02:30:51.550744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4940/5932] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 02:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1144089847 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:30:51.657833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:30:51.658561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:30:51.665904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:51.666416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:51.666869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:51.667595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:30:51.668351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:30:51.668660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:30:51.873675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:30:51.881888 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa3c8c4e-cdd8-4f8b-bfb9-f5b06540cb63 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1506 microversion: 2.1 time: 0.228121 Aug 24 02:30:51.882485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4941/5933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:30:51 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:11.625459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb07db46-87b2-4059-b2b6-1a93e46c70c4", "device": "/dev/sdb"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:31:11.627995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:11.631332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:31:11.632236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=52 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:31:11.639138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:11.639717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:11.640196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:11.640930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:11.641397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:11.641839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:11.919480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93328bac-e305-4032-9198-5387bdc61dd7 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "POST /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297879 Aug 24 02:31:11.920458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4942/5934] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:31:11 2022] POST /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:31:35.887986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:31:35.888896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:31:35.893518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:35.894109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:35.901428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:35.901922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:35.902375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:35.903073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:35.903535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:35.903971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:35.992665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lazy-loading 'services' on Instance uuid e86ff880-1c15-4a4b-8b38-8ef773ed2566 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:31:36.062762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bc78d91-11b2-4796-8044-b9abfd1f7490 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566/os-volume_attachments/eb07db46-87b2-4059-b2b6-1a93e46c70c4" status: 202 len: 0 microversion: 2.1 time: 0.176434 Aug 24 02:31:36.063407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4943/5935] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:31:35 2022] DELETE /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566/os-volume_attachments/eb07db46-87b2-4059-b2b6-1a93e46c70c4 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:31:41.461027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:41.461636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:41.467931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:41.468432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:41.468914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:41.469620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:41.470093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:41.470536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:41.497955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:31:41.574963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22e8c60b-9fa5-48a0-b6be-83f82a1e4f71 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 204 len: 0 microversion: 2.1 time: 0.118874 Aug 24 02:31:41.575626 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4944/5936] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:31:41 2022] DELETE /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:31:41.584609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:41.585348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:41.591299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:41.591800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:41.592252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:41.592987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:41.593461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:41.593906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:41.727189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:41.735105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84b83568-e636-46bb-9554-375797c331bc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1512 microversion: 2.1 time: 0.154625 Aug 24 02:31:41.735683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4945/5937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:41 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:42.757564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:42.758173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:42.765400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:42.766019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:42.766611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:42.767328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:42.767797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:42.768233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:42.896954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:42.905586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-973d7442-f6d2-4436-8ef1-bfea3b542e0b tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1512 microversion: 2.1 time: 0.152222 Aug 24 02:31:42.906627 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4946/5938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:42 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:43.926821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:43.927536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:43.935998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:43.936858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:43.937599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:43.938339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:43.938811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:43.939249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:44.041688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:44.049760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7c560390-77a7-469b-8925-ba3f2ed68350 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 200 len: 1470 microversion: 2.1 time: 0.127018 Aug 24 02:31:44.050372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4947/5939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:43 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 1470 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:44.055562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86ff880-1c15-4a4b-8b38-8ef773ed2566", "name": "network-vif-deleted", "tag": "88fc9323-edeb-48a0-93af-0892d3d4c42d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:31:44.066280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:44.066862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:44.067480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:44.079953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] Creating event network-vif-deleted:88fc9323-edeb-48a0-93af-0892d3d4c42d for instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 on n-h2-854121-3 Aug 24 02:31:44.085768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-46cd8794-77a2-4684-8892-70e5bc5588ce req-1c47c0a8-4e73-4ee4-a74d-522d8e4fdf76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Aug 24 02:31:44.086918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4948/5940] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:31:45.073354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:45.074084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: e86ff880-1c15-4a4b-8b38-8ef773ed2566] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:45.081994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:45.082510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:45.082967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:45.083699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:45.084171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:45.084616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:45.098879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] HTTP exception thrown: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Request method failure captured: Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 HTTP/1.1 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY0UdAr_tQzk-SuZF-6t5x5EZQXjrJhhHpv4Q5jHqS3VH_bo7fi6iFBXEqC4tgfdwWt8LQvVDIG37esruWeZeq8DTRzWcsJv9MGYO26ByMQFdoxrbauPGu6QSUU64-5qBKZ8iuZpSFYx9G45Vu4OULHEBxlp44Yu0Lrr6Ri2RS3eT64 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: afe6d9009c2f4187a8bb41eed7e459c1 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: afe6d9009c2f4187a8bb41eed7e459c1 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotTestJSON-1541642217-project Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e0ee15124f9b4dbf86fd562bb1296bc5 Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotTestJSON-1541642217-project Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e86ff880-1c15-4a4b-8b38-8ef773ed2566'} Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:31:45.100543 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Returning 404 to user: Instance e86ff880-1c15-4a4b-8b38-8ef773ed2566 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03370bd4-ade5-48b5-b668-f4eeb7ff57c3 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566" status: 404 len: 111 microversion: 2.1 time: 0.033088 Aug 24 02:31:45.105096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4949/5941] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:45 2022] GET /compute/v2.1/servers/e86ff880-1c15-4a4b-8b38-8ef773ed2566 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:31:46.902726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:46.903314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:46.909478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:46.910047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:46.910567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:46.911352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:46.911874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:46.912385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:46.937058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fcefd10-3725-44c0-a19c-29662c5d85d2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/ips" status: 200 len: 146 microversion: 2.1 time: 0.232248 Aug 24 02:31:46.937623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4950/5942] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:31:46 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/ips => generated 146 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:31:48.295883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d27aca0f-2acf-4411-986f-55d15b5acc2c"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:31:48.298544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:48.305733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:48.306350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:48.306871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:48.307678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:48.308221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:48.308757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:48.606741 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-921cc439-deaf-4879-82b0-d7e0fd783ca4 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314709 Aug 24 02:31:48.612437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4951/5943] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:31:48 2022] POST /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:31:52.105991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1252721338", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "f379370f-b026-4d3d-8c10-3aab7d71bf5a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:31:52.162446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] validate_networks() for [('f379370f-b026-4d3d-8c10-3aab7d71bf5a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:31:52.534739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:31:52.535209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:31:52.536330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:31:52.537132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:31:52.537721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:31:52.546823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:52.547325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:52.547890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:52.548647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:52.549173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:52.549686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:52.566638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Getting quotas for project afe6d9009c2f4187a8bb41eed7e459c1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:31:52.572084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Getting quotas for user e0ee15124f9b4dbf86fd562bb1296bc5 and project afe6d9009c2f4187a8bb41eed7e459c1. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:31:52.585515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:31:52.587923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:31:52.633756 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e16be107-7730-4908-8b92-0a89e04b0548 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532218 Aug 24 02:31:52.634744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4952/5944] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:31:52.645872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74da0e7d-7a10-42e2-9d94-984850bbe5e6 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:52.646502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74da0e7d-7a10-42e2-9d94-984850bbe5e6 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:52.710841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74da0e7d-7a10-42e2-9d94-984850bbe5e6 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:52.719613 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74da0e7d-7a10-42e2-9d94-984850bbe5e6 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1219 microversion: 2.1 time: 0.078246 Aug 24 02:31:52.720520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4953/5945] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:52 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:31:53.740845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:53.741738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:53.748467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:53.753260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:53.753947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:53.754710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:53.755350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:53.755971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:53.820567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:53.831950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3a7e37c-de45-4ba8-9a5a-32c5b5a51d9c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1271 microversion: 2.1 time: 0.095176 Aug 24 02:31:53.832530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4954/5946] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:53 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:54.864063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:54.864688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:54.871594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:54.872095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:54.872542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:54.873268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:54.873896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:54.874522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:55.127500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:55.137736 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a2d350f-674e-403e-bd0d-973fa2484fbc tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.278078 Aug 24 02:31:55.138517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4955/5947] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:54 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:55.441764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f087ad44-258b-4b8e-8ed1-8f74aab297b6", "tag": "7c954bb2-085a-45af-b355-fc3ef01e022c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:31:55.453941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:55.455288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:55.456241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:55.468428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] Creating event network-changed:7c954bb2-085a-45af-b355-fc3ef01e022c for instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 on n-h1-854121-3 Aug 24 02:31:55.475608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-787cdfec-e380-479b-ae7e-74b4e28b9447 req-15797de1-1fbc-443c-a2eb-e4b3ecc3d51a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039201 Aug 24 02:31:55.476496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4956/5948] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:31:56.159007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:56.159721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:56.166751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:56.167249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:56.167698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:56.168402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:56.168905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:56.169347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:56.307685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:56.316124 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5771e12-7152-4e4a-acc2-5f3caedd0a2c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.160694 Aug 24 02:31:56.316706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4957/5949] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:56 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:57.337892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:57.338639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:57.345625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:57.346129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:57.347150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:57.347881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:57.348354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:57.348825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:57.483257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:57.491096 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69338beb-b522-46e8-aef3-b87c11e8c7d5 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.157228 Aug 24 02:31:57.491710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4958/5950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:57 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:58.512301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:58.512974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:58.519644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:58.520149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:58.520598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:58.521351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:58.521817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:58.522256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:58.658775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:58.662874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:31:58.668065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f2db7b1-ee2d-43eb-9eaa-e0ebb4fdac87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.160528 Aug 24 02:31:58.669051 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4959/5951] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:58 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:31:59.696961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:31:59.697686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:31:59.706936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:59.707473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:59.707922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:59.708701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:31:59.709239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:31:59.709682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:31:59.841250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:31:59.849125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8242f1e2-7d00-4f29-bb6c-7ebcb3d77052 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.156812 Aug 24 02:31:59.849903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4960/5952] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:31:59 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:00.462206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:00.463296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:00.469535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.469995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.470448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:00.471672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.472144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.472584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:00.502934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f82c3746-29d4-4dc0-8df7-3265d3575487 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Aug 24 02:32:00.503496 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4961/5953] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:32:00 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:00.513472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:00.513973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:00.519668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.520170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.520624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:00.521358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.521826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.522268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:00.553164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-807b8bfe-f315-418e-929c-25662a562bfb tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c" status: 200 len: 194 microversion: 2.1 time: 0.043156 Aug 24 02:32:00.553946 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4962/5954] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 02:32:00 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:00.869604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:00.871245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:00.878716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.879307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.879838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:00.880911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:00.881277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:00.881792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:01.017876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:01.026615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f85fd7d3-97fd-41c8-8503-4dc2a5fa0b83 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.160998 Aug 24 02:32:01.027341 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4963/5955] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:00 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:01.234041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f087ad44-258b-4b8e-8ed1-8f74aab297b6", "name": "network-vif-plugged", "status": "completed", "tag": "7c954bb2-085a-45af-b355-fc3ef01e022c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:01.251357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:01.252091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:01.253254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:01.267781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] Creating event network-vif-plugged:7c954bb2-085a-45af-b355-fc3ef01e022c for instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 on n-h1-854121-3 Aug 24 02:32:01.275464 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4897c1bd-6bff-4e22-8fa8-9ef35afacbfb req-5289e695-c4c8-4161-9200-2ef0475abc1e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045676 Aug 24 02:32:01.277782 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4964/5956] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:01.879780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62f3e1da-f919-47fa-a1a5-fcc9f70430f7"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:01.882332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:01.889518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:01.890018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:01.890476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:01.891190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:01.891666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:01.892112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:02.169897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d6a123f-4f6f-4e0c-809f-2592d6ed328a tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "POST /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294370 Aug 24 02:32:02.170559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4965/5957] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:32:01 2022] POST /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:02.185351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:02.186097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:02.194368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:02.196654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:02.197956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:02.198761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:02.199395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:02.199885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:02.341760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:02.350936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b520779-44b6-4c03-8e4b-1ca1cac920a8 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1319 microversion: 2.1 time: 0.179141 Aug 24 02:32:02.351511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4966/5958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:02 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:32:03.371582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:03.372449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:03.374533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:03.375831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:03.382329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:03.383014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:03.383529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:03.384341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:03.384901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:03.385402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:03.516846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:03.525228 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ae9b82a-ae15-4f62-b2ab-73775f64ddc2 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1507 microversion: 2.1 time: 0.157629 Aug 24 02:32:03.525957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4967/5959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:03 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:03.546632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02ddc667-300d-4ad9-8a8b-ed86549f4762", "device": "/dev/sdb"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:03.549949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:03.559051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:03.559656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:03.560200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:03.561203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:03.561903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:03.562554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:03.869929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb5e0aae-f51c-430e-ac81-8f5d340c37c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "POST /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326651 Aug 24 02:32:03.870510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4968/5960] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 02:32:03 2022] POST /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:16.004392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:16.004392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:16.004392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:16.004392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:16.009807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.010311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.010767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.011484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.011955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.012399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.049758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67b0d846-d8a0-487c-8a14-7ccee8fa8510 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056189 Aug 24 02:32:16.050271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4969/5961] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:32:15 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:16.193136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:16.193650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:16.200394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.200968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.201428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.202145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.202618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.203068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.232881 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8e7cfc2-a5f4-40ae-b4c2-b7c9f9c061e2 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c" status: 200 len: 194 microversion: 2.1 time: 0.043720 Aug 24 02:32:16.238937 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4970/5962] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 02:32:16 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:16.244375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:16.244933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:16.250961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.251461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.251944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.252652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:16.253168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:16.253612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:16.339649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lazy-loading 'services' on Instance uuid e4de2bae-fadf-4764-a954-df2df9d1fbd6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:32:16.424067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb5ae65c-4a61-48d9-8594-12f9f26c8b07 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c" status: 202 len: 0 microversion: 2.1 time: 0.183249 Aug 24 02:32:16.424667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4971/5963] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:32:16 2022] DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/d27aca0f-2acf-4411-986f-55d15b5acc2c => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:32:22.099817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:22.099817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:22.103579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:22.104091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:22.104550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:22.105302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:22.105784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:22.106235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:22.141059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4922217-f627-441f-992e-384c7e8a802c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/62f3e1da-f919-47fa-a1a5-fcc9f70430f7" status: 200 len: 194 microversion: 2.1 time: 0.049772 Aug 24 02:32:22.141838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4972/5964] 10.222.0.49 () {58 vars in 1413 bytes} [Wed Aug 24 02:32:22 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/62f3e1da-f919-47fa-a1a5-fcc9f70430f7 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:22.154885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:22.155371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:22.162252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:22.162772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:22.163268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:22.163996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:22.164669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:22.165158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:22.274502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lazy-loading 'services' on Instance uuid e4de2bae-fadf-4764-a954-df2df9d1fbd6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:32:22.370901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbc73311-def0-488e-9adf-1cb3da2a0e4c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/62f3e1da-f919-47fa-a1a5-fcc9f70430f7" status: 202 len: 0 microversion: 2.1 time: 0.222086 Aug 24 02:32:22.375173 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4973/5965] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:32:22 2022] DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments/62f3e1da-f919-47fa-a1a5-fcc9f70430f7 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:32:27.837773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:27.839635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:27.846296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:27.846826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:27.847292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:27.848040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:27.848527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:27.848987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:27.879828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02622bd6-cf2e-419c-b4bd-baf745f3b02e tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047936 Aug 24 02:32:27.880396 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4974/5966] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:32:27 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 02:32:27.996522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:27.998751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:28.005420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.005921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.006377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.007084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.007556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.008003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.036451 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e9d068d-8d9d-451f-959f-0c354b0e8b02 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043777 Aug 24 02:32:28.036963 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4975/5967] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 02:32:27 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 02:32:28.099807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:28.100233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:28.106391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.106895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.107350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.108069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.108550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.109014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.134508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:32:28.215003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3970f26-d0be-49a5-b07c-fabc7deebaab tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 204 len: 0 microversion: 2.1 time: 0.119521 Aug 24 02:32:28.215642 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4976/5968] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:32:28 2022] DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:32:28.223523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:28.224125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:28.230471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.230974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.231428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.232146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.232618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.233091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.323932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lazy-loading 'services' on Instance uuid f087ad44-258b-4b8e-8ed1-8f74aab297b6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:32:28.400401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2bcfefc6-f9b8-459e-b28c-7e00813b45ca tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6/os-volume_attachments/02ddc667-300d-4ad9-8a8b-ed86549f4762" status: 202 len: 0 microversion: 2.1 time: 0.181932 Aug 24 02:32:28.401028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4977/5969] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 02:32:28 2022] DELETE /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6/os-volume_attachments/02ddc667-300d-4ad9-8a8b-ed86549f4762 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:32:28.416657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:28.419139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:28.433296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.434140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.435431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.436923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:28.437574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:28.438388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:28.592846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:28.602868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05e6816e-2074-4487-bd4c-64fce2f64cf1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1675 microversion: 2.1 time: 0.200196 Aug 24 02:32:28.603538 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4978/5970] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:28 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:32:29.625385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:29.626095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:29.635833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:29.636424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:29.636994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:29.637945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:29.638609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:29.639780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:29.793497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:29.801731 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-731c927a-c9d4-42c9-98f8-4ac454386751 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1675 microversion: 2.1 time: 0.180193 Aug 24 02:32:29.802406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4979/5971] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:29 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:30.825065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:30.825912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:30.835010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:30.835831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:30.836313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:30.837171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:30.837647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:30.838083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:30.986059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:30.995370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af13e77f-1302-453b-857a-7b1315d8c4c1 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1675 microversion: 2.1 time: 0.174270 Aug 24 02:32:30.996055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4980/5972] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:30 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:31.540184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4de2bae-fadf-4764-a954-df2df9d1fbd6", "name": "network-vif-deleted", "tag": "80d6f367-57d3-4c70-8d34-5e5edbd9c9f3"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:31.586568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:31.588027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:31.588664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:31.623543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] Creating event network-vif-deleted:80d6f367-57d3-4c70-8d34-5e5edbd9c9f3 for instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 on n-h2-854121-3 Aug 24 02:32:31.628492 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-460889e6-534f-486e-bb83-0dc2eca21404 req-c584bdcd-3ff7-43f0-ba5e-37c73ac4e8b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235142 Aug 24 02:32:31.629134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4981/5973] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:32.019366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:32.020215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:32.027743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:32.028591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:32.029066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:32.030013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:32.030721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:32.031164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:32.050188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:32.066187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:32.066959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:32.067410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:32.067874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lazy-loading 'fault' on Instance uuid e4de2bae-fadf-4764-a954-df2df9d1fbd6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:32:32.116662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c2285adcb64632b010b881ef8da1b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8091b155401c481e9b19412d742c9c4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:32.126826 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc794dbf-e30d-4e1b-afd4-7e5ab08f146f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 200 len: 1328 microversion: 2.1 time: 0.111974 Aug 24 02:32:32.127408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4982/5974] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:32 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:32:33.148359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:33.149058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:33.156981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:33.156981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:33.158141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:33.158909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:33.159394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:33.159842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:33.174413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 HTTP/1.1 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4de2bae-fadf-4764-a954-df2df9d1fbd6'} Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:33.176116 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0dbe1603-57a6-4113-999c-b67581dca099 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 404 len: 111 microversion: 2.1 time: 0.033339 Aug 24 02:32:33.181038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4983/5975] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:33 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:32:33.186631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a1d1a40-cf69-46a7-991d-7bd7a06fcc0c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '.version_select at 0x7f6b914e83a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:33.209700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a1d1a40-cf69-46a7-991d-7bd7a06fcc0c tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060441459" status: 202 len: 0 microversion: 2.1 time: 0.026638 Aug 24 02:32:33.210781 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4984/5976] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 02:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060441459 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:32:33.849394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:33.849917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:33.858927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:33.859461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:33.859920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:33.861171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:33.861639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:33.862231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:33.893432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:32:34.000701 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2381769b-8409-408d-aa53-93867baefc70 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 204 len: 0 microversion: 2.1 time: 0.155054 Aug 24 02:32:34.004231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4985/5977] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:32:33 2022] DELETE /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:32:34.010842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:34.011667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:34.017900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:34.018471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:34.018999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:34.019779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:34.020341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:34.020884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:34.161916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:34.169822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cea6385e-c0cc-4575-9590-ed003fb854c4 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1513 microversion: 2.1 time: 0.163209 Aug 24 02:32:34.170335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4986/5978] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:34 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:32:35.191709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:35.192451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:35.199709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:35.200211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:35.200819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:35.201585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:35.202050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:35.202487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:35.338238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:35.346204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23032499-2c88-4515-992d-9c367b24308d tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1513 microversion: 2.1 time: 0.158931 Aug 24 02:32:35.346808 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4987/5979] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:35 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:32:36.257677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f087ad44-258b-4b8e-8ed1-8f74aab297b6", "name": "network-vif-deleted", "tag": "7c954bb2-085a-45af-b355-fc3ef01e022c"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:36.275211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:36.276127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:36.276885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:36.293222 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] Creating event network-vif-deleted:7c954bb2-085a-45af-b355-fc3ef01e022c for instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 on n-h1-854121-3 Aug 24 02:32:36.298987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ec505ad4-0782-486c-a816-839a4073b788 req-19158612-3b2a-4704-9532-a265094101a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046720 Aug 24 02:32:36.299980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4988/5980] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:32:36.370316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:36.371193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:36.387298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:36.387813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:36.388412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:36.389203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:36.389687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:36.390134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:36.426498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:36.427358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:36.427967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:36.428616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lazy-loading 'fault' on Instance uuid f087ad44-258b-4b8e-8ed1-8f74aab297b6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:32:36.473159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0ee15124f9b4dbf86fd562bb1296bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe6d9009c2f4187a8bb41eed7e459c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:32:36.484611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7efd25d-f55e-44a4-a4d3-b7d4182a9d87 tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 200 len: 1309 microversion: 2.1 time: 0.120585 Aug 24 02:32:36.486726 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4989/5981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:36 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:32:37.507831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:37.508620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] [instance: f087ad44-258b-4b8e-8ed1-8f74aab297b6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:37.515877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:37.517306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:37.518109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:37.518909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:37.519457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:37.519986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:37.540824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] HTTP exception thrown: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Request method failure captured: Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 HTTP/1.1 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY0UdAr_tQzk-SuZF-6t5x5EZQXjrJhhHpv4Q5jHqS3VH_bo7fi6iFBXEqC4tgfdwWt8LQvVDIG37esruWeZeq8DTRzWcsJv9MGYO26ByMQFdoxrbauPGu6QSUU64-5qBKZ8iuZpSFYx9G45Vu4OULHEBxlp44Yu0Lrr6Ri2RS3eT64 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: afe6d9009c2f4187a8bb41eed7e459c1 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_afe6d9009c2f4187a8bb41eed7e459c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: afe6d9009c2f4187a8bb41eed7e459c1 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1541642217 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesSnapshotTestJSON-1541642217-project Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e0ee15124f9b4dbf86fd562bb1296bc5 Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesSnapshotTestJSON-1541642217-project Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f087ad44-258b-4b8e-8ed1-8f74aab297b6'} Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:37.542519 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] Returning 404 to user: Instance f087ad44-258b-4b8e-8ed1-8f74aab297b6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:37.546642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b96d6240-240a-42d3-86b6-57fc72eac84c tempest-VolumesSnapshotTestJSON-1541642217 tempest-VolumesSnapshotTestJSON-1541642217-project] 10.222.0.49 "GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6" status: 404 len: 111 microversion: 2.1 time: 0.040354 Aug 24 02:32:37.548852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4990/5982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:37 2022] GET /compute/v2.1/servers/f087ad44-258b-4b8e-8ed1-8f74aab297b6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:32:41.494955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:41.495769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:41.502913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:41.504082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:41.504793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:41.505767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:41.506744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:41.507419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:41.524230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 HTTP/1.1 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4de2bae-fadf-4764-a954-df2df9d1fbd6'} Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:41.526121 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.530071 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.532915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:41.534011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92c828c9-eea7-4505-90d6-5826b641cf41 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 404 len: 111 microversion: 2.1 time: 0.043142 Aug 24 02:32:41.535482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4991/5983] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:32:41 2022] DELETE /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:32:41.550784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:41.551725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: e4de2bae-fadf-4764-a954-df2df9d1fbd6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:41.563295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:41.564034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:41.564748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:41.565888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:41.566649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:41.567414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:41.586183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 HTTP/1.1 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4de2bae-fadf-4764-a954-df2df9d1fbd6'} Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:41.588300 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance e4de2bae-fadf-4764-a954-df2df9d1fbd6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6529f304-9caf-4ded-ba83-639887d2f51f tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6" status: 404 len: 111 microversion: 2.1 time: 0.047741 Aug 24 02:32:41.598876 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4992/5984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:41 2022] GET /compute/v2.1/servers/e4de2bae-fadf-4764-a954-df2df9d1fbd6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:32:44.947624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:44.948186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:44.955954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:44.956830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:44.957492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:44.958415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:44.959092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:44.959798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:44.974733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a HTTP/1.1 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ad3056a1-ae75-47b1-a234-3df81405a87a'} Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:44.976633 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:44.982123 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:44.984245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:44.985924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9a62838-5c72-46cf-9085-3964dde93efe tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 404 len: 111 microversion: 2.1 time: 0.042365 Aug 24 02:32:44.986984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4993/5985] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:32:44 2022] DELETE /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:32:44.994817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:44.995711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] [instance: ad3056a1-ae75-47b1-a234-3df81405a87a] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:32:45.008695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:45.009230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:45.009907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:45.010810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:32:45.011431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:32:45.012030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:32:45.026844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] HTTP exception thrown: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Request method failure captured: Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a HTTP/1.1 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBYwpkOaOe9Wp2_LrlQv30LIyYWQeOH4XghtL55HtrFOgSKOEDXY_Es0NKwU9ePMXBc4vA3zPCHzkKneV5kBnWyz7dMMULpNXinJ1Mic02-IiLKTPwWdBbykdDsJXYfBflZmFmkETsBTIAAC0rQQLUJXudbM8fIHvOnKJIlEa49XPCw4 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8091b155401c481e9b19412d742c9c4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8091b155401c481e9b19412d742c9c4a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8091b155401c481e9b19412d742c9c4a Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-AttachVolumeTestJSON-919775344 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 58c2285adcb64632b010b881ef8da1b7 Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-AttachVolumeTestJSON-919775344-project Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'ad3056a1-ae75-47b1-a234-3df81405a87a'} Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:45.028869 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:45.033220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] Returning 404 to user: Instance ad3056a1-ae75-47b1-a234-3df81405a87a could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:45.035561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89970751-e03b-487c-b9aa-a59662182145 tempest-AttachVolumeTestJSON-919775344 tempest-AttachVolumeTestJSON-919775344-project] 10.222.0.49 "GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a" status: 404 len: 111 microversion: 2.1 time: 0.042144 Aug 24 02:32:45.036244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4994/5986] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:32:44 2022] GET /compute/v2.1/servers/ad3056a1-ae75-47b1-a234-3df81405a87a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:32:51.191155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-38c7c4fc-6257-46df-aa0a-4e534fb33470 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Action: 'create', calling method: .version_select at 0x7f6b9146fb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-476464623", "metadata": {"Type": "work"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:32:51.570502 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-38c7c4fc-6257-46df-aa0a-4e534fb33470 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.517827 Aug 24 02:32:51.571092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4995/5987] 10.222.0.49 () {60 vars in 1156 bytes} [Wed Aug 24 02:32:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 24 02:32:51.585848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-811eb809-56eb-4027-b01a-72924dd971bd tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b91953310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:51.652829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-811eb809-56eb-4027-b01a-72924dd971bd tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 352 microversion: 2.1 time: 0.071341 Aug 24 02:32:51.653426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4996/5988] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:51 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:32:52.669350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6560777-8f49-4ff2-aa4e-b6c89c6d7ca7 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b9146f310>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:52.769313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6560777-8f49-4ff2-aa4e-b6c89c6d7ca7 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 353 microversion: 2.1 time: 0.105656 Aug 24 02:32:52.769899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4997/5989] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:52 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:32:52.785349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9458f0ef-d839-45da-ae9f-cc8120a8b42e tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b913c71f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:52.864796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9458f0ef-d839-45da-ae9f-cc8120a8b42e tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 353 microversion: 2.1 time: 0.085929 Aug 24 02:32:52.865377 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4998/5990] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:52 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:52.879633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0559d8f-dbb3-4d19-985d-b8c93ef8ada9 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b9045a700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:52.961946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0559d8f-dbb3-4d19-985d-b8c93ef8ada9 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 202 len: 0 microversion: 2.1 time: 0.086201 Aug 24 02:32:52.966651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 4999/5991] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 02:32:52 2022] DELETE /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:32:52.977917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af6b44a5-3de2-4ec9-8abf-159f5240b69d tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b917459d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:53.071998 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af6b44a5-3de2-4ec9-8abf-159f5240b69d tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 352 microversion: 2.1 time: 0.104109 Aug 24 02:32:53.072649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5000/5992] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:52 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:32:54.088243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd98f2a5-294e-4ed3-8ff9-a32c53140e27 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b917675e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:54.174925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd98f2a5-294e-4ed3-8ff9-a32c53140e27 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 352 microversion: 2.1 time: 0.092531 Aug 24 02:32:54.178788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5001/5993] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:54 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:32:55.195816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8442b234-69e6-480c-8543-544b4184127d tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b91564ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:55.205821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:55.207044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:32:55.265905 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8442b234-69e6-480c-8543-544b4184127d tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 200 len: 352 microversion: 2.1 time: 0.077691 Aug 24 02:32:55.266700 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5002/5994] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:55 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:32:56.281612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a617d49e-58bd-45c5-a807-b7550b34c235 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Calling method '.version_select at 0x7f6b914a6430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:32:56.318194 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a617d49e-58bd-45c5-a807-b7550b34c235 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] HTTP exception thrown: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a617d49e-58bd-45c5-a807-b7550b34c235 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Request method failure captured: Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce HTTP/1.1 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY3SoP8SugRyloCJQ-9amZM1MVPuJbfFoT161OHTejPtTKyoQmut0K5dwVLmRNgoHbzAFy4E0EN_wKEk7Bqacz5PujKtMgSfFKAzE5NY_kVOk9ZopfabIhPN07j0mxyBZxWq-YeE_zI_GbLfglYLef0Tm000o7mjKaGzzX5Gu2wNsLE Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 7e344f2f0dcc4063ab2a093789228667 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesGetTestJSON-1175429621 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7e344f2f0dcc4063ab2a093789228667"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7e344f2f0dcc4063ab2a093789228667"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7e344f2f0dcc4063ab2a093789228667"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7e344f2f0dcc4063ab2a093789228667"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesGetTestJSON-1175429621 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 7e344f2f0dcc4063ab2a093789228667 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesGetTestJSON-1175429621 Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesGetTestJSON-1175429621-project Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e2c46462262247ab97d6295b1b31ca4b Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesGetTestJSON-1175429621-project Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: method: Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: exception: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '3110c2b2-ed14-40a7-b8e9-698844e2ebce'} Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. (HTTP 404) (Request-ID: req-76860f4a-e50b-43a5-8f3b-5f502f4264ec) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 02:32:56.320651 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. Aug 24 02:32:56.325456 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:32:56.328324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a617d49e-58bd-45c5-a807-b7550b34c235 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] Returning 404 to user: Volume 3110c2b2-ed14-40a7-b8e9-698844e2ebce could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:32:56.332748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a617d49e-58bd-45c5-a807-b7550b34c235 tempest-VolumesGetTestJSON-1175429621 tempest-VolumesGetTestJSON-1175429621-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce" status: 404 len: 109 microversion: 2.1 time: 0.052273 Aug 24 02:32:56.332748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5003/5995] 10.222.0.49 () {58 vars in 1245 bytes} [Wed Aug 24 02:32:56 2022] GET /compute/v2.1/os-volumes/3110c2b2-ed14-40a7-b8e9-698844e2ebce => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:33:09.300857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2dda5a60-6685-425c-9b21-c1c92be1471a tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Action: 'create', calling method: .version_select at 0x7f6b912805e0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1740712631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXT2B36rsR0v+QFMH+sDH4+RfzqvPNnwK+Mpzb6YDcgEcqljn57RJylyJFZzRqDCCsHjfCs6DDFhYTvOAF/zbxC/+9HfJuYouoobn5QaVjcPpcdUfrmuKkMb65TebYN1Q=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:09.320134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2dda5a60-6685-425c-9b21-c1c92be1471a tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Getting quotas for project 520ac26212d246728a592004055e8e38. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:33:09.325959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2dda5a60-6685-425c-9b21-c1c92be1471a tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Getting quotas for user 0bca998358b94a4a8ed63b70e45baa42 and project 520ac26212d246728a592004055e8e38. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:33:09.358360 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2dda5a60-6685-425c-9b21-c1c92be1471a tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062463 Aug 24 02:33:09.366283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5004/5996] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:33:09 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:33:10.652646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-350052817", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0f29cfe6-b1b2-4b0c-9002-eae5e61b6580", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1740712631", "security_groups": [{"name": "tempest-secgroup-smoke-231861956"}], "networks": [{"uuid": "cdd64b12-db2a-42cc-bc8e-c41c3a9f9f0e"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:10.773321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] validate_networks() for [('cdd64b12-db2a-42cc-bc8e-c41c3a9f9f0e', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:33:11.136878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:33:11.137316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:33:11.137801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:33:11.138298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:33:11.138792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:33:11.148229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:11.148747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:11.149198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:11.149934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:11.150397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:11.150832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:11.167342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Getting quotas for project 520ac26212d246728a592004055e8e38. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:33:11.172635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Getting quotas for user 0bca998358b94a4a8ed63b70e45baa42 and project 520ac26212d246728a592004055e8e38. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:33:11.237714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:33:11.240103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f29cfe6-b1b2-4b0c-9002-eae5e61b6580',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:33:11.381391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50cf029b-331f-41ca-a2a9-b59703f36ac4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733967 Aug 24 02:33:11.382265 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5005/5997] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:33:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:33:11.392815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b85ca0c9-bd40-456d-a34e-74f133a9ef8d tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:11.393449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b85ca0c9-bd40-456d-a34e-74f133a9ef8d tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:11.452203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b85ca0c9-bd40-456d-a34e-74f133a9ef8d tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:11.460972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b85ca0c9-bd40-456d-a34e-74f133a9ef8d tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1098 microversion: 2.1 time: 0.070837 Aug 24 02:33:11.461797 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5006/5998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:11 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:12.484001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:12.485830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:12.496647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:12.497836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:12.499037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:12.500955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:12.501744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:12.502724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:12.580381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:12.594065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3a0d66c7-0a88-490a-ae2f-9940ab5c1568 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1204 microversion: 2.1 time: 0.116200 Aug 24 02:33:12.595541 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5007/5999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:12 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1204 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:13.615845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:13.617159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:13.629079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:13.629825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:13.630434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:13.631337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:13.634285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:13.635076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:13.993810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:14.016772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8eb5a6ea-e66c-406e-a187-a029c0170ca9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1281 microversion: 2.1 time: 0.403226 Aug 24 02:33:14.019184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5008/6000] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:13 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1281 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:15.024423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:15.094575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:15.095399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:15.096073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:15.126077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] Creating event network-changed:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:33:15.144316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b6498888-0355-4f63-9168-687802319c46 req-72a679b3-4d67-4f4f-8746-60ff4c40597e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133663 Aug 24 02:33:15.145649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5009/6001] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:33:15.159361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:15.160406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:15.174116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:15.174685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:15.175084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:15.175839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:15.176318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:15.176779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:15.450345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:15.460609 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2fdbb344-1dd6-4b39-b7de-d969a37e9b27 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1281 microversion: 2.1 time: 0.312340 Aug 24 02:33:15.461265 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5010/6002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:15 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:16.486361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:16.487012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:16.493646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:16.494275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:16.494732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:16.495446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:16.495918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:16.496358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:16.638501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:16.647794 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71e4508e-0b06-490a-ab80-b899917d1980 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1281 microversion: 2.1 time: 0.166794 Aug 24 02:33:16.649054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5011/6003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:16 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:17.673780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:17.675240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:17.683970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:17.684782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:17.685612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:17.686807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:17.688429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:17.689219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:17.919139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:17.928559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6606c40c-c8e1-4bca-9f68-d2bd7b3829b5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1281 microversion: 2.1 time: 0.262757 Aug 24 02:33:17.942204 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5012/6004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:17 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1281 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:18.952145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:18.954141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:18.962357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:18.967091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:18.967091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:18.970374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:18.971025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:18.972632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:19.131501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:19.141352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-482e33f3-afae-4997-9f3d-ac35c76eca24 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.193227 Aug 24 02:33:19.141947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5013/6005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:18 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:20.165058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:20.166296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:20.174717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:20.175226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:20.175688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:20.176414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:20.176919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:20.177364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:20.375513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:20.384601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8da381f-5767-4cd8-91a3-5950756c9c46 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.225369 Aug 24 02:33:20.385771 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5014/6006] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:20 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:21.405601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:21.407528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:21.411033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:21.416408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:21.417341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:21.417851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:21.418666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:21.419151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:21.419592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:21.456898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:21.565075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:21.583745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83f91b3a-b2e0-4758-9b3f-0f174f38f906 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.182773 Aug 24 02:33:21.596905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5015/6007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:21 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:22.618832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:22.620324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:22.641036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:22.641934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:22.642616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:22.645154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:22.646034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:22.647008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:22.830007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:22.840137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52a98723-b4e1-4343-873f-6c979e6fe64e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.237349 Aug 24 02:33:22.843124 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5016/6008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:22 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:23.862680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:23.863326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:23.869464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:23.869962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:23.870419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:23.871129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:23.871774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:23.872217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:24.030136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:24.039190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e0e98f5-d2c3-494d-b833-17587e097e5e tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.182202 Aug 24 02:33:24.039921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5017/6009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:23 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:25.060547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:25.061260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:25.070400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:25.071143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:25.071822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:25.072815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:25.073455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:25.074126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:25.220695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:25.248950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f183a565-d780-470e-b7eb-4affc0d9bcc2 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.192385 Aug 24 02:33:25.249552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5018/6010] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:25 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:26.269207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:26.269887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:26.277693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:26.278307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:26.278894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:26.279844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:26.280412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:26.280951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:26.429314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:26.438717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-250944f6-4b3a-403b-89be-06060d9b1b14 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.173705 Aug 24 02:33:26.439411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5019/6011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:26 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:27.459078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:27.460400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:27.469488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:27.470169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:27.470715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:27.471808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:27.472436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:27.472981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:27.617970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:27.626148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2f41569-f494-43b7-bfb9-c8875ed71e1c tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.171587 Aug 24 02:33:27.626738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5020/6012] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:27 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:28.648381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:28.649991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:28.657511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:28.658025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:28.658483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:28.668288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:28.668870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:28.669309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:28.901114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:28.910528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85b3d00d-61f1-4fd9-9970-cbd945cf1776 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.266661 Aug 24 02:33:28.911113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5021/6013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:28 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:29.932059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:29.932682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:29.942429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:29.945426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:29.946310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:29.948229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:29.948638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:29.949370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:30.176918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:30.185882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4bf81c56-0606-4a40-98fb-0e1f1e738626 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.257542 Aug 24 02:33:30.186827 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5022/6014] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:29 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:30.381269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "name": "network-vif-plugged", "status": "completed", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:30.392442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:30.393256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:30.393880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:30.405882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] Creating event network-vif-plugged:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:33:30.414339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-508de4b2-54b2-417a-b702-7c5492e881c7 req-ee94aea0-3d2d-4ae6-8bf0-5911fdb05686 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226198 Aug 24 02:33:30.416495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5023/6015] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:33:31.214136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:31.214725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:31.222060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:31.222571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:31.223022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:31.223741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:31.224204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:31.224645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:31.255435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:31.380150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:31.388281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-063d8b5b-4727-43fd-a195-b37bc61cfde9 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1269 microversion: 2.1 time: 0.184913 Aug 24 02:33:31.388887 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5024/6016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:31 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:32.409446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:32.411039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:32.424600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:32.425416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:32.426087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:32.427030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:32.428033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:32.429154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:32.588978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:32.604091 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c690cb7e-b18c-4ce6-80f5-b8ed39c2e4f4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1458 microversion: 2.1 time: 0.198781 Aug 24 02:33:32.605595 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5025/6017] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:32 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1458 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:32.633433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:32.634757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:32.641924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:32.642534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:32.643517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:32.644357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:32.645256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:32.646249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:32.814525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:32.824857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a948d2d-1450-4310-ac41-962d2782cccc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1458 microversion: 2.1 time: 0.197352 Aug 24 02:33:32.825505 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5026/6018] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:32 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1458 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:35.355341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ca3d2c0-36bc-421a-8e87-d48b2a7c158b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Action: 'create', calling method: .version_select at 0x7f6b91f52b80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-874140376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy3xpk7sJnR7wvFGTUB6bOOOiuyUPYuJYi6zTjsZ9vzMrXrj2qOW9mcTQPJxoOFc8eBwNmWHLV2005kVqSJaSRlkgnB20Oa31vJ3AIQxAetTr+gphSWQPGu3LPrHUNHrQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:35.372169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6ca3d2c0-36bc-421a-8e87-d48b2a7c158b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for project d1357a213a2a488c9242a7860fa9c826. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:33:35.377797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6ca3d2c0-36bc-421a-8e87-d48b2a7c158b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for user 0243d74c122e4598a0ceceb5e8f10617 and project d1357a213a2a488c9242a7860fa9c826. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:33:35.407880 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ca3d2c0-36bc-421a-8e87-d48b2a7c158b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.272970 Aug 24 02:33:35.414695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5027/6019] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:33:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:33:36.319972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:36.341320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:36.342113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:36.342740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:36.367557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] Creating event network-changed:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:33:36.377357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fd2972f7-30df-4cc8-8baa-1c4c1e483adc req-fc9fcc3b-3c5f-4793-9441-d6588bdd55bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161272 Aug 24 02:33:36.378008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5028/6020] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:33:38.833747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:38.848028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:38.849193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:38.849869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:38.865357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] Creating event network-changed:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:33:38.870758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-51f77384-a752-4a22-823f-04f43568a94e req-b8bfad41-da62-4134-9716-ddc3e972e925 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041665 Aug 24 02:33:38.871581 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5029/6021] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:33:40.912616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:40.919235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:40.927591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:40.943017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:40.943889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:40.967258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] Creating event network-changed:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:33:40.973585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cd021101-c77c-4000-81cd-7c2ee4de93d5 req-4f777101-70c5-4fe8-aa2e-7bb0f550891a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064826 Aug 24 02:33:40.974267 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5030/6022] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:33:45.306926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-679511122-access_point-1971587307", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "a6d41e58-9ca4-4703-b03b-a74ce74d34fc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-874140376", "security_groups": [{"name": "tempest-secgroup_access--1045265412"}, {"name": "tempest-secgroup_general--59358394"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:45.387516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:45.534052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] validate_networks() for [('a6d41e58-9ca4-4703-b03b-a74ce74d34fc', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:33:46.053202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:33:46.054019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:33:46.054783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:33:46.055476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:33:46.055977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:33:46.065630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:46.066428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:46.067049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:46.067959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:46.068593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:46.069345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:46.092622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for project d1357a213a2a488c9242a7860fa9c826. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:33:46.100546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for user 0243d74c122e4598a0ceceb5e8f10617 and project d1357a213a2a488c9242a7860fa9c826. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:33:46.116665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:33:46.119182 n-d-854121-3 devstack@n-api.service[128567]: WARNING nova.utils [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-679511122-access_point-1971587307 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-679511122-acc Aug 24 02:33:46.120478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:33:46.180229 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9d75078-a022-4b64-9634-47159eedb948 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.881864 Aug 24 02:33:46.181771 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5031/6023] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:33:45 2022] POST /compute/v2.1/servers => generated 456 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:33:46.196456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a012f6d-316c-4a2d-8a81-d8947984fd98 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:46.197776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a012f6d-316c-4a2d-8a81-d8947984fd98 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:46.301718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a012f6d-316c-4a2d-8a81-d8947984fd98 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:46.310642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a012f6d-316c-4a2d-8a81-d8947984fd98 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1293 microversion: 2.1 time: 0.121256 Aug 24 02:33:46.313151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5032/6024] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:46 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:47.336113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:47.338073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:47.347273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:47.347713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:47.348178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:47.349052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:47.349528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:47.349974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:47.423474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:47.436035 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-047aed13-5b0a-4b13-bd90-92773cb9a5fc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1345 microversion: 2.1 time: 0.104330 Aug 24 02:33:47.437272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5033/6025] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:47 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:48.462525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:48.464067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:48.475837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:48.476456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:48.477173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:48.478129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:48.478820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:48.479492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:48.603982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:48.615103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68edec0e-6151-4fbe-8fa5-cd17248b2ff6 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1351 microversion: 2.1 time: 0.156531 Aug 24 02:33:48.615750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5034/6026] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:48 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:49.521684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c213dff2-7eb7-428c-ada4-ce76467eafdd", "tag": "014d5def-013b-40a8-a23f-f5e58993c822"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:49.546573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:49.548256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:49.549040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:49.566565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] Creating event network-changed:014d5def-013b-40a8-a23f-f5e58993c822 for instance c213dff2-7eb7-428c-ada4-ce76467eafdd on n-h1-854121-3 Aug 24 02:33:49.576173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8c7177c9-3c9c-4a18-bdfb-7afd27257d99 req-59208a39-48e9-4aa1-8c24-272d3d44a4b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071691 Aug 24 02:33:49.579375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5035/6027] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:33:49.639614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:49.640342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:49.652365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:49.654048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:49.654943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:49.656119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:49.657392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:49.658093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:50.314789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:50.322713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bd50793-cf60-4599-9231-515df68cec12 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.688891 Aug 24 02:33:50.323303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5036/6028] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:49 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:51.344402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:51.345123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:51.352314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:51.352859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:51.353405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:51.354124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:51.354788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:51.355262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:51.603848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:51.611964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68d7a787-640b-4a49-82a5-4f355027bdec tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.272066 Aug 24 02:33:51.612644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5037/6029] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:51 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:52.633269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:52.634895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:52.643122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:52.643635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:52.644141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:52.645321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:52.645965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:52.646586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:53.032113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:53.056344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67b10a47-022f-43f8-b4b5-c01245fc4dfb tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.427349 Aug 24 02:33:53.058075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5038/6030] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:52 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:54.082330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:54.083017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:54.091620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:54.092794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:54.093447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:54.094228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:54.094707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:54.095755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:54.293234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:54.304079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3cfa84d2-f902-4545-b207-e4dfd3831f1b tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.226920 Aug 24 02:33:54.304992 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5039/6031] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:54 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:55.325989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:55.327401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:55.335552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:55.336272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:55.336944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:55.337666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:55.338311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:55.338762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:55.487320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:55.496499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-94bfc298-8cc6-4fe9-a491-bc3d85bd1d9c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.174456 Aug 24 02:33:55.497138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5040/6032] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:55 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:56.070712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c213dff2-7eb7-428c-ada4-ce76467eafdd", "name": "network-vif-plugged", "status": "completed", "tag": "014d5def-013b-40a8-a23f-f5e58993c822"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:33:56.081548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:56.084089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:56.084863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:56.085567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:56.100433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] Creating event network-vif-plugged:014d5def-013b-40a8-a23f-f5e58993c822 for instance c213dff2-7eb7-428c-ada4-ce76467eafdd on n-h1-854121-3 Aug 24 02:33:56.105759 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3745ff9f-25e8-41c4-95f8-35a886e1597f req-659b0853-5229-4eaf-a1c5-9b31b94ab99b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039449 Aug 24 02:33:56.106404 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5041/6033] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:33:56.516614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:33:56.522482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:56.523194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:56.530392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:56.531885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:56.532626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:56.533658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:56.534355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:56.535057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:56.756867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:56.771322 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b645920-01ac-436a-acc8-dc5680bfb4ab tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1469 microversion: 2.1 time: 0.255867 Aug 24 02:33:56.772825 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5042/6034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:56 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:57.793919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:57.794588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:57.803351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:57.803880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:57.804406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:57.805175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:57.805844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:57.806296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:58.049270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:58.062310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52633fd9-ff8e-4962-891d-917220547008 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1641 microversion: 2.1 time: 0.272517 Aug 24 02:33:58.063291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5043/6035] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:57 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1641 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:33:58.083405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:58.084397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:58.090968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:58.091781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:58.092301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:58.093281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:58.094548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:58.095197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:58.267794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:33:58.278902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd54cd1b-7940-4dda-b273-abb43e3194cc tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1641 microversion: 2.1 time: 0.199425 Aug 24 02:33:58.293310 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5044/6036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:58 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1641 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:33:58.299770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:33:58.300784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:33:58.308619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:58.309247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:58.309789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:58.310734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:33:58.311216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:33:58.311666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:33:58.565956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-889b4db6-1119-4b5f-a3d2-ee0215b19d35 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1792 microversion: 2.1 time: 0.269657 Aug 24 02:33:58.566555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5045/6037] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:33:58 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1792 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:00.701678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c213dff2-7eb7-428c-ada4-ce76467eafdd", "tag": "014d5def-013b-40a8-a23f-f5e58993c822"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:00.720635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:00.721172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:00.721622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:00.749302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] Creating event network-changed:014d5def-013b-40a8-a23f-f5e58993c822 for instance c213dff2-7eb7-428c-ada4-ce76467eafdd on n-h1-854121-3 Aug 24 02:34:00.766659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-745880db-d01c-4620-9b87-a289f8c7833a req-43c4fb7e-6184-4f5b-a944-4387dc9fad3a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068609 Aug 24 02:34:00.768283 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5046/6038] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:34:11.153259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:11.154992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:11.163022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:11.166218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:11.184604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:11.185899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:11.186623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:11.188515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:11.190797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:11.192877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:11.253719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:34:11.361450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed6a5b7d-e6a9-4234-9ed7-babe1be55cc5 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "DELETE /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 204 len: 0 microversion: 2.1 time: 0.214728 Aug 24 02:34:11.365795 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5047/6039] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:34:11 2022] DELETE /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:34:11.373238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:11.385429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:11.386199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:11.387075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:11.401881 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] Creating event network-changed:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:34:11.408357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5edfdc40-b6dd-4448-a030-04dac4d999f9 req-e898021f-84ec-494b-88e3-ab1624f23c00 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040737 Aug 24 02:34:11.410020 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5048/6040] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:34:11.418186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:11.419125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:11.426514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:11.427392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:11.428206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:11.429208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:11.430199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:11.430800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:11.630421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:11.640106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb8fc8d6-c52b-418c-b9e5-0b5c68a54453 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1583 microversion: 2.1 time: 0.228583 Aug 24 02:34:11.643305 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5049/6041] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:11 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1583 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:34:12.668641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:12.669880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:12.686256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:12.686872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:12.687632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:12.688618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:12.689575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:12.690369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:12.848021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:12.856843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1a29a5d-5b4b-4543-840f-4230c4f331aa tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1583 microversion: 2.1 time: 0.193075 Aug 24 02:34:12.857854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5050/6042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:12 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1583 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:13.878350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:13.879648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:13.886267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:13.886766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:13.887300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:13.887913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:13.888372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:13.889008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:14.140252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:14.151805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a061ce8-1fa3-4085-8a61-011bfcab4d5f tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1583 microversion: 2.1 time: 0.277197 Aug 24 02:34:14.153083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5051/6043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:13 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1583 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:14.303803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17db2c2e-7dcb-468c-a896-af39942a2859", "name": "network-vif-deleted", "tag": "8b573502-cba5-423c-b9f2-5d5eff6b187d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:14.314844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:14.315346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:14.315832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:14.327909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] Creating event network-vif-deleted:8b573502-cba5-423c-b9f2-5d5eff6b187d for instance 17db2c2e-7dcb-468c-a896-af39942a2859 on n-h2-854121-3 Aug 24 02:34:14.334402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-bd6a5005-cf39-4f65-8be2-bde698b19a28 req-0c25ad36-2af4-4c15-a246-374b7b593782 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Aug 24 02:34:14.335255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5052/6044] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:34:15.175546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:15.176515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:15.184546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:15.185369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:15.186028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:15.186992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:15.187469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:15.188864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:15.300567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:15.310238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3468b41-39ac-4f4b-85b9-ce11d85935bc tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1229 microversion: 2.1 time: 0.140179 Aug 24 02:34:15.311154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5053/6045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:15 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1229 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:16.333837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:16.334462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:16.352452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:16.353009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:16.353476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:16.354687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:16.355205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:16.355668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:16.474833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:16.482936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-551dfe19-d7c6-4b2f-84a9-d7225ab96241 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1229 microversion: 2.1 time: 0.154103 Aug 24 02:34:16.497220 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5054/6046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:16 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:34:17.506262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:17.506895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:17.514405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:17.515054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:17.515653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:17.516494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:17.517059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:17.517587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:17.595865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:17.604247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e4d6cdb-1894-4843-87da-ff57db733108 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1229 microversion: 2.1 time: 0.102127 Aug 24 02:34:17.612410 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5055/6047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:17 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:18.626711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:18.627367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:18.634649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:18.635187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:18.635646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:18.636402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:18.637294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:18.637426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:18.716500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bca998358b94a4a8ed63b70e45baa42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520ac26212d246728a592004055e8e38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:18.725624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc949da2-d3e6-487e-91d9-e9324d658951 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 200 len: 1229 microversion: 2.1 time: 0.103659 Aug 24 02:34:18.726228 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5056/6048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:18 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:19.746216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:19.746851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] [instance: 17db2c2e-7dcb-468c-a896-af39942a2859] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:19.754452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:19.754950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:19.755409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:19.756124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:19.756593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:19.757148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:19.773455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] HTTP exception thrown: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Request method failure captured: Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 HTTP/1.1 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY1lHUO8FaDldrJGMOoq0J6ZV9mJhl5QwbOep3eDbIZxAa3enXFJKBWFXPhnM0cLa9J8DdpAqKPoEOoBTKWQm65HdFixnbLJsFOfiSHVQtszCIiMJqQ1wBYyQIcUbTqRD2uqxewolAwCr_XyNHX_97wEGFhDg6vKrsqzAh64RaAfzLw Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 520ac26212d246728a592004055e8e38 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestVolumeBackupRestore-1225455916 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/520ac26212d246728a592004055e8e38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/520ac26212d246728a592004055e8e38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/520ac26212d246728a592004055e8e38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_520ac26212d246728a592004055e8e38"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestVolumeBackupRestore-1225455916 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 520ac26212d246728a592004055e8e38 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1225455916 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestVolumeBackupRestore-1225455916-project Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0bca998358b94a4a8ed63b70e45baa42 Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestVolumeBackupRestore-1225455916-project Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '17db2c2e-7dcb-468c-a896-af39942a2859'} Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:34:19.775228 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Returning 404 to user: Instance 17db2c2e-7dcb-468c-a896-af39942a2859 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6c858e4-380e-42f3-b135-c169c37b85a7 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859" status: 404 len: 111 microversion: 2.1 time: 0.034398 Aug 24 02:34:19.783707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5057/6049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:19 2022] GET /compute/v2.1/servers/17db2c2e-7dcb-468c-a896-af39942a2859 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:34:19.946149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1747b8c-7a6e-4d33-a9e8-dcdd70db9ca4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] Calling method '.version_select at 0x7f6b91953f70>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:19.977461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1747b8c-7a6e-4d33-a9e8-dcdd70db9ca4 tempest-TestVolumeBackupRestore-1225455916 tempest-TestVolumeBackupRestore-1225455916-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1740712631" status: 202 len: 0 microversion: 2.1 time: 0.035195 Aug 24 02:34:19.978077 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5058/6050] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 02:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1740712631 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:34:34.052500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:34.053311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:34.189051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1144567405", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "208f0ffe-6b42-44ff-a75c-9719952533f2"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:34.257235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] validate_networks() for [('208f0ffe-6b42-44ff-a75c-9719952533f2', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:34:34.602614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:34:34.603080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:34:34.603567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:34:34.603989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:34:34.604413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:34:34.615633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:34.616469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:34.617242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:34.617993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:34.618471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:34.618916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:34.636101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Getting quotas for project 92fb31a5e4bf464d9e092c8430ebb3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:34:34.641399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Getting quotas for user e71cbb30e2c34a4181b6aaabcd2c38f9 and project 92fb31a5e4bf464d9e092c8430ebb3ae. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:34:34.653598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:34:34.655850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:34:34.700399 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0fa6b062-d275-4f7d-b22b-70622eb0e513 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649847 Aug 24 02:34:34.701078 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5059/6051] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:34:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:34:34.711864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd8b1f4c-aeca-442f-b012-dea9c07e27df tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:34.712480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd8b1f4c-aeca-442f-b012-dea9c07e27df tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:34.766262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd8b1f4c-aeca-442f-b012-dea9c07e27df tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:34.773442 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd8b1f4c-aeca-442f-b012-dea9c07e27df tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1214 microversion: 2.1 time: 0.065420 Aug 24 02:34:34.774214 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5060/6052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:34 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:35.794034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:35.794669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:35.801580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:35.802106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:35.802562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:35.803269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:35.803739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:35.804185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:35.868157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:35.876045 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8dffc78-f86c-4273-9ccf-23fd7a451588 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1210 microversion: 2.1 time: 0.085913 Aug 24 02:34:35.876622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5061/6053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:35 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:36.898118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:36.898772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:36.905471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:36.905971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:36.906422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:36.907160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:36.907611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:36.908048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:36.974326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:36.982245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e692ebf5-6ed8-4c5c-8fe4-5ede88ed3ddd tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1272 microversion: 2.1 time: 0.088605 Aug 24 02:34:36.982837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5062/6054] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:36 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:37.654438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b727df-68af-416e-99c6-7372a4b986b2", "tag": "03913813-9d0d-474a-9dc9-5f37ef4c77c1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:37.664607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:37.665129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:37.665578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:37.677255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] Creating event network-changed:03913813-9d0d-474a-9dc9-5f37ef4c77c1 for instance 45b727df-68af-416e-99c6-7372a4b986b2 on n-h2-854121-3 Aug 24 02:34:37.682030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-380da190-eadb-4efe-9eb2-9542afcae227 req-cba73834-1c05-4699-ac37-880e9b103e26 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032010 Aug 24 02:34:37.682939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5063/6055] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:34:38.004267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:38.005098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:38.011494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:38.011998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:38.012446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:38.013188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:38.013654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:38.014090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:38.206205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:38.215781 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27913b59-5367-4eb2-bee2-b082a0c6f57d tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.216456 Aug 24 02:34:38.217057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5064/6056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:37 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:34:39.238625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:39.239262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:39.246457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:39.246898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:39.247344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:39.248046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:39.248511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:39.248976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:39.377806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:39.385649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b289ccc-62a1-422c-97cf-0b4415729126 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.151532 Aug 24 02:34:39.386232 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5065/6057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:39 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:40.406741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:40.407369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:40.414966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:40.415471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:40.415933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:40.416649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:40.417853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:40.418306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:40.545866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:40.553515 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc6c2634-4b00-4727-8a00-9e8043c1f80a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.150826 Aug 24 02:34:40.554088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5066/6058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:40 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:41.574348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:41.575025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:41.583060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:41.583564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:41.584265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:41.585012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:41.585506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:41.585947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:41.717191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:41.725432 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e14df9c6-b80d-4723-918f-c0dbbc7d1e29 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.155070 Aug 24 02:34:41.726018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5067/6059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:41 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:42.747300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:42.747953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:42.754807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:42.755302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:42.755754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:42.757127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:42.757596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:42.758032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:42.885069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:42.892692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f361b20-cf5e-40f8-a7df-18ce66052d8f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.149344 Aug 24 02:34:42.893282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5068/6060] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:42 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:43.913990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:43.914663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:43.921158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:43.921660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:43.922115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:43.922824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:43.923294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:43.923737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:44.055830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:44.063527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5ecdac1-bdac-4796-847b-28789abab0ad tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.153604 Aug 24 02:34:44.064102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5069/6061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:43 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:44.485372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b727df-68af-416e-99c6-7372a4b986b2", "name": "network-vif-plugged", "status": "completed", "tag": "03913813-9d0d-474a-9dc9-5f37ef4c77c1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:44.497215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:44.497726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:44.498176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:44.509604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] Creating event network-vif-plugged:03913813-9d0d-474a-9dc9-5f37ef4c77c1 for instance 45b727df-68af-416e-99c6-7372a4b986b2 on n-h2-854121-3 Aug 24 02:34:44.514651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-32acb443-67b5-4ae6-a6a9-94027beb034a req-74412c40-9962-414f-a660-d0d9a6de5668 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Aug 24 02:34:44.515256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5070/6062] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:34:45.086684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:45.087516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:45.089782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:45.090623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:45.098188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:45.098694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:45.099154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:45.100460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:45.100957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:45.101404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:45.230101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:45.238115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2381c34b-431a-4ea6-8364-84cae4e5b473 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1314 microversion: 2.1 time: 0.156898 Aug 24 02:34:45.238635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5071/6063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:45 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:46.258925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:46.259552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:46.266734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:46.267234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:46.267685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:46.268387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:46.268895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:46.269335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:46.396629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:46.405010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82c8cfaa-3715-4212-808c-cdd3d200d63f tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1498 microversion: 2.1 time: 0.150104 Aug 24 02:34:46.405596 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5072/6064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:46 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:48.582693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:48.583260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:48.590862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:48.591367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:48.591821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:48.592532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:48.593035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:48.593484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:48.618654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:34:48.691734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0a93c43-4dc4-4acb-9547-7f6a6cd38685 tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "DELETE /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 204 len: 0 microversion: 2.1 time: 0.112567 Aug 24 02:34:48.692474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5073/6065] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:34:48 2022] DELETE /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:34:48.701194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:48.701912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:48.707777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:48.708293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:48.708795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:48.710880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:48.711360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:48.711807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:48.842347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:48.850698 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7829c170-69b4-451a-9be8-0aa4ed3e22eb tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1504 microversion: 2.1 time: 0.153028 Aug 24 02:34:48.851273 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5074/6066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:48 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:49.872277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:49.872978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:49.879693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:49.880189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:49.880639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:49.881394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:49.881890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:49.882327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:50.010064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:50.017818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61e88343-9437-4171-875a-60587591e1ac tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1504 microversion: 2.1 time: 0.149502 Aug 24 02:34:50.018391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5075/6067] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:49 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:50.833538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b727df-68af-416e-99c6-7372a4b986b2", "name": "network-vif-deleted", "tag": "03913813-9d0d-474a-9dc9-5f37ef4c77c1"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:34:50.845179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:50.845678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:50.846128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:50.857539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] Creating event network-vif-deleted:03913813-9d0d-474a-9dc9-5f37ef4c77c1 for instance 45b727df-68af-416e-99c6-7372a4b986b2 on n-h2-854121-3 Aug 24 02:34:50.862771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a8e55056-d890-4374-9f47-9eba73a36fd5 req-bbfac031-30a4-4d87-bd93-bb62020bdca9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Aug 24 02:34:50.863412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5076/6068] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:34:51.040170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:51.041002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:51.047970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:51.048568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:51.049113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:51.050102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:51.050642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:51.051154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:51.070612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:34:51.085181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:51.085680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:51.086133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:51.086595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lazy-loading 'fault' on Instance uuid 45b727df-68af-416e-99c6-7372a4b986b2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:34:51.130982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e71cbb30e2c34a4181b6aaabcd2c38f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92fb31a5e4bf464d9e092c8430ebb3ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:34:51.139311 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbc16c7c-cd83-4961-9408-ae4b59c1f91a tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 200 len: 1304 microversion: 2.1 time: 0.104338 Aug 24 02:34:51.139885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5077/6069] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:51 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:34:52.160578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:34:52.161245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] [instance: 45b727df-68af-416e-99c6-7372a4b986b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:34:52.168080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:52.168583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:52.169073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:52.169788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:34:52.170264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:34:52.170711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:34:52.184005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] HTTP exception thrown: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Request method failure captured: Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 HTTP/1.1 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY44edDdGxiUyaGUimpV-p_einx1hZnpI-uEEMeecze1jQ499yrMsakIdN0jU0SPh1KhgKJHSoyGmjsLTttVLVO_VjZtG9JzQfZ1QP_lfaZiHLxHHNEH0JK46lMzQoD10708v37MHvQjEthCNrx-NGzukFWgnlEbhCpeXdgMchq_cnE Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 92fb31a5e4bf464d9e092c8430ebb3ae Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-VolumesActionsTest-1372255694 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/92fb31a5e4bf464d9e092c8430ebb3ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fb31a5e4bf464d9e092c8430ebb3ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/92fb31a5e4bf464d9e092c8430ebb3ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_92fb31a5e4bf464d9e092c8430ebb3ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-VolumesActionsTest-1372255694 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 92fb31a5e4bf464d9e092c8430ebb3ae Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-VolumesActionsTest-1372255694 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-VolumesActionsTest-1372255694-project Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e71cbb30e2c34a4181b6aaabcd2c38f9 Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-VolumesActionsTest-1372255694-project Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '45b727df-68af-416e-99c6-7372a4b986b2'} Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:34:52.185803 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] Returning 404 to user: Instance 45b727df-68af-416e-99c6-7372a4b986b2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4391dff-f474-4ec6-9e55-90c9caae335b tempest-VolumesActionsTest-1372255694 tempest-VolumesActionsTest-1372255694-project] 10.222.0.49 "GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2" status: 404 len: 111 microversion: 2.1 time: 0.030633 Aug 24 02:34:52.196693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5078/6070] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:34:52 2022] GET /compute/v2.1/servers/45b727df-68af-416e-99c6-7372a4b986b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:35:12.487194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-135377913", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "37ddef91-f521-4776-96cd-6340c09b9f22"}], "key_name": "tempest-TestSecurityGroupsBasicOps-874140376", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c213dff2-7eb7-428c-ada4-ce76467eafdd"]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:12.503758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:35:12.505181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:35:12.562070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] validate_networks() for [('37ddef91-f521-4776-96cd-6340c09b9f22', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:35:13.040075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:35:13.040798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:35:13.041523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:35:13.042266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:35:13.043696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:35:13.055798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:13.056649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:13.057378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:13.058344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:13.059097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:13.059790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:13.078493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for project d1357a213a2a488c9242a7860fa9c826. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:35:13.084309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Getting quotas for user 0243d74c122e4598a0ceceb5e8f10617 and project d1357a213a2a488c9242a7860fa9c826. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:35:13.099484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:35:13.101988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:35:13.150213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e720e26f-8f7a-46ad-95cb-6f98024966fd tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.669238 Aug 24 02:35:13.151371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5079/6071] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:35:12 2022] POST /compute/v2.1/servers => generated 361 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:35:13.182590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-713fc249-61eb-4ea5-83b1-311f3eaa3d2d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:13.183715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-713fc249-61eb-4ea5-83b1-311f3eaa3d2d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:13.283887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-713fc249-61eb-4ea5-83b1-311f3eaa3d2d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:13.293577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-713fc249-61eb-4ea5-83b1-311f3eaa3d2d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1240 microversion: 2.1 time: 0.125829 Aug 24 02:35:13.294234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5080/6072] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:13 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:35:14.315374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:14.319556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:14.326606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:14.327212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:14.327900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:14.328711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:14.329517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:14.330072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:14.400220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:14.408477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a493a9d1-0539-4e91-a825-b0130e992123 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1292 microversion: 2.1 time: 0.097058 Aug 24 02:35:14.421058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5081/6073] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:14 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1292 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:15.431411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:15.432031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:15.443154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:15.443661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:15.444182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:15.447201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:15.459344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:15.460351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:15.630288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:15.642628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9dccb22-cdff-425e-ba80-2eca6560d81f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.215965 Aug 24 02:35:15.644875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5082/6074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:15 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:16.203122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0c2ad8-3793-4c79-8418-94a93b5d59b2", "tag": "e39ca545-706e-4373-b69c-eefe75e83474"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:16.215472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:16.216125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:16.216649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:16.233606 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] Creating event network-changed:e39ca545-706e-4373-b69c-eefe75e83474 for instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 on n-h2-854121-3 Aug 24 02:35:16.238774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-be61aad5-24b9-41b2-b843-0da01027b997 req-e013cc1c-4284-4022-930c-7bc34afab091 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039585 Aug 24 02:35:16.239386 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5083/6075] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:35:16.667476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:16.668267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:16.674774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:16.675372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:16.676544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:16.677359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:16.677999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:16.678563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:16.782980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:16.790863 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b841baa-1a65-48f5-a3b0-52afb7fdfbd7 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.129143 Aug 24 02:35:16.791446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5084/6076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:16 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:17.811445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:17.812103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:17.818876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:17.819325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:17.819782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:17.820494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:17.820992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:17.821436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:17.905063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:17.913317 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14b38e90-ae3f-4eb4-bbf1-db81e547923c tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.105247 Aug 24 02:35:17.913891 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5085/6077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:17 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:18.934853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:18.936411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:18.948541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:18.949351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:18.949893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:18.950697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:18.951249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:18.951763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:19.054467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:19.062737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b3fb9e1-d1f7-4f0e-bb1f-e0eee4743aa1 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.132327 Aug 24 02:35:19.063427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5086/6078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:18 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:20.083602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:20.084331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:20.092744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:20.093538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:20.093997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:20.094752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:20.095222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:20.095667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:20.184093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:20.192706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45367a37-ffae-4bb8-bb9a-c1a8a059b376 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.113055 Aug 24 02:35:20.206313 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5087/6079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:20 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:21.215138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:21.216499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:21.225083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:21.225616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:21.226071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:21.227004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:21.227485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:21.227929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:21.310194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:21.318153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cce49fe1-d046-4646-87da-7556652d8074 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.107038 Aug 24 02:35:21.318730 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5088/6080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:21 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:22.340438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:22.341096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:22.348613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:22.349158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:22.349623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:22.350387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:22.350866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:22.351315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:22.441876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:22.451255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf17adca-62ff-4fb6-93b2-8ce3a1cea538 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.114769 Aug 24 02:35:22.451937 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5089/6081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:22 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:22.517746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c2ad8-3793-4c79-8418-94a93b5d59b2", "name": "network-vif-plugged", "status": "completed", "tag": "e39ca545-706e-4373-b69c-eefe75e83474"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:22.530272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:22.530824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:22.531382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:22.549308 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] Creating event network-vif-plugged:e39ca545-706e-4373-b69c-eefe75e83474 for instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 on n-h2-854121-3 Aug 24 02:35:22.554828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-eef1ebc8-f71d-417e-8bf8-929b5723ddef req-82c888fa-5395-466c-97d8-b0bdd502134e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041313 Aug 24 02:35:22.555445 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5090/6082] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:35:23.472754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:23.473461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:23.475451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:35:23.476308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:35:23.484937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:23.485440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:23.485919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:23.486633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:23.487097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:23.487538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:23.573193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:23.581428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b5a5474-01f2-4473-9892-ea62a269c5e2 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1298 microversion: 2.1 time: 0.112824 Aug 24 02:35:23.582899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5091/6083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:23 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:24.607093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:24.607822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:24.614789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.615294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.615781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.616491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.616984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.617432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.703922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:24.712784 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b779df83-d373-4495-8a23-2ada6f92ebdf tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1470 microversion: 2.1 time: 0.109613 Aug 24 02:35:24.713678 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5092/6084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:24 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:35:24.733887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:24.734607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:24.740773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.741275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.741718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.742427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.742891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.743353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.826466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:24.835046 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9171e39c-1849-4da1-bb60-c9320bab8d8f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1470 microversion: 2.1 time: 0.104411 Aug 24 02:35:24.835891 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5093/6085] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:24 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:24.855273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:24.855892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:24.861946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.862443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.862889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.863587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.864052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.864487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.947455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc0674b6-106d-4233-87ab-1cfc280c37a1 tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1621 microversion: 2.1 time: 0.095724 Aug 24 02:35:24.948041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5094/6086] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:24 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1621 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:24.967520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:24.968091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:24.974243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.974749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.975246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:24.975967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:24.976439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:24.976910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:25.124011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8189f2f-5d1f-4011-b87c-b16278c51a5b tempest-TestSecurityGroupsBasicOps-2041285022 tempest-TestSecurityGroupsBasicOps-2041285022-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1911 microversion: 2.1 time: 0.160139 Aug 24 02:35:25.124594 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5095/6087] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:24 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1911 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:25.191880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:25.192468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:25.199403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:25.199926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:25.200400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:25.201188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:25.201670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:25.202253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:25.230994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:35:25.285753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:35:25.315697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00a678af-1b89-4863-8133-f2c7d7653ab5 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 204 len: 0 microversion: 2.1 time: 0.127477 Aug 24 02:35:25.316312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5096/6088] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:35:25 2022] DELETE /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:35:25.325555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:25.326323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:25.332605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:25.333147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:25.333596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:25.334304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:25.335325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:25.336083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:25.421479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:25.430729 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2784a3e-205f-4ad9-ad0d-398a1e3b57ff tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1476 microversion: 2.1 time: 0.109357 Aug 24 02:35:25.431329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5097/6089] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:25 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1476 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:26.451396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:26.452087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:26.460234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:26.461026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:26.461483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:26.462202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:26.462673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:26.463115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:26.547432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:26.556127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80f1f130-b667-4303-9f25-fb29a539b338 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1476 microversion: 2.1 time: 0.108577 Aug 24 02:35:26.556710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5098/6090] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:26 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1476 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:27.411838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0c2ad8-3793-4c79-8418-94a93b5d59b2", "name": "network-vif-deleted", "tag": "e39ca545-706e-4373-b69c-eefe75e83474"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:27.423869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:27.424369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:27.424842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:27.438016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] Creating event network-vif-deleted:e39ca545-706e-4373-b69c-eefe75e83474 for instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 on n-h2-854121-3 Aug 24 02:35:27.443465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7f7851e8-362b-48ef-9437-2f20a7c565fe req-d69e58e6-35ea-4859-aadc-b7e8f1f8a63f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Aug 24 02:35:27.444219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5099/6091] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:35:27.588188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:27.588969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:27.596683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:27.597446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:27.597901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:27.598620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:27.599269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:27.599955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:27.640767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:27.641285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:27.641798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:27.642276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lazy-loading 'fault' on Instance uuid 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:35:27.685229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:27.693083 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c18ae205-f9c3-436d-937f-cdb60f46928f tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 200 len: 1330 microversion: 2.1 time: 0.111120 Aug 24 02:35:27.693661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5100/6092] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:27 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:35:28.715595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:28.716343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: 9e0c2ad8-3793-4c79-8418-94a93b5d59b2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:28.723502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:28.724012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:28.724482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:28.725766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:28.726247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:28.726693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:28.740627 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] HTTP exception thrown: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Request method failure captured: Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 HTTP/1.1 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY399O5DD2kt9aBBpM1-yH_efYjyVD3oURxjSKN_onzuRbBhKPvw3-KEpBHAUeqcgwyOdoK-5g5TP-4dCEfOG-4WxRCpvApXS5Vpj7cNeSYLq6H1PoSsv4_BANzLKRE23O6bDxB5QGSKjuAOkpMahwNY27lVa_vgJp500917HMnzcUg Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d1357a213a2a488c9242a7860fa9c826 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d1357a213a2a488c9242a7860fa9c826 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestSecurityGroupsBasicOps-679511122-project Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0243d74c122e4598a0ceceb5e8f10617 Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestSecurityGroupsBasicOps-679511122-project Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9e0c2ad8-3793-4c79-8418-94a93b5d59b2'} Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:35:28.742954 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Returning 404 to user: Instance 9e0c2ad8-3793-4c79-8418-94a93b5d59b2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f581071-9498-4678-9fe4-969938960484 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2" status: 404 len: 111 microversion: 2.1 time: 0.033058 Aug 24 02:35:28.751993 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5101/6093] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:28 2022] GET /compute/v2.1/servers/9e0c2ad8-3793-4c79-8418-94a93b5d59b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:35:32.985246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:32.985918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:32.993395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:32.994215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:32.994673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:32.995422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:32.995901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:32.996346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:33.025122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:35:33.132979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b713704c-63b8-4496-ae15-f5c8df6e0a7a tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 204 len: 0 microversion: 2.1 time: 0.151864 Aug 24 02:35:33.134644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5102/6094] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:35:32 2022] DELETE /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:35:33.141569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c213dff2-7eb7-428c-ada4-ce76467eafdd", "tag": "014d5def-013b-40a8-a23f-f5e58993c822"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:33.155820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:33.156659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:33.157302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:33.170547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] Creating event network-changed:014d5def-013b-40a8-a23f-f5e58993c822 for instance c213dff2-7eb7-428c-ada4-ce76467eafdd on n-h1-854121-3 Aug 24 02:35:33.175996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3045fee2-a616-4e5a-a251-c5cb562d22a8 req-1786179f-d771-4e15-bb93-7b5a5cc12362 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039580 Aug 24 02:35:33.177608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5103/6095] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:35:33.183809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:33.184789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:33.192460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:33.193281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:33.194730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:33.195846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:33.196521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:33.197345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:33.360198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:33.369951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc8e3d8b-c2f2-4f84-b977-22cd65b9aa14 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1766 microversion: 2.1 time: 0.190826 Aug 24 02:35:33.371066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5104/6096] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:33 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1766 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:35:34.391582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:34.392216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:34.399658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:34.400151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:34.400596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:34.401330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:34.401799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:34.402231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:34.576334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:34.584054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7af41698-d7b2-4f0f-af81-828510536569 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1766 microversion: 2.1 time: 0.196509 Aug 24 02:35:34.585146 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5105/6097] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:34 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1766 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:35.322309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c213dff2-7eb7-428c-ada4-ce76467eafdd", "name": "network-vif-deleted", "tag": "014d5def-013b-40a8-a23f-f5e58993c822"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:35:35.332982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:35.333687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:35.334428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:35.346988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] Creating event network-vif-deleted:014d5def-013b-40a8-a23f-f5e58993c822 for instance c213dff2-7eb7-428c-ada4-ce76467eafdd on n-h1-854121-3 Aug 24 02:35:35.352811 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-daa2c828-fce4-4fb7-8331-cc77870d3eb4 req-c1e1d595-8a6d-4666-9eb0-b8621c43874d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034758 Aug 24 02:35:35.353540 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5106/6098] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:35:35.608347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:35.609121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:35.617202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:35.617774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:35.618245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:35.618979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:35.619464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:35.619915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:35.655197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:35.655704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:35.656160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:35.656634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lazy-loading 'fault' on Instance uuid c213dff2-7eb7-428c-ada4-ce76467eafdd {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:35:35.699299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0243d74c122e4598a0ceceb5e8f10617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1357a213a2a488c9242a7860fa9c826', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:35:35.708038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b581066-d626-4df4-912a-bde2fc202a7d tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 200 len: 1534 microversion: 2.1 time: 0.105174 Aug 24 02:35:35.708802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5107/6099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:35 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 1534 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:35:36.729856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:36.730519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] [instance: c213dff2-7eb7-428c-ada4-ce76467eafdd] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:35:36.737555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:36.738067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:36.738525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:36.739244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:35:36.739719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:35:36.740160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:35:36.754243 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] HTTP exception thrown: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Request method failure captured: Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd HTTP/1.1 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY399O5DD2kt9aBBpM1-yH_efYjyVD3oURxjSKN_onzuRbBhKPvw3-KEpBHAUeqcgwyOdoK-5g5TP-4dCEfOG-4WxRCpvApXS5Vpj7cNeSYLq6H1PoSsv4_BANzLKRE23O6bDxB5QGSKjuAOkpMahwNY27lVa_vgJp500917HMnzcUg Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d1357a213a2a488c9242a7860fa9c826 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d1357a213a2a488c9242a7860fa9c826"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d1357a213a2a488c9242a7860fa9c826 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-679511122 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestSecurityGroupsBasicOps-679511122-project Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0243d74c122e4598a0ceceb5e8f10617 Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestSecurityGroupsBasicOps-679511122-project Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c213dff2-7eb7-428c-ada4-ce76467eafdd'} Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:35:36.755907 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Returning 404 to user: Instance c213dff2-7eb7-428c-ada4-ce76467eafdd could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ed2b18d-4d56-4e23-8e4b-623113616fe8 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd" status: 404 len: 111 microversion: 2.1 time: 0.032266 Aug 24 02:35:36.761175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5108/6100] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:35:36 2022] GET /compute/v2.1/servers/c213dff2-7eb7-428c-ada4-ce76467eafdd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:35:40.443412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4b93a83-2ac0-4a15-a8ca-662c684991e9 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] Calling method '.version_select at 0x7f6b913ee430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:35:40.483472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4b93a83-2ac0-4a15-a8ca-662c684991e9 tempest-TestSecurityGroupsBasicOps-679511122 tempest-TestSecurityGroupsBasicOps-679511122-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-874140376" status: 202 len: 0 microversion: 2.1 time: 0.044819 Aug 24 02:35:40.488068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5109/6101] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:35:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-874140376 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:36:13.578594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:13.579913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:13.730201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c098636-7e0d-493a-a8da-490018dc38a8 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-496144726", "availability_zone": "foo_zone"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:13.733225 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:13.733225 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:13.734226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.aggregate [None req-8c098636-7e0d-493a-a8da-490018dc38a8 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Generated uuid 2903b7a6-c10f-4899-bde6-f0c01642cc70 for aggregate {{(pid=128567) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 24 02:36:13.762291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c098636-7e0d-493a-a8da-490018dc38a8 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.186589 Aug 24 02:36:13.762890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5110/6102] 10.222.0.49 () {60 vars in 1164 bytes} [Wed Aug 24 02:36:13 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:13.774373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68a237ef-718c-4db4-a981-1bf0dca22699 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:13.776992 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:13.776992 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:13.799604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68a237ef-718c-4db4-a981-1bf0dca22699 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.029318 Aug 24 02:36:13.800896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5111/6103] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 02:36:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:13.812147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:13.814731 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:13.814731 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:13.815895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:13.817347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:13.817814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:13.818784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:13.819292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:13.819729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:13.844599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-364f4bfe-6e41-408e-8a96-8c0c678e7cf4 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036067 Aug 24 02:36:13.845449 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5112/6104] 10.222.0.49 () {58 vars in 1176 bytes} [Wed Aug 24 02:36:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:13.857188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8381ae4c-f953-4b2a-ba0f-1aa9900e3e48 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:13.857950 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:13.857950 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:13.864855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8381ae4c-f953-4b2a-ba0f-1aa9900e3e48 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.011434 Aug 24 02:36:13.868911 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5113/6105] 10.222.0.49 () {58 vars in 1143 bytes} [Wed Aug 24 02:36:13 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:13.877264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccf40090-c21e-4b25-b3d1-d4b95a8c1d44 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:13.879756 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:13.879756 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:13.888013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccf40090-c21e-4b25-b3d1-d4b95a8c1d44 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:13.888515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccf40090-c21e-4b25-b3d1-d4b95a8c1d44 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:13.888986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ccf40090-c21e-4b25-b3d1-d4b95a8c1d44 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:14.143923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccf40090-c21e-4b25-b3d1-d4b95a8c1d44 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.270352 Aug 24 02:36:14.144658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5114/6106] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 02:36:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:14.155816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52744c26-18b8-4b84-ae3d-a763954afc27 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:14.156671 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.156671 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.164923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52744c26-18b8-4b84-ae3d-a763954afc27 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.012691 Aug 24 02:36:14.165465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5115/6107] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:36:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:14.175529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7039551d-29b3-465e-a38b-69cfc0442252 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-877075476", "availability_zone": "foo_zone"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:14.178382 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.178382 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.217463 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7039551d-29b3-465e-a38b-69cfc0442252 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.045285 Aug 24 02:36:14.224802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5116/6108] 10.222.0.49 () {60 vars in 1173 bytes} [Wed Aug 24 02:36:14 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:14.230668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c056b3eb-0060-4afa-b54a-1be669a7633b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:14.233336 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.233336 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.254670 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c056b3eb-0060-4afa-b54a-1be669a7633b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.028244 Aug 24 02:36:14.255260 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5117/6109] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 02:36:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:36:14.266453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1ad7d5a-5fc8-4911-87fc-209541c3e7a1 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:14.267204 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.267204 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.275853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1ad7d5a-5fc8-4911-87fc-209541c3e7a1 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.012993 Aug 24 02:36:14.276395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5118/6110] 10.222.0.49 () {58 vars in 1152 bytes} [Wed Aug 24 02:36:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:14.286666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ecb6606-86d3-427c-b40b-42a8b180394b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-3"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:14.289764 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.289764 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.297578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecb6606-86d3-427c-b40b-42a8b180394b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:14.298077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecb6606-86d3-427c-b40b-42a8b180394b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:14.298529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecb6606-86d3-427c-b40b-42a8b180394b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:14.415881 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ecb6606-86d3-427c-b40b-42a8b180394b tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.132471 Aug 24 02:36:14.416537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5119/6111] 10.222.0.49 () {60 vars in 1194 bytes} [Wed Aug 24 02:36:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:14.427400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8d95a88-e138-4c1b-9c63-ada8e4af5864 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:14.428152 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:36:14.428152 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:36:14.448440 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8d95a88-e138-4c1b-9c63-ada8e4af5864 tempest-TestAggregatesBasicOps-1530999497 tempest-TestAggregatesBasicOps-1530999497-project-admin] 10.222.0.49 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.024527 Aug 24 02:36:14.449059 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5120/6112] 10.222.0.49 () {58 vars in 1155 bytes} [Wed Aug 24 02:36:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 24 02:36:23.000765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7d56355-bdb5-412f-ade0-261733893bb0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: .version_select at 0x7f6b91232ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1713259476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD7mHvHZHw7iAcxRWt2ueCvgLl8E0qqRqnXkLkk9p5esNT5MUJZDU5YjYa6OebaM0h4OgaHF20RDluBTfcv3u4mksgsoSs8D3amSeB+IM7GGsYY5xAhadm1nXEuiWCUTA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:23.018433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7d56355-bdb5-412f-ade0-261733893bb0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:36:23.023626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c7d56355-bdb5-412f-ade0-261733893bb0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:36:23.048520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7d56355-bdb5-412f-ade0-261733893bb0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.213379 Aug 24 02:36:23.049165 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5121/6113] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:36:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:28.566789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:28.569007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:28.573646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-935676933", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "229f2291-dc80-4fb1-950e-3d41f66b31a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1713259476", "security_groups": [{"name": "tempest-secgroup-smoke-901262076"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:28.837480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] validate_networks() for [('229f2291-dc80-4fb1-950e-3d41f66b31a4', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:36:29.258293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:36:29.258742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:36:29.259239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:36:29.259884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:36:29.260323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:36:29.269366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:29.269868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:29.270325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:29.271075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:29.271748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:29.272199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:29.290009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:36:29.295416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:36:29.309574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:36:29.311938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:36:29.359308 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ceabd8c-1d5d-461e-bf62-44f3f673de1c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793142 Aug 24 02:36:29.360064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5122/6114] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:36:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:36:29.373637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93426e6c-50ed-483b-8a0b-0966dc329f40 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:29.374916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93426e6c-50ed-483b-8a0b-0966dc329f40 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:29.432137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93426e6c-50ed-483b-8a0b-0966dc329f40 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:29.440065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93426e6c-50ed-483b-8a0b-0966dc329f40 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1266 microversion: 2.1 time: 0.073216 Aug 24 02:36:29.445050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5123/6115] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:29 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:30.463631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:30.464358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:30.472182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:30.472848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:30.474512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:30.475224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:30.475705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:30.476195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:30.569537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:30.582682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57cab132-b8de-4569-b5d1-411b72ce1225 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1326 microversion: 2.1 time: 0.123796 Aug 24 02:36:30.583973 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5124/6116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:30 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1326 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:31.606605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:31.608198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:31.612691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:31.618728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:31.620010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:31.620942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:31.621942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:31.622527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:31.623074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:31.784143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:31.794576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5893131c-c891-49ec-81ce-800fa8eb903c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.194693 Aug 24 02:36:31.796664 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5125/6117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:31 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:31.995192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:32.005347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:32.005951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:32.006573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:32.018487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] Creating event network-changed:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h2-854121-3 Aug 24 02:36:32.024167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-42e25318-d54b-436d-b346-8e92c962ac07 req-2084e62f-0f45-4ca6-9d31-4fcc3a001bf6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Aug 24 02:36:32.025113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5126/6118] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:36:32.817443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:32.818186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:32.824387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:32.824932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:32.825391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:32.826091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:32.826557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:32.827000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:32.957387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:32.965807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4649eab4-d875-4e60-85ce-fdf37fd8e51e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.153491 Aug 24 02:36:32.966382 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5127/6119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:32 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:33.986202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:33.986892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:33.993793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:33.994294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:33.994749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:33.995452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:33.995922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:33.996361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:34.125740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:34.134065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b330e817-8fd5-4c93-ba81-eca8d59bd4de tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.151784 Aug 24 02:36:34.134632 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5128/6120] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:33 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:35.154409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:35.155071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:35.162019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:35.162530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:35.162993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:35.163712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:35.164182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:35.164625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:35.302470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:35.310702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75e8cc13-80a7-4f30-a39d-af789b327257 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.160203 Aug 24 02:36:35.311287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5129/6121] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:35 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:36.331643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:36.332279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:36.340089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:36.340596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:36.341081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:36.341788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:36.342259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:36.342705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:36.475344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:36.483286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfcf5cff-fa9c-4ae9-99c8-97fd3dfe43dc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.155560 Aug 24 02:36:36.483872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5130/6122] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:36 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:36:37.505048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:37.505721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:37.512470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:37.512997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:37.513449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:37.514176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:37.514642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:37.515076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:37.643212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:37.651657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1520c282-bcdf-4dce-9f5a-3b84e5cbfb83 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.150510 Aug 24 02:36:37.652228 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5131/6123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:37 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:38.672095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:38.672747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:38.679302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:38.679807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:38.680263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:38.681697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:38.682175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:38.682620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:38.818694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:38.826533 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f186dfe-6bd6-4c2f-a349-3369c1ad384d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.158550 Aug 24 02:36:38.827107 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5132/6124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:38 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:38.866091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "name": "network-vif-plugged", "status": "completed", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:38.875496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:38.876031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:38.876431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:38.887777 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] Creating event network-vif-plugged:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h2-854121-3 Aug 24 02:36:38.892945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-23a64b5b-a102-4e71-a552-919a19f0899b req-16b19854-5103-4c86-9ee6-3ca08feb345a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030659 Aug 24 02:36:38.893636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5133/6125] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:36:39.844753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:39.845677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:36:39.850354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:39.851062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:39.858314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:39.858810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:39.859260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:39.859964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:39.860429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:39.860897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:39.990768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:39.999166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2645e578-80a4-46d7-9691-cafd68d52030 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1391 microversion: 2.1 time: 0.155463 Aug 24 02:36:39.999732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5134/6126] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:39 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:41.019827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:41.021246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:41.028378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:41.028926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:41.029385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:41.030097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:41.030572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:41.031020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:41.156474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:41.164206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46a26b08-4414-4e87-8768-45d54ad0865c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1564 microversion: 2.1 time: 0.148346 Aug 24 02:36:41.164796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5135/6127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:41 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1564 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:41.184239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:41.184896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:41.190695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:41.191190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:41.191646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:41.192350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:41.192847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:41.193294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:41.327790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:41.336185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9177fcb-9846-4700-ba8c-d5d6c0573485 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1564 microversion: 2.1 time: 0.156003 Aug 24 02:36:41.336772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5136/6128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:41 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:42.881489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:36:42.882133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:36:42.889954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:42.890458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:42.890910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:42.891614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:42.892078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:42.892514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:43.023363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:36:43.031290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1fb3b1f-f1ce-4795-b341-8c8e5ff58e43 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1564 microversion: 2.1 time: 0.154602 Aug 24 02:36:43.031877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5137/6129] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:36:42 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:36:43.036323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:36:43.046193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:36:43.046695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:36:43.047149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:36:43.061367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] Creating event network-changed:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h2-854121-3 Aug 24 02:36:43.066373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f3381dd3-1957-4a38-93bb-a25cfa3f0ae2 req-81a3bdbe-dad6-42b4-aecc-3459e5446574 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 Aug 24 02:36:43.066980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5138/6130] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:37:16.349576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:37:16.351853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:16.354894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=27 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:37:16.355673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=80 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:37:16.361571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:16.362067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:16.362514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:16.363214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:16.363679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:16.364118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:16.430173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c549f416-c5b8-4e96-92d3-ef62a0cb2509 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action" status: 200 len: 24572 microversion: 2.1 time: 0.085053 Aug 24 02:37:16.430896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5139/6131] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:37:16 2022] POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action => generated 24572 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:37:55.579538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:37:55.580261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:55.582820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:37:55.583528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:37:55.590427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:55.591200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:55.591661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:55.592377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:55.592874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:55.593328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:55.812566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04c6493e-5063-471a-99a4-4699c3e95f3f tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1834 microversion: 2.1 time: 0.237199 Aug 24 02:37:55.813094 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5140/6132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:37:55 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1834 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:37:55.834776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:37:55.835405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:55.841704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:55.842199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:55.842654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:55.843359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:55.843837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:55.844277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:55.976874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:37:55.984632 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6aea2a2c-7470-48ed-8dd7-5b20ca75a982 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1683 microversion: 2.1 time: 0.155344 Aug 24 02:37:55.985233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5141/6133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:37:55 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:37:56.075759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:37:56.078007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:56.084051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.084488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.084967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.085696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.086135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.086576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.153396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-043f51ce-f78e-45af-8f63-d560f67452e9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action" status: 200 len: 32641 microversion: 2.1 time: 0.081521 Aug 24 02:37:56.154047 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5142/6134] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:37:56 2022] POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action => generated 32641 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:37:56.287546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:37:56.288229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:56.295280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.295775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.296235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.296968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.297437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.297876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.338418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8e8a1035d39d42b59818ca3e2486f6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513feb0e6fdd4182b260bd7b7d31a4e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:37:56.339027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] flavor_id is None. Assuming migration. {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 02:37:56.339530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:37:56.452384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18a6f021-002a-46ac-a0aa-cd35618cbb3b tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action" status: 202 len: 0 microversion: 2.1 time: 0.169021 Aug 24 02:37:56.453033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5143/6135] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:37:56 2022] POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:37:56.461172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:37:56.461824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:56.468549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.469130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.469583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.470284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:56.471408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:56.471853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:56.641689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:37:56.650167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30d5f9bd-1b23-4988-ba70-0455951d43f0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1692 microversion: 2.1 time: 0.192958 Aug 24 02:37:56.651945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5144/6136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:37:56 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1692 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:37:57.673605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:37:57.674874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:57.681728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:57.682240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:57.682701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:57.683429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:57.684017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:57.684467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:57.813457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:37:57.821910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29249e0d-3e37-4514-9a98-90d735336c54 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1692 microversion: 2.1 time: 0.152349 Aug 24 02:37:57.822469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5145/6137] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:37:57 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:37:58.843354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:37:58.843994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:37:58.851358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:58.851866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:58.852326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:58.853073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:37:58.853546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:37:58.853994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:37:58.986148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:37:58.993913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c38216e9-06de-497b-967d-90e16a76e8e6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.154757 Aug 24 02:37:58.994490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5146/6138] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:37:58 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:00.015387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:00.016083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:00.022843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:00.023340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:00.023787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:00.024486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:00.024977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:00.025417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:00.150668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:00.158832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-217186ca-5eef-4ada-82ff-71e1222d3f5d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.146818 Aug 24 02:38:00.159399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5147/6139] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:00 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:01.179830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:01.180460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:01.187435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:01.187937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:01.188393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:01.189132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:01.190172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:01.190614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:01.323057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:01.330815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab8ff2ab-0396-4c21-90f3-4261c8d29166 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.154878 Aug 24 02:38:01.331387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5148/6140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:01 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:02.351791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:02.352399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:02.359250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:02.359743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:02.360190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:02.360934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:02.361994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:02.362432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:02.503036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:02.510935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-836b4d8c-254e-4e2f-a25f-bf968bc68026 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.162988 Aug 24 02:38:02.511500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5149/6141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:02 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:03.531408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:03.532058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:03.539482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:03.539977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:03.540424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:03.541147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:03.541614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:03.542050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:03.672646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:03.680477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf08f75e-634e-47ea-b5de-dfdfdefa4732 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.153032 Aug 24 02:38:03.681092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5150/6142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:03 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:04.702010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:04.702673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:04.709506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:04.710014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:04.710470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:04.711172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:04.711640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:04.712081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:04.839158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:04.847722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29d0a170-5839-4850-951f-6025283f20ce tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.149764 Aug 24 02:38:04.848298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5151/6143] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:04 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:05.870207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:05.870912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:05.878067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:05.878571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:05.879030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:05.879749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:05.880255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:05.880703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:06.008791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:06.016498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9b29b44-6878-4bcf-877d-c351b5d1a717 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.150906 Aug 24 02:38:06.017096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5152/6144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:05 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:07.038557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:07.039182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:07.046099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:07.046600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:07.047058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:07.047763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:07.048238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:07.049265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:07.179990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:07.187849 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62d97fb5-0670-4e59-91f1-7afe3ea6ceed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.153161 Aug 24 02:38:07.188428 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5153/6145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:07 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:08.209525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:08.210170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:08.217305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:08.217809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:08.218261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:08.218968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:08.219437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:08.219883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:08.347859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:08.355610 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4a6fac9-f175-4b13-8d56-13c5a7702f0e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.150578 Aug 24 02:38:08.356199 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5154/6146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:08 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:09.376845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:09.377455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:09.384237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:09.384751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:09.385212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:09.385915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:09.386386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:09.386835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:09.390960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:38:09.524474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:09.532426 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-907423c3-0392-404e-bf46-8206ffe8adbc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.159535 Aug 24 02:38:09.533628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5155/6147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:09 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:10.554784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:10.555448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:10.562309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:10.562809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:10.563264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:10.563969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:10.565099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:10.565547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:10.697123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:10.704995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-38bad767-9384-4be1-b946-dc83cd86bd02 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1697 microversion: 2.1 time: 0.154071 Aug 24 02:38:10.705574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5156/6148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:10 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:11.337588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:38:11.347833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:11.348331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:11.348818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:11.361585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Creating event network-vif-unplugged:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h1-854121-3 Aug 24 02:38:11.367875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] Instance 6d371425-9347-4af2-ba15-cde24e7d1819 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:38:11.379010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-84160cc3-4246-4dd0-9375-67adf17c494d req-cab9f834-90ce-4843-9108-2aeb85364821 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045086 Aug 24 02:38:11.379624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5157/6149] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:38:11.729017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:11.729768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:11.736349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:11.736891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:11.737413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:11.738152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:11.738627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:11.739075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:12.023955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:12.031786 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-daaac080-968e-4906-b54d-1e207d4a8474 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1696 microversion: 2.1 time: 0.308094 Aug 24 02:38:12.032367 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5158/6150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:11 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1696 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:13.053516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:13.054221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:13.061039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:13.061538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:13.062015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:13.062719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:13.063185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:13.063623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:13.196024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:13.204041 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e6bc4b4-3d25-47cc-8ea4-f46c0a9c5b5f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1694 microversion: 2.1 time: 0.154997 Aug 24 02:38:13.204645 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5159/6151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:13 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:13.407012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:38:13.416968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:13.417462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:13.417913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:13.429482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Creating event network-changed:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h1-854121-3 Aug 24 02:38:13.434586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] Instance 6d371425-9347-4af2-ba15-cde24e7d1819 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:38:13.445051 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-feb73319-a51e-4810-8bc1-14ac4cec7c2e req-534b7845-b502-4fe4-97e2-e90a26609965 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041685 Aug 24 02:38:13.445728 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5160/6152] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:38:14.227836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:14.228473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:14.235249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:14.235751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:14.236200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:14.237474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:14.237940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:14.238374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:14.367874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:14.375541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71499825-aa04-4f36-9090-7b80a6a3e195 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1694 microversion: 2.1 time: 0.152934 Aug 24 02:38:14.376109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5161/6153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:14 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:15.397325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:15.398017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:15.404797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:15.405305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:15.405823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:15.406551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:15.407027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:15.407475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:15.595097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:15.602823 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02cc08f7-134a-47bb-8d74-44beea9905e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1694 microversion: 2.1 time: 0.210024 Aug 24 02:38:15.603398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5162/6154] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:15 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:16.624551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:16.625274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:16.632795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.633298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.633755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:16.634461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.634932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.635374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:16.771468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:16.779175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8782f13a-c5dc-482d-975f-02959c8c47b4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1691 microversion: 2.1 time: 0.158543 Aug 24 02:38:16.779760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5163/6155] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:16 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:16.799586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:38:16.800129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:16.806013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.806564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.806969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:16.807672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.808141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.808587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:16.864641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d69aebf1-b425-4bf5-9883-d2388f664e82 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action" status: 204 len: 0 microversion: 2.1 time: 0.068534 Aug 24 02:38:16.865321 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5164/6156] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:38:16 2022] POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:38:16.873915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:16.874421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:16.881040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.881544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.882001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:16.882832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:16.883301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:16.883744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:17.015961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:17.023783 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-612c8d23-627b-44d3-a448-6d825a8117f5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1691 microversion: 2.1 time: 0.154083 Aug 24 02:38:17.024357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5165/6157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:16 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:17.611369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "name": "network-vif-plugged", "status": "completed", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:38:17.622602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:17.623336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:17.623876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:17.638764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Creating event network-vif-plugged:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h1-854121-3 Aug 24 02:38:17.644664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] Instance 6d371425-9347-4af2-ba15-cde24e7d1819 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:38:17.655797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-99a1daf6-f3e7-40c5-a4da-cad233d57d15 req-ffc514bb-10e3-416a-8f54-dc2f5399edfa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047937 Aug 24 02:38:17.656651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5166/6158] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:38:18.045693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:18.046401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:18.052522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:18.053058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:18.053508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:18.054206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:18.054671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:18.055109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:18.194176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:18.202594 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66401bde-47d6-4259-9fce-065efd9f6c31 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1691 microversion: 2.1 time: 0.161080 Aug 24 02:38:18.203164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5167/6159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:18 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:19.225437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:38:19.226061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:19.233528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:19.234042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:19.234502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:19.235222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:19.235693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:19.236133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:19.367678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:38:19.375417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14dcba76-3a84-456e-92de-d61ba6a3b43b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1683 microversion: 2.1 time: 0.153978 Aug 24 02:38:19.375984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5168/6160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:38:19 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:38:49.588503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:38:49.590790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:38:49.593578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=60 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:38:49.594253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:38:49.599765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:49.600264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:49.600740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:49.601452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:38:49.601928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:38:49.602370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:38:49.670796 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99261ce8-46e4-4797-836c-b4132e3bb89c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action" status: 200 len: 24566 microversion: 2.1 time: 0.086262 Aug 24 02:38:49.671693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5169/6161] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:38:49 2022] POST /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819/action => generated 24566 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:39:03.093906 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:39:03.094802 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:39:06.086173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:06.086880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:06.091251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:39:06.091898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:39:06.097111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:06.097604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:06.098051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:06.098756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:06.099289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:06.099738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:06.226275 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-093930e6-c884-4e75-9740-6a3d27207436 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1834 microversion: 2.1 time: 0.144119 Aug 24 02:39:06.226953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5170/6162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:06 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1834 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:07.059266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:07.059786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:07.066627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:07.067119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:07.067578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:07.068304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:07.068815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:07.069261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:07.098282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:39:07.180839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4643c359-4263-48c6-b4a4-75f81eeeec97 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 204 len: 0 microversion: 2.1 time: 0.125129 Aug 24 02:39:07.182254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5171/6163] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:39:07 2022] DELETE /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:39:07.261780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:07.272517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:07.273022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:07.273461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:07.284318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] Creating event network-changed:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h1-854121-3 Aug 24 02:39:07.289339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0ba009dc-d330-4129-8ff8-3fc660a4e630 req-cebf1d14-eef9-4cee-876e-71a481871cb1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105483 Aug 24 02:39:07.289938 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5172/6164] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:39:07.294999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:07.295695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:07.301833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:07.302329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:07.302774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:07.303469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:07.303931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:07.304365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:07.435384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:07.444334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9d48a348-a522-44a9-9791-bae67d4231f8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1689 microversion: 2.1 time: 0.153193 Aug 24 02:39:07.444976 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5173/6165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:07 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:39:08.466177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:08.466840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:08.474160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:08.474657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:08.475111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:08.475817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:08.476285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:08.476739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:08.644642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:08.652433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a66abe67-e9d9-433b-9582-d8c268db9e88 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1689 microversion: 2.1 time: 0.190153 Aug 24 02:39:08.653029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5174/6166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:08 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:09.547107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d371425-9347-4af2-ba15-cde24e7d1819", "name": "network-vif-deleted", "tag": "8e2730f1-b161-4ca9-8b4e-63d892356ddb"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:09.557497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:09.558100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:09.558557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:09.573728 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] Creating event network-vif-deleted:8e2730f1-b161-4ca9-8b4e-63d892356ddb for instance 6d371425-9347-4af2-ba15-cde24e7d1819 on n-h1-854121-3 Aug 24 02:39:09.578314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a87e01e5-ca71-419c-9f8e-17a64a3389e5 req-91feb7f2-66a8-45a9-b01d-d5314746fb10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100072 Aug 24 02:39:09.578915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5175/6167] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:39:09.674437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:09.675163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:09.681390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:09.681944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:09.682352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:09.683060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:09.683532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:09.683975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:09.716000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:09.716524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:09.716989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:09.717459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lazy-loading 'fault' on Instance uuid 6d371425-9347-4af2-ba15-cde24e7d1819 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:39:09.759226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:09.767455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9d57e97-a01b-426a-865c-ac46894db69a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 200 len: 1356 microversion: 2.1 time: 0.097194 Aug 24 02:39:09.768081 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5176/6168] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:09 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:10.790010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:10.790723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 6d371425-9347-4af2-ba15-cde24e7d1819] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:10.797810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:10.798318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:10.798776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:10.799507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:10.799982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:10.800422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:10.813928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] HTTP exception thrown: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Request method failure captured: Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 HTTP/1.1 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY6mcUK6SKBWmvGe6pxFXCLvrQ-NcpjutPmJzGb9LWF4SnvvrFX9F3Ge0ycTQ5AfFQclVFVhtPR1AXmH3i54fXSF-1Xc_FJBVF4HGAu9bPK1YJMPZDMpyRQfxj1rjt50R-wmtSTDn5CqMpEEMpLwJFjZo-z1jYOSKF1HfjMaAwbfTcA Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5931e5875204084b37acf023dd23685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5931e5875204084b37acf023dd23685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14e74d8577a94089a96fb2fd9b08b02c Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '6d371425-9347-4af2-ba15-cde24e7d1819'} Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:39:10.815563 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Returning 404 to user: Instance 6d371425-9347-4af2-ba15-cde24e7d1819 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4c67281-fd4b-4db9-89da-bd3cea3ee921 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819" status: 404 len: 111 microversion: 2.1 time: 0.030899 Aug 24 02:39:10.821268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5177/6169] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:10 2022] GET /compute/v2.1/servers/6d371425-9347-4af2-ba15-cde24e7d1819 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:39:14.024217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd063ad2-fa15-4f84-a7be-d597637d0b53 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '.version_select at 0x7f6b915784c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:14.051340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd063ad2-fa15-4f84-a7be-d597637d0b53 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1713259476" status: 202 len: 0 microversion: 2.1 time: 0.031655 Aug 24 02:39:14.051933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5178/6170] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 02:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1713259476 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:39:14.083554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a8b7afe-8574-487c-9de7-aa0f0653661a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: .version_select at 0x7f6b911dfca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1867714218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQdfEIDGSdYsJX0VD1wm52dnn6M6UhJUzT428n0N/Dr0RJDN8TpBmHRCPNjIiA82RKMlcH+3A0b4zVEfHXEUwyOpmwHj0lR/3sFmQfDl2KuPvtcAyH7mWpH6q/SuiHwKQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:14.100681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0a8b7afe-8574-487c-9de7-aa0f0653661a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:39:14.105874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-0a8b7afe-8574-487c-9de7-aa0f0653661a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:39:14.129103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a8b7afe-8574-487c-9de7-aa0f0653661a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049862 Aug 24 02:39:14.129728 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5179/6171] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:39:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:39:19.501830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-178957953", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "ea44f1ad-d779-46ab-bbfa-1303e6dcea0c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1867714218", "security_groups": [{"name": "tempest-secgroup-smoke-235342033"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:19.614111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] validate_networks() for [('ea44f1ad-d779-46ab-bbfa-1303e6dcea0c', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:39:20.203164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:39:20.203922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:39:20.204482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:39:20.204998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:39:20.205555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:39:20.216770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:20.217619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:20.218712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:20.219904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:20.220604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:20.221438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:20.256346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:39:20.262477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:39:20.280139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:39:20.282561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:39:20.335231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-650f58b5-9bd1-4d54-8449-e4534c2b371e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.837033 Aug 24 02:39:20.342693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5180/6172] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:39:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:39:20.351490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-745ef55d-79b9-416f-9ca6-313b3474a2f4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:20.363781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-745ef55d-79b9-416f-9ca6-313b3474a2f4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:20.430053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-745ef55d-79b9-416f-9ca6-313b3474a2f4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:20.438808 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-745ef55d-79b9-416f-9ca6-313b3474a2f4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1266 microversion: 2.1 time: 0.093040 Aug 24 02:39:20.439419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5181/6173] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:20 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:39:21.461516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:21.462860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:21.472503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:21.473041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:21.473728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:21.474702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:21.475473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:21.486063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:21.574405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:21.587769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6bcfbe2-93fc-4a1c-9ca2-58d43f65393f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1326 microversion: 2.1 time: 0.131047 Aug 24 02:39:21.594113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5182/6174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:21 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:22.611463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:22.612129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:22.619395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:22.619902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:22.620356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:22.621204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:22.621688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:22.622179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:22.766911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:22.775760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf12f195-f842-4bf4-aef1-067c8ac20ade tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.168152 Aug 24 02:39:22.776425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5183/6175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:22 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:39:22.893909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:22.905067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:22.905848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:22.906324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:22.917770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] Creating event network-changed:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:39:22.922930 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-03295d5a-732a-4a9d-a80f-8286f226ceec req-88b31a12-963d-4843-abad-b07fb2e27d1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033791 Aug 24 02:39:22.923540 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5184/6176] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:39:23.798404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:23.799112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:23.805319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:23.805816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:23.806269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:23.806971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:23.807439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:23.807884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:23.934725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:23.942910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4121846f-5fa1-43cf-9478-99b44a7ad2ae tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.149571 Aug 24 02:39:23.943481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5185/6177] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:23 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:24.964299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:24.964967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:24.972111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:24.972617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:24.973105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:24.973813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:24.974282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:24.974723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:25.109075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:25.117344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1cb58af6-3a8f-409b-b4b1-393fdecbc817 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.156969 Aug 24 02:39:25.117934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5186/6178] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:24 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:26.139836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:26.140471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:26.148249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:26.148838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:26.149294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:26.150071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:26.150542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:26.150981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:26.282287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:26.289979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f8b8d01-f02e-4857-b9ea-15e9739a4995 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.154561 Aug 24 02:39:26.290556 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5187/6179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:26 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:27.311056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:27.311683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:27.318569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:27.319065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:27.319521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:27.320221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:27.320692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:27.321154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:27.453541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:27.463306 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-55f73ace-2714-49fe-9b24-09e7e02ed317 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.155910 Aug 24 02:39:27.469481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5188/6180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:27 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:27.797200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-plugged", "status": "completed", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:27.806689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:27.807187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:27.807639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:27.818799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] Creating event network-vif-plugged:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:39:27.823801 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b4a42e89-8deb-4b5d-8f0f-216654ea7353 req-f4707a49-3ec5-40d5-8594-69185bc7e0bc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102184 Aug 24 02:39:27.824389 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5189/6181] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:39:28.485435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:28.486137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:28.493210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:28.493650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:28.494102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:28.494804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:28.495267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:28.495705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:28.624658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:28.632886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7c49fce-6314-42ba-8830-71e684ee284e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1391 microversion: 2.1 time: 0.151630 Aug 24 02:39:28.633458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5190/6182] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:28 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:29.654341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:29.655021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:29.662625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:29.663123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:29.663597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:29.664280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:29.664778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:29.665223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:29.683061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:39:29.797729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:29.805591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69518955-2619-4f9c-92ae-177a861c7ea6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1563 microversion: 2.1 time: 0.155209 Aug 24 02:39:29.806175 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5191/6183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:29 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:29.825711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:29.826338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:29.832827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:29.833331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:29.833789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:29.834501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:29.834975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:29.835421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:29.971542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:29.979397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac8e33bb-a038-4cf4-93f8-55fff8793a9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1563 microversion: 2.1 time: 0.157347 Aug 24 02:39:29.979979 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5192/6184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:29 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:39:31.827853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:39:31.828498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:39:31.830483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:39:31.831195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:39:31.838495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:31.839004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:31.839466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:31.840176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:31.840644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:31.841117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:31.970961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:39:31.978829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbd3b1e2-7e5e-42e7-81ab-3e1cb722002a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1563 microversion: 2.1 time: 0.155169 Aug 24 02:39:31.979407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5193/6185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:39:31 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:39:31.983895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:39:31.994543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:39:31.995183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:39:31.995651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:39:32.008543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] Creating event network-changed:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:39:32.014008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2cdba501-bf9c-4418-86be-d8499353d090 req-936ebb3d-4b9c-44bc-9425-91322df12624 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033443 Aug 24 02:39:32.014709 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5194/6186] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:40:05.274159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:40:05.274932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=16 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:40:05.279090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:05.281352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:05.289420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:05.289911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:05.290354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:05.291051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:05.291515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:05.291952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:05.360596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2465ea59-2e78-4235-b371-6b8942237a0b tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action" status: 200 len: 24569 microversion: 2.1 time: 0.088547 Aug 24 02:40:05.361255 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5195/6187] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:40:05 2022] POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action => generated 24569 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:40:35.808070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:35.808845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:35.811354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:40:35.812008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:40:35.818169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:35.818671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:35.819124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:35.819829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:35.820297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:35.820755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:35.951929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bfe796f-96ee-4707-8974-99d2132fd657 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1833 microversion: 2.1 time: 0.148038 Aug 24 02:40:35.952499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5196/6188] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:35 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1833 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:35.972863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:35.973503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:35.979669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:35.980167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:35.980621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:35.981347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:35.981819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:35.982261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.108228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:36.115940 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8c0b64a-51ad-445d-a26a-24752aca12f1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1682 microversion: 2.1 time: 0.146888 Aug 24 02:40:36.116507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5197/6189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:35 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:36.210632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:36.212874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:36.218946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.219445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.220164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.220916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.221388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.221830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.290634 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-458d3295-d42f-4606-98a0-72a8cc8ff528 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action" status: 200 len: 32642 microversion: 2.1 time: 0.083766 Aug 24 02:40:36.291271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5198/6190] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:40:36 2022] POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:40:36.523287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:36.523890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:36.530995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.531494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.531948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.532658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.533785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.534266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.563207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8e8a1035d39d42b59818ca3e2486f6dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513feb0e6fdd4182b260bd7b7d31a4e1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:36.563787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] flavor_id is None. Assuming migration. {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 24 02:40:36.564238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:40:36.677292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89681310-bc57-44b5-814c-eaf7b01e08b8 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action" status: 202 len: 0 microversion: 2.1 time: 0.158152 Aug 24 02:40:36.677904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5199/6191] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:40:36 2022] POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:40:36.685850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:36.686612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:36.692603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.693237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.693696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.694418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:36.694888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:36.695330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:36.850431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:36.858446 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6452ae3c-3284-449b-8a2f-d7812621b8d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1691 microversion: 2.1 time: 0.176262 Aug 24 02:40:36.859023 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5200/6192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:36 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:37.879240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:37.879900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:37.886822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:37.887331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:37.887789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:37.889095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:37.889575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:37.890024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:38.020734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:38.028550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e430838-f58d-4401-becb-ecd8cd6a733c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1691 microversion: 2.1 time: 0.153140 Aug 24 02:40:38.029152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5201/6193] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:37 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:39.050633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:39.051287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:39.057714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:39.058454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:39.058899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:39.059804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:39.060274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:39.060791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:39.203040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:39.210955 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-591bf28d-8b30-47cd-bf7a-45786bf5b4e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.164234 Aug 24 02:40:39.212753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5202/6194] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:39 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:40.234279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:40.234945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:40.242016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:40.242657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:40.243185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:40.243901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:40.244381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:40.244859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:40.375733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:40.383490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fb99086-71e0-493e-bfd7-fa1f1b8c8b0a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.153591 Aug 24 02:40:40.384058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5203/6195] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:40 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:41.405786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:41.406433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:41.413541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:41.414071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:41.414521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:41.415305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:41.415719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:41.416155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:41.549689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:41.557909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92a06041-4277-4ab0-ac82-2ddea099b2b6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.156462 Aug 24 02:40:41.558694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5204/6196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:41 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:42.579811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:42.580469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:42.587320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:42.587821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:42.588273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:42.589007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:42.589476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:42.589921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:42.721603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:42.729327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f9979a2-b8e5-483d-af9f-c174a1edf9a6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.153877 Aug 24 02:40:42.729900 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5205/6197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:42 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:43.750904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:43.751622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:43.758048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:43.758554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:43.759013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:43.759727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:43.760201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:43.760648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:43.891844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:43.899559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a22bacb-0888-4899-99d5-2914cc7b62c2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.152685 Aug 24 02:40:43.900131 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5206/6198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:43 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:44.921896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:44.922546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:44.929181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:44.929946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:44.930635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:44.931347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:44.931812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:44.932244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:45.062724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:45.070436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-445ca94a-05b4-4f9e-aa5e-1cbab9701762 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.153013 Aug 24 02:40:45.071011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5207/6199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:44 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:46.092137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:46.092816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:46.100047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:46.100574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:46.101124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:46.101836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:46.102308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:46.102750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:46.235114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:46.243741 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae511b58-c7d7-4be0-a84e-e6cac2f96836 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.155899 Aug 24 02:40:46.244316 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5208/6200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:46 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:47.266194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:47.266866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:47.273895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:47.274400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:47.274851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:47.275565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:47.276036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:47.276483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:47.408198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:47.416178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b131a2e4-be5e-477a-b818-6b5331734c08 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.154495 Aug 24 02:40:47.417001 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5209/6201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:47 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:48.437888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:48.438560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:48.445426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:48.445956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:48.446407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:48.447109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:48.447580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:48.448018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:48.574036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:48.582227 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a94c516-188c-4903-9257-e8b796151a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.148247 Aug 24 02:40:48.582805 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5210/6202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:48 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:49.604878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:49.605531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:49.613093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:49.613601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:49.614247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:49.614957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:49.615436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:49.615881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:49.620086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:40:50.082508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:50.090259 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4be076a-9725-4b72-9b76-a6bd6a9a3527 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1696 microversion: 2.1 time: 0.489359 Aug 24 02:40:50.090849 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5211/6203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:49 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1696 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:51.112873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:51.113549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:51.120981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:51.121484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:51.121933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:51.122640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:51.123164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:51.123608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:51.257614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:51.266025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3dca79ae-caf0-4149-a4db-c773818905ee tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1695 microversion: 2.1 time: 0.157071 Aug 24 02:40:51.266613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5212/6204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:51 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:51.354436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-unplugged", "status": "completed", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:51.365030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:51.365524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:51.365973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:51.377620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Creating event network-vif-unplugged:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h1-854121-3 Aug 24 02:40:51.382930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:40:51.395443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0c6cc626-5229-4f97-a317-4e54d88a2a31 req-4bc93cd3-6582-49fb-a1bc-ad1beb7da7fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044789 Aug 24 02:40:51.396060 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5213/6205] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:40:52.288105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:52.288946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:52.296784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:52.297295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:52.297754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:52.298494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:52.298997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:52.299479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:52.434990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:52.442836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f014b9b-22d3-4322-959a-73fc83477f3a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1695 microversion: 2.1 time: 0.159131 Aug 24 02:40:52.443407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5214/6206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:52 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:53.417703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:53.428389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:53.428931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:53.429502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:53.440875 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Creating event network-changed:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h1-854121-3 Aug 24 02:40:53.446018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:40:53.456565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c3412bff-65c3-4c90-a328-e85d17c3ade2 req-56a07e2b-edd5-4d91-bbbf-40d3fac6b530 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042721 Aug 24 02:40:53.457179 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5215/6207] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:40:53.465273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:53.465988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:53.472899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:53.473401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:53.473860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:53.474596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:53.475072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:53.475514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:53.606342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:53.614857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74e8f3ed-b3b8-4330-b7c3-99d8e79d2793 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1693 microversion: 2.1 time: 0.153704 Aug 24 02:40:53.615440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5216/6208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:53 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:54.636678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:54.637389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:54.644168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:54.644667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:54.645146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:54.645856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:54.646323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:54.646769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:54.778561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:54.786852 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e095073f-93aa-498c-b0b5-edcea60811a9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1693 microversion: 2.1 time: 0.154108 Aug 24 02:40:54.787425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5217/6209] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:54 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:55.809259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:55.809901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:55.817428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:55.817936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:55.818398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:55.819172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:55.819652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:55.820106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:55.951303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:55.959084 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-382b75e6-e56c-41dd-9279-b7137553896d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1690 microversion: 2.1 time: 0.153743 Aug 24 02:40:55.959658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5218/6210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:55 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:55.979503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:55.980051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:55.986377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:55.986880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:55.987330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:55.988033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:55.988503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:55.988972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:56.094652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb40f3d5-e04a-4f2c-90b8-8d49c2219ce3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action" status: 202 len: 0 microversion: 2.1 time: 0.118181 Aug 24 02:40:56.095263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5219/6211] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:40:55 2022] POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:40:56.104746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:56.105459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:56.112831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:56.113610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:56.114910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:56.116064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:56.116694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:56.117181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:56.262288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:56.271338 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72b94683-51af-4b42-a51c-41d5ecb9341f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.171518 Aug 24 02:40:56.272264 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5220/6212] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:56 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:57.292793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:57.293409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:57.300281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:57.300817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:57.301272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:57.301982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:57.302445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:57.302882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:57.435562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:57.443924 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-303ded2b-fb79-429a-bffc-cb44ccbac8aa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.154994 Aug 24 02:40:57.444428 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5221/6213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:57 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:58.360192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-plugged", "status": "completed", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:58.370406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:58.370919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:58.371360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:58.383068 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Creating event network-vif-plugged:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h1-854121-3 Aug 24 02:40:58.388405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:40:58.399413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ba9c48cf-19b1-40f9-a417-fa046c34dc2e req-f1114d9d-8bf8-4ea9-80e5-c41ced2b25fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042933 Aug 24 02:40:58.400010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5222/6214] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:40:58.465602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:58.466254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:58.472706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:58.473226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:58.473677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:58.474373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:58.474837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:58.475276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:58.611659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:58.619441 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eff95d3-004c-43b9-99ee-a2cbd433ba07 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.158206 Aug 24 02:40:58.620003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5223/6215] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:58 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:40:59.572430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-unplugged", "status": "completed", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:40:59.583366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:59.583864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:59.584312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:59.596475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Creating event network-vif-unplugged:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:40:59.601914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:40:59.614547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d10973c8-cff3-42ae-a447-52ab6eca7430 req-381223c7-a7e2-4237-8dc2-065a8e949b14 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045719 Aug 24 02:40:59.615174 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5224/6216] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:40:59.641722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:40:59.642431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:40:59.648519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:59.649049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:59.649496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:59.650198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:40:59.650669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:40:59.651107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:40:59.792289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:40:59.800805 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bfbfab6-db64-458f-b7ee-4ea2f811c4c8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.163204 Aug 24 02:40:59.801391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5225/6217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:40:59 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:41:00.822919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:41:00.823589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:00.830946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:00.831439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:00.831890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:00.832593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:00.833083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:00.833521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:00.960862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:41:00.968556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-672cfc32-b982-4283-8417-fec699f8a381 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.149558 Aug 24 02:41:00.969150 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5226/6218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:41:00 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:41:01.651883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:41:01.662569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:01.663062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:01.663501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:01.675877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Creating event network-changed:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:41:01.678420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:01.682212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:41:01.692857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a56e49a5-2405-4106-957b-871e7bfc4403 req-0f91bf8e-22e6-48e9-abb3-bdbe6f174c47 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044657 Aug 24 02:41:01.693450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5227/6219] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:41:01.992595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:41:01.993344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:02.001330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:02.001831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:02.002290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:02.003009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:02.003475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:02.003919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:02.139172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:41:02.147017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-30366377-4bd6-4f38-9f65-7464528c639f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.160003 Aug 24 02:41:02.147587 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5228/6220] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:41:01 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:41:03.168744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:41:03.169385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:03.176150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:03.176593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:03.177157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:03.177789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:03.178261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:03.178705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:03.322712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:41:03.331705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5490f360-1fc8-4268-99b3-7ad9eb5bc163 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1689 microversion: 2.1 time: 0.165967 Aug 24 02:41:03.332325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5229/6221] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:41:03 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:41:04.355157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:41:04.355842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:04.363239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:04.363738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:04.364188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:04.364916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:04.365383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:04.365817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:04.495514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:41:04.503396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2e57bb0-9a07-484f-8be5-2de68623d480 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1682 microversion: 2.1 time: 0.152084 Aug 24 02:41:04.503977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5230/6222] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:41:04 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:41:06.106211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-plugged", "status": "completed", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:41:06.113180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=77 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:06.119853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:06.120338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:06.120826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:06.132815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] Creating event network-vif-plugged:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:41:06.137770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5296b164-3e53-4008-8972-6edf8a5df3f0 req-e4cfd874-b67e-49f2-b0bc-12699e936d76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035583 Aug 24 02:41:06.139324 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5231/6223] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:41:36.725139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:36.725885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=21 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:36.785516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:41:36.787928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:36.794136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:36.794640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:36.795092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:36.795797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:36.796267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:36.796705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:36.868442 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5bed7970-e033-4443-99a9-f22626e7b0cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action" status: 200 len: 62187 microversion: 2.1 time: 0.145288 Aug 24 02:41:36.869104 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5232/6224] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:41:36 2022] POST /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb/action => generated 62187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:41:59.867126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:59.867876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:41:59.917577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:41:59.918388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:41:59.924566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:59.925108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:59.925562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:41:59.926265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:41:59.926737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:41:59.927176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:00.105503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0e3e84e1-a1fe-4da0-8951-2167a73a2e00 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1833 microversion: 2.1 time: 0.243673 Aug 24 02:42:00.106080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5233/6225] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:41:59 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1833 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:00.949839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:00.950469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:00.957672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:00.958269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:00.958793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:00.959576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:00.960122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:00.960639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:00.986814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:42:01.067708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-798fa89f-54d3-4b66-9ec2-719db8f277e8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 204 len: 0 microversion: 2.1 time: 0.122366 Aug 24 02:42:01.071472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5234/6226] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:42:00 2022] DELETE /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:42:01.075020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:01.085021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:01.085514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:01.085961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:01.097190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] Creating event network-changed:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:42:01.101992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f69623ae-d15a-438c-aa95-37a3810a965e req-458b3da1-8519-485e-a391-fa86185b5a04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032224 Aug 24 02:42:01.102584 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5235/6227] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:42:01.107793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:01.108501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:01.114632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:01.115134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:01.115597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:01.116309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:01.116806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:01.117254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:01.256182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:01.264506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9464499e-2418-424f-a4c1-dd719f504c72 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1688 microversion: 2.1 time: 0.160509 Aug 24 02:42:01.265109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5236/6228] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:01 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:42:02.286661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:02.287346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:02.294655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:02.295155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:02.295609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:02.296320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:02.296814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:02.297258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:02.433656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:02.441543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed233460-091b-484d-8f40-aa9ba74833ed tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1688 microversion: 2.1 time: 0.158771 Aug 24 02:42:02.442322 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5237/6229] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:02 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:03.401654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b9eb72-f84f-4879-abaf-298e95a2d6fb", "name": "network-vif-deleted", "tag": "27eb7469-0c72-4ed2-b631-b6692e1ccf67"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:03.416089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:03.417093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:03.417914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:03.431476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] Creating event network-vif-deleted:27eb7469-0c72-4ed2-b631-b6692e1ccf67 for instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb on n-h2-854121-3 Aug 24 02:42:03.436113 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-94ad27db-e5f6-4d55-9bb8-62c0c46bc03f req-3715641a-baac-4fa8-807e-e59792d9e281 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038697 Aug 24 02:42:03.436729 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5238/6230] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:42:03.464050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:03.464795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:03.471256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:03.471772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:03.472230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:03.473326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:03.473797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:03.474238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:03.543105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:03.551031 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f747bd72-fcc8-4c95-93d3-4739f6015f61 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 200 len: 1351 microversion: 2.1 time: 0.091725 Aug 24 02:42:03.551807 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5239/6231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:03 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:04.572321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:04.573013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: d2b9eb72-f84f-4879-abaf-298e95a2d6fb] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:04.579886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:04.580375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:04.580867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:04.581579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:04.582053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:04.582500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:04.596300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] HTTP exception thrown: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Request method failure captured: Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb HTTP/1.1 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY6mcUK6SKBWmvGe6pxFXCLvrQ-NcpjutPmJzGb9LWF4SnvvrFX9F3Ge0ycTQ5AfFQclVFVhtPR1AXmH3i54fXSF-1Xc_FJBVF4HGAu9bPK1YJMPZDMpyRQfxj1rjt50R-wmtSTDn5CqMpEEMpLwJFjZo-z1jYOSKF1HfjMaAwbfTcA Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5931e5875204084b37acf023dd23685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5931e5875204084b37acf023dd23685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14e74d8577a94089a96fb2fd9b08b02c Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd2b9eb72-f84f-4879-abaf-298e95a2d6fb'} Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:42:04.597999 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Returning 404 to user: Instance d2b9eb72-f84f-4879-abaf-298e95a2d6fb could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9d7cb15-c1e1-4259-8da5-bc14825f4041 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb" status: 404 len: 111 microversion: 2.1 time: 0.030844 Aug 24 02:42:04.604493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5240/6232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:04 2022] GET /compute/v2.1/servers/d2b9eb72-f84f-4879-abaf-298e95a2d6fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:42:07.538586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce62a0ea-39fe-4a42-a1fe-016a2b41bf59 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '.version_select at 0x7f6b91004ca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:07.543832 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce62a0ea-39fe-4a42-a1fe-016a2b41bf59 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [f453edae-6459-4870-82e9-e93e63086404] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 02:42:08.551495 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce62a0ea-39fe-4a42-a1fe-016a2b41bf59 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [f453edae-6459-4870-82e9-e93e63086404] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44286. Aug 24 02:42:08.570946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce62a0ea-39fe-4a42-a1fe-016a2b41bf59 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1867714218" status: 202 len: 0 microversion: 2.1 time: 1.036513 Aug 24 02:42:08.571526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5241/6233] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 02:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1867714218 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 02:42:08.607803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7872049-4ce4-4b3c-8f09-0dde6a77d516 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: .version_select at 0x7f6b91004c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1187651371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaHvcdevbEJK5U5W/3eSx7f7PPvScnkORZWK1N9xzdRpTAzknhku518vRYginarmDF2PaLs7wGo6XXtHQRC8mrN1UAS9ecdjqLx14Ati42I8rqTf9WvZbeNnOg1ldAs+w=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:08.623287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d7872049-4ce4-4b3c-8f09-0dde6a77d516 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:42:08.628461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d7872049-4ce4-4b3c-8f09-0dde6a77d516 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:42:08.651455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7872049-4ce4-4b3c-8f09-0dde6a77d516 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048402 Aug 24 02:42:08.652055 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5242/6234] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:42:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:42:14.051906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-48162769", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "18437902-d934-4f83-9200-a47a4641dedb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1187651371", "security_groups": [{"name": "tempest-secgroup-smoke-1070874664"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:14.170319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] validate_networks() for [('18437902-d934-4f83-9200-a47a4641dedb', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:42:14.581670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:42:14.582368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:42:14.582864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:42:14.583320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:42:14.583928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:42:14.587136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:42:14.604897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:14.605523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:14.606072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:14.606896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:14.607366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:14.608465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:14.631226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:42:14.637521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:42:14.650126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:42:14.652482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:42:14.699902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a7e9599-5f7a-454b-b414-e4a69b375fc9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653464 Aug 24 02:42:14.701213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5243/6235] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:42:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:42:14.715361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-064393a9-5b3b-4b90-88c0-f44c18d7ce4c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:14.716078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-064393a9-5b3b-4b90-88c0-f44c18d7ce4c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:14.774720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-064393a9-5b3b-4b90-88c0-f44c18d7ce4c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:14.781812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-064393a9-5b3b-4b90-88c0-f44c18d7ce4c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1265 microversion: 2.1 time: 0.073619 Aug 24 02:42:14.782383 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5244/6236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:14 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:15.806074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c9ef924-fea0-45f2-a1e1-3839a75ec9cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:15.807537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c9ef924-fea0-45f2-a1e1-3839a75ec9cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:15.870369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c9ef924-fea0-45f2-a1e1-3839a75ec9cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:15.878401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c9ef924-fea0-45f2-a1e1-3839a75ec9cb tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1265 microversion: 2.1 time: 0.076383 Aug 24 02:42:15.887425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5245/6237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:15 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:16.902292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d85e9af2-03ba-4a4c-915b-49cf076dbded tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:16.902973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d85e9af2-03ba-4a4c-915b-49cf076dbded tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:16.969597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d85e9af2-03ba-4a4c-915b-49cf076dbded tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:16.977303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d85e9af2-03ba-4a4c-915b-49cf076dbded tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1265 microversion: 2.1 time: 0.079002 Aug 24 02:42:16.978472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5246/6238] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:16 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:17.999272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb385f53-dc41-4782-ae8a-c4cc53b89629 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:17.999912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb385f53-dc41-4782-ae8a-c4cc53b89629 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:18.051747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb385f53-dc41-4782-ae8a-c4cc53b89629 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:18.059737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb385f53-dc41-4782-ae8a-c4cc53b89629 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1265 microversion: 2.1 time: 0.065025 Aug 24 02:42:18.060294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5247/6239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:17 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:19.080233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:19.080913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:19.087866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:19.088368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:19.088855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:19.089572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:19.090046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:19.090490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:19.151014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:19.159143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5287f6f8-7768-413c-9fde-dbb978399191 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1269 microversion: 2.1 time: 0.082907 Aug 24 02:42:19.159710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5248/6240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:19 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:20.180624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:20.181415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:20.189033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:20.189529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:20.189976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:20.190685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:20.191173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:20.191607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:20.260055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:20.268226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7dfcc0b-1e2b-404f-9556-f7486a623f19 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1323 microversion: 2.1 time: 0.091649 Aug 24 02:42:20.268814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5249/6241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:20 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:21.289086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:21.300477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:21.301178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:21.301626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:21.312818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] Creating event network-changed:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h1-854121-3 Aug 24 02:42:21.317544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9bd555a0-de13-4fb0-99a5-701dbe069057 req-26972c55-fca5-4431-b249-09cef6c57315 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Aug 24 02:42:21.318141 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5250/6242] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:42:21.323097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:21.324128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:21.330937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:21.331624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:21.332293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:21.333051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:21.333523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:21.333966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:21.469358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:21.477550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e4f4700-397f-4976-8d1f-ed885c4b9c85 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.158198 Aug 24 02:42:21.478159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5251/6243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:21 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:42:22.500179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:22.500872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:22.507618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:22.508122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:22.508578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:22.509323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:22.509797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:22.510244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:22.637670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:22.645450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d6517f2-ba13-48d0-9fdc-080b88839e8d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.149864 Aug 24 02:42:22.646021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5252/6244] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:22 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:23.665615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:23.666269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:23.673144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:23.673648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:23.674103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:23.674815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:23.675285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:23.675731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:23.808318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:23.817333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d0759e2-a053-4021-bc64-79cb53e6ee24 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.155594 Aug 24 02:42:23.818268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5253/6245] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:23 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:24.839462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:24.840151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:24.842213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:42:24.848771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:24.849285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:24.849747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:24.850466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:24.850942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:24.851393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:24.984844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:24.993249 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2cb0917-fb65-41d6-b811-7e6d65cc6fd9 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.157038 Aug 24 02:42:24.993249 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5254/6246] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:24 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:26.014398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:26.015007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:26.021887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:26.022388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:26.022843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:26.023551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:26.024025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:26.024469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:26.154207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:26.162424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b288249-1e7f-4e72-8981-c0d42806e175 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.152102 Aug 24 02:42:26.163026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5255/6247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:26 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:26.924405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "name": "network-vif-plugged", "status": "completed", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:26.934603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:26.935124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:26.935581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:26.946700 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] Creating event network-vif-plugged:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h1-854121-3 Aug 24 02:42:26.951548 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-aa680ad4-6037-4288-a7e0-4f2c92c91908 req-76f67442-6750-4ba1-943b-414978421505 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031543 Aug 24 02:42:26.952317 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5256/6248] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:42:27.184806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:27.185524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:27.191811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:27.192310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:27.192797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:27.193503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:27.194005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:27.194447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:27.323126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:27.331331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c8fac3b-4b77-4ec8-ab55-192079b84357 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.151597 Aug 24 02:42:27.331898 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5257/6249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:27 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:42:28.352665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:28.353637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:28.355525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=18 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:42:28.361563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:28.362058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:28.362504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:28.363204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:28.363667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:28.364102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:28.500346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:28.508011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e96b3d9f-4506-44db-bfa9-d10eca4d6e78 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1391 microversion: 2.1 time: 0.159169 Aug 24 02:42:28.508588 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5258/6250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:28 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:29.528943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:29.529661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:29.536257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:29.536772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:29.537222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:29.537918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:29.538381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:29.538818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:29.669370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:29.677699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2dbcf2a0-97e4-4d3d-9ded-e1e1920c36e7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1563 microversion: 2.1 time: 0.152728 Aug 24 02:42:29.678276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5259/6251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:29 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:29.697439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:29.698059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:29.703682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:29.704186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:29.704644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:29.705381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:29.705859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:29.706306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:29.833235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:29.841233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d3bc879-6876-4d74-9169-b61f27a08cc6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1563 microversion: 2.1 time: 0.147210 Aug 24 02:42:29.841816 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5260/6252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:29 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1563 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:31.381176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:42:31.381842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:42:31.384634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:42:31.390007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:31.390511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:31.390967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:31.391684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:31.392157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:31.392602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:31.531202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:42:31.539139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c62282f-feea-425c-9e00-b02632460af3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1563 microversion: 2.1 time: 0.162202 Aug 24 02:42:31.539717 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5261/6253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:42:31 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:42:31.544161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:42:31.553358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:42:31.553848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:42:31.554290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:42:31.565439 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] Creating event network-changed:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h1-854121-3 Aug 24 02:42:31.570936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-67bcaf9f-1e9f-41ef-bc97-ff425de0e9ba req-589f996e-4aa8-4e6f-8db6-e186eb496378 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030080 Aug 24 02:42:31.572162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5262/6254] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:43:06.837310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:43:06.839573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:06.842045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:43:06.842706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=80 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:43:06.849024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:06.849555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:06.850010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:06.850724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:06.851199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:06.851671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:06.919153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-310658dd-b10d-4134-b9b4-f047282ca951 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action" status: 200 len: 24566 microversion: 2.1 time: 0.086565 Aug 24 02:43:06.920105 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5263/6255] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:43:06 2022] POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action => generated 24566 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:43:45.964031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:45.964807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:45.967230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:43:45.968017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:43:45.975185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:45.975694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:45.976148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:45.976915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:45.977386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:45.977827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.125853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:46.133822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6bc06152-b952-4c98-9cc7-fb78b259189f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1682 microversion: 2.1 time: 0.174110 Aug 24 02:43:46.134401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5264/6256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:45 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:46.233587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:43:46.236005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:46.242600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.243106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.243569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.244292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.244793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.245240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.316867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74dc4196-7934-4cd6-b50e-a0c604382c34 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action" status: 200 len: 32647 microversion: 2.1 time: 0.087353 Aug 24 02:43:46.317551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5265/6257] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:43:46 2022] POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action => generated 32647 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:43:46.464268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:46.465013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:46.472439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.472899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.473354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.474073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.474546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.474986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.615959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2afc0ea9-7eba-49e5-a32f-40c51e23dc14 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1833 microversion: 2.1 time: 0.155696 Aug 24 02:43:46.616514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5266/6258] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:46 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1833 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:46.644331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:43:46.646955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:46.653049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.653543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.653989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.654696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:46.655163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:46.655646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:46.681688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lazy-loading 'flavor' on Instance uuid 35e49b33-07d8-481c-8265-9c6570f40196 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:43:46.696056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Going to try to live migrate instance to another host {{(pid=128567) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 24 02:43:48.534908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e25bb9b9-f58a-4516-9f6e-fb3007d3d852 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action" status: 202 len: 0 microversion: 2.1 time: 1.894301 Aug 24 02:43:48.540755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5267/6259] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:43:46 2022] POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action => generated 0 bytes in 1901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:43:48.548358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:48.551212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:48.560005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:48.561662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:48.563535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:48.565126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:48.565892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:48.566759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:48.735613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:48.744090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a60208e2-bf1f-4c9e-a7b2-786e5708060c tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.201889 Aug 24 02:43:48.744695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5268/6260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:48 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:43:49.766521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:49.767325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:49.775334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:49.775953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:49.776455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:49.777309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:49.777778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:49.778273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:49.947847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:49.962380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-094c52ea-08ee-435a-b382-a00199eaf705 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.199444 Aug 24 02:43:49.963519 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5269/6261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:49 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:50.102691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:43:50.113839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:50.114434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:50.114811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:50.127329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] Creating event network-vif-unplugged:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h1-854121-3 Aug 24 02:43:50.133433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-dc3d1037-503b-4bda-948b-ac001954555e req-e8929fde-8089-4595-a2bc-a82633c0f874 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035590 Aug 24 02:43:50.135680 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5270/6262] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:43:50.988503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:50.989189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:50.995451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:50.995956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:50.996410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:50.997163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:50.997641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:50.998087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:51.155680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:51.164988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bef74e90-f68b-44e0-bc2c-e5d0946edbc4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.182116 Aug 24 02:43:51.165582 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5271/6263] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:50 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:52.149875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:43:52.160576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:52.161175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:52.161659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:52.173539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] Creating event network-changed:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h1-854121-3 Aug 24 02:43:52.178619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3a67c90c-7721-45a0-84b7-6614e0c3c296 req-4aa0e86f-18a5-4724-8c92-554a839968f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032509 Aug 24 02:43:52.179231 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5272/6264] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:43:52.189738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:52.190448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:52.196694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:52.197222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:52.197672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:52.198382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:52.198848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:52.199291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:52.357613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:52.366807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be532dd2-3879-4d3c-a8eb-b04a6cdad48d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.181857 Aug 24 02:43:52.367399 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5273/6265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:52 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:43:53.391213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:53.392246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:53.399959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:53.400495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:53.401008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:53.401760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:53.402259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:53.402734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:53.547444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:53.558709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7fbcfd5-eaba-4955-89d9-9f2589b8ea6f tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.173433 Aug 24 02:43:53.559450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5274/6266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:53 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:43:54.583702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:54.584465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:54.591678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:54.592765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:54.593246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:54.593963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:54.594464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:54.594906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:54.737308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:54.745157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb5e1011-ff55-4054-a85f-9c623920c097 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.165490 Aug 24 02:43:54.745734 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5275/6267] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:54 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:55.769796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:55.770556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:55.777864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:55.778380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:55.778837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:55.779570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:55.780625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:55.781103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:55.945289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:55.954165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f6b5cf7-b19e-4e8b-bf33-0c2ba216e012 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.188270 Aug 24 02:43:55.954794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5276/6268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:55 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:56.976605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:56.977431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:56.984863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:56.985370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:56.985828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:56.986540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:56.987015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:56.987509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:57.135693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:57.143787 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ead5fc8f-3a63-43c5-8a5c-b3f35a1aa972 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.171096 Aug 24 02:43:57.144385 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5277/6269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:56 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:58.165808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:58.166545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:58.174016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:58.174553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:58.175046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:58.175789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:58.176259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:58.176749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:58.329126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:58.338770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-488f52c5-ef71-4eb9-9067-067e29572602 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.176895 Aug 24 02:43:58.339351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5278/6270] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:58 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:43:59.364348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:43:59.365298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:43:59.379718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:59.380865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:59.381529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:59.382600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:43:59.383289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:43:59.383910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:43:59.538664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:43:59.547484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53713c00-0e38-45ee-96ca-c40e935d9234 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.187546 Aug 24 02:43:59.548076 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5279/6271] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:43:59 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:00.570639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:00.571361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:00.580519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:00.581080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:00.581605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:00.582478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:00.583103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:00.583616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:00.602512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:44:00.744647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:00.754965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-510c2bae-72ad-441a-afc8-3b31c5d17ca5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1692 microversion: 2.1 time: 0.188129 Aug 24 02:44:00.755989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5280/6272] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:00 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:01.785894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:01.786594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:01.794443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:01.794952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:01.795423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:01.796146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:01.796613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:01.797084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:01.939230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:01.947263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67d9f0d0-f3b2-45d3-87eb-cfa5168ff5e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1682 microversion: 2.1 time: 0.166343 Aug 24 02:44:01.947845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5281/6273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:01 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:01.967926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:01.968551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:01.974656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:01.975155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:01.975612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:01.976325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:01.976822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:01.977278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:02.123219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5aa0b837-e023-41eb-b08f-fc95c7935bc3 tempest-TestNetworkAdvancedServerOps-1756929862 tempest-TestNetworkAdvancedServerOps-1756929862-project-admin] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1833 microversion: 2.1 time: 0.159254 Aug 24 02:44:02.124381 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5282/6274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:01 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1833 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:02.153582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:02.154440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:02.162662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:02.163416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:02.164056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:02.164996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:02.165577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:02.166203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:02.323365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:02.331563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe84b8d7-6674-41f0-aa63-9d8e7adec4e3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1682 microversion: 2.1 time: 0.183216 Aug 24 02:44:02.332133 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5283/6275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:02 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:02.433321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:02.435538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:02.443157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:02.443662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:02.444122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:02.444867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:02.445343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:02.445857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:02.506688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d0d8788-cdfa-4aba-9ab7-29876596c2bd tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action" status: 200 len: 38350 microversion: 2.1 time: 0.077966 Aug 24 02:44:02.507258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5284/6276] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:44:02 2022] POST /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196/action => generated 38350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 02:44:06.888110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:06.889501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:06.897597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:06.898109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:06.898566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:06.899326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:06.899796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:06.900241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:06.931204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:44:07.016855 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9159875-9e97-4315-b06a-b759894577c1 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 204 len: 0 microversion: 2.1 time: 0.132761 Aug 24 02:44:07.017612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5285/6277] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:44:06 2022] DELETE /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:44:07.089300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:07.101594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:07.102152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:07.102600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:07.114525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] Creating event network-changed:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h2-854121-3 Aug 24 02:44:07.119856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cf0a475a-df5f-4a8f-b70a-1668b3e1bf46 req-9f7e0b03-1fc1-4b67-8043-65eb97d402fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100914 Aug 24 02:44:07.120537 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5286/6278] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:44:07.127546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:07.128271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:07.134631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:07.135138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:07.137041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:07.137041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:07.137041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:07.137931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:07.297465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:07.309867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d57d7f75-e00b-4a68-935e-425eed38ec17 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1688 microversion: 2.1 time: 0.187174 Aug 24 02:44:07.310500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5287/6279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:07 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:44:08.338120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:08.338858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:08.348667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:08.349201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:08.349652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:08.350369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:08.350830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:08.351269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:08.426691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:08.436341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2e246edb-652c-4b85-9f26-26e972786370 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 200 len: 1501 microversion: 2.1 time: 0.102432 Aug 24 02:44:08.437053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5288/6280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:08 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 1501 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:08.470180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35e49b33-07d8-481c-8265-9c6570f40196", "name": "network-vif-deleted", "tag": "cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:08.482231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:08.482773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:08.483207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:08.495151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] Creating event network-vif-deleted:cfd7fcd8-0c6d-4af4-a3d7-849dffbf006d for instance 35e49b33-07d8-481c-8265-9c6570f40196 on n-h2-854121-3 Aug 24 02:44:08.500032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7d77021b-425c-4393-97a0-0b9feed8ff41 req-b22d9dbf-6d86-488b-bd7f-d06d870e0c18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Aug 24 02:44:08.500885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5289/6281] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:44:09.460689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:09.461525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 35e49b33-07d8-481c-8265-9c6570f40196] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:09.468202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:09.468738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:09.469237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:09.469984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:09.470501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:09.470959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:09.485552 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] HTTP exception thrown: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Request method failure captured: Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 HTTP/1.1 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY6mcUK6SKBWmvGe6pxFXCLvrQ-NcpjutPmJzGb9LWF4SnvvrFX9F3Ge0ycTQ5AfFQclVFVhtPR1AXmH3i54fXSF-1Xc_FJBVF4HGAu9bPK1YJMPZDMpyRQfxj1rjt50R-wmtSTDn5CqMpEEMpLwJFjZo-z1jYOSKF1HfjMaAwbfTcA Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5931e5875204084b37acf023dd23685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5931e5875204084b37acf023dd23685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14e74d8577a94089a96fb2fd9b08b02c Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '35e49b33-07d8-481c-8265-9c6570f40196'} Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:44:09.487307 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Returning 404 to user: Instance 35e49b33-07d8-481c-8265-9c6570f40196 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0f3d77e-3dc1-4212-823b-5f2fee8f99ea tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196" status: 404 len: 111 microversion: 2.1 time: 0.033537 Aug 24 02:44:09.492683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5290/6282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:09 2022] GET /compute/v2.1/servers/35e49b33-07d8-481c-8265-9c6570f40196 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:44:12.773073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0da82aa9-b513-4d2a-80d9-d3e130188787 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '.version_select at 0x7f6b9125a040>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:12.803596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0da82aa9-b513-4d2a-80d9-d3e130188787 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1187651371" status: 202 len: 0 microversion: 2.1 time: 0.036008 Aug 24 02:44:12.804755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5291/6283] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 02:44:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1187651371 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:44:12.837622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52ad0b48-fda4-44b4-8d00-2b0cf54674e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: .version_select at 0x7f6b9046c940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-914052631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS2w5nU3I51Kf1PA5p2o1zoerYGXYeD5EAx6aLyXzIlrtthv5ksO+MTYGxR5nj6ZB+FWvqbw/cwadme0LCIIOpp4W9/JfaWF+ieTepHYgRytSaNZd6Y7LaLo3g+EtuWiQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:12.855097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-52ad0b48-fda4-44b4-8d00-2b0cf54674e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:44:12.861559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-52ad0b48-fda4-44b4-8d00-2b0cf54674e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:44:12.891992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52ad0b48-fda4-44b4-8d00-2b0cf54674e4 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.058284 Aug 24 02:44:12.893089 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5292/6284] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:44:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:44:19.178178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-876672446", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "0bb9dec9-cc46-4614-8aa5-8b714997cfea"}], "key_name": "tempest-TestNetworkAdvancedServerOps-914052631", "security_groups": [{"name": "tempest-secgroup-smoke-601044962"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:19.188943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:44:19.350152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] validate_networks() for [('0bb9dec9-cc46-4614-8aa5-8b714997cfea', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:44:19.476042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:44:19.858390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:44:19.859255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:44:19.859970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:44:19.860626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:44:19.861630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:44:19.875521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:19.876497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:19.877227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:19.878597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:19.879352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:19.880033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:19.905616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:44:19.912059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Getting quotas for user 14e74d8577a94089a96fb2fd9b08b02c and project c5931e5875204084b37acf023dd23685. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:44:19.928500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:44:19.931273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:44:19.995646 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91d37b3e-2ee3-4ab4-a3fc-af59fe4425a7 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821831 Aug 24 02:44:19.996370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5293/6285] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:44:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:44:20.010690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02ec7e10-4da5-4978-acc8-f7e851a061d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:20.011597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02ec7e10-4da5-4978-acc8-f7e851a061d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:20.086091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02ec7e10-4da5-4978-acc8-f7e851a061d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:20.096904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02ec7e10-4da5-4978-acc8-f7e851a061d6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1265 microversion: 2.1 time: 0.092247 Aug 24 02:44:20.097517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5294/6286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:20 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:21.128785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:21.130287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:21.140751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:21.142649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:21.143231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:21.144142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:21.145284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:21.146396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:21.231071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:21.242469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80f943f3-e86b-4a82-8cd3-5c095f0a6093 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1325 microversion: 2.1 time: 0.123245 Aug 24 02:44:21.252134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5295/6287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:21 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1325 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:22.273102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:22.274676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:22.286932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:22.287463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:22.289200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:22.293913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:22.294675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:22.295540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:22.457370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:22.468044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eff58405-bd0a-4e4e-a810-0b9c181c054d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.199221 Aug 24 02:44:22.470797 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5296/6288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:22 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:22.963887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:22.974038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:22.974604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:22.974989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:22.986689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] Creating event network-changed:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:44:22.991684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e7c0d831-e242-4168-9b62-9a2944bf667e req-a7c87f6a-5e3b-4441-932b-4574f9a07a6a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099579 Aug 24 02:44:22.992282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5297/6289] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:44:23.492281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:23.492960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:23.500118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:23.500617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:23.501093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:23.501798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:23.502265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:23.502697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:23.652153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:23.660844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e90aa6d-dbfb-4ba4-8b12-bd26d2747265 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.172309 Aug 24 02:44:23.661450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5298/6290] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:23 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:24.688109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:24.688789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:24.695808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:24.696338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:24.696809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:24.697517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:24.697979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:24.698412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:24.833168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:24.841017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5276bd9-09cb-4b0f-b130-b23d94a25647 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.157325 Aug 24 02:44:24.841597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5299/6291] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:24 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:25.862938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:25.863739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:25.870785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:25.871284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:25.871732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:25.872443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:25.873463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:25.874050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:26.020492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:26.028858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-42a3ed22-cf8c-48b0-b5cf-501efa96fa14 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.170053 Aug 24 02:44:26.029543 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5300/6292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:25 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:44:27.050049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:27.050711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:27.057596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:27.058100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:27.058552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:27.059295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:27.059763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:27.060204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:27.198442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:27.207963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-747790ad-5342-4946-9564-29a4fa7b0b27 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.161819 Aug 24 02:44:27.208563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5301/6293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:27 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:28.229774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:28.230431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:28.238615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:28.239115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:28.239561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:28.240279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:28.240768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:28.241438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:28.383008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:28.392063 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6583032-eedf-44f7-b338-f253a826e7fc tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.165963 Aug 24 02:44:28.392670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5302/6294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:28 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:28.944317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "name": "network-vif-plugged", "status": "completed", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:28.954928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:28.955445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:28.955894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:28.967581 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] Creating event network-vif-plugged:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:44:28.972629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9af9949b-05fe-471c-828a-24b39438a46f req-032713b9-ae38-438a-b028-d4d46119fd2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096301 Aug 24 02:44:28.973261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5303/6295] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:44:29.414753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:29.415474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:29.422578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:29.423084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:29.423542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:29.424268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:29.424764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:29.425215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:29.562269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:29.570230 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-83a7da19-ceb7-4400-ad3a-e76de559dd9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1390 microversion: 2.1 time: 0.160573 Aug 24 02:44:29.570808 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5304/6296] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:29 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:30.591536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:30.592434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:30.594227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:44:30.595029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:44:30.601769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:30.602268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:30.602714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:30.603420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:30.603883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:30.604316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:30.750111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:30.757976 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-383c9afa-41cc-419c-aaec-84e72f85e0d5 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1562 microversion: 2.1 time: 0.170375 Aug 24 02:44:30.758586 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5305/6297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:30 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:30.780678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:30.781319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:30.787646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:30.789008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:30.789008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:30.789424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:30.789896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:30.790383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:30.932034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:30.940774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-facbc110-a92d-4ead-b398-985e4caddeef tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1562 microversion: 2.1 time: 0.163922 Aug 24 02:44:30.941357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5306/6298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:30 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:32.588450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:44:32.589147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:44:32.597477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:32.598040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:32.599006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:32.600240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:32.600762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:32.601200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:32.747826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:44:32.756641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2727fce-06f8-4bdf-bbbb-4f3c4db2d210 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1562 microversion: 2.1 time: 0.173175 Aug 24 02:44:32.757272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5307/6299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:44:32 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:44:32.762631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:44:32.773332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:44:32.773829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:44:32.774272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:44:32.793150 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] Creating event network-changed:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:44:32.800001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4c427a3c-7719-479f-a984-389f0531fa6b req-ac1f5fc6-7ec3-4ddd-8d6f-4ea9ce6780ab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041049 Aug 24 02:44:32.801197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5308/6300] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:45:08.064000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:45:08.064900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=74 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:45:08.069646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:45:08.071904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:08.079382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:08.079886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:08.080341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:08.081081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:08.081553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:08.082029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:08.152646 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc7e2b3a-91c9-4906-aea7-428228e7f83a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action" status: 200 len: 24563 microversion: 2.1 time: 0.090682 Aug 24 02:45:08.153349 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5309/6301] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:45:08 2022] POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action => generated 24563 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:45:47.244529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:45:47.247401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:47.250300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:45:47.250985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:45:47.257909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.258413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.258866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.259591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.260060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.260508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.345712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:45:47.346150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:45:47.346642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:45:47.347075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:45:47.347511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:45:47.411035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:47.417594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.418108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.418559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.419284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.419749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.420185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.448865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0ef2fe3-a55f-4bba-828a-fdb79730aeaa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action" status: 202 len: 1136 microversion: 2.1 time: 0.209065 Aug 24 02:45:47.449536 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5310/6302] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:45:47 2022] POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action => generated 1136 bytes in 211 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 24 02:45:47.470657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:47.471336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:47.478784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.479295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.479744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.480481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:47.480970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:47.481409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:47.629725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:47.639883 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-11beb4c6-2f97-4e7b-9e64-ac99aeea7d35 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.173889 Aug 24 02:45:47.641073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5311/6303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:47 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:48.661599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:48.662243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:48.669463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:48.669964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:48.670422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:48.671143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:48.672225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:48.672673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:48.808006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:48.816144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-382edfaa-e7b7-4c3c-869a-4e9b79840675 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.158458 Aug 24 02:45:48.816737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5312/6304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:48 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:49.837722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:49.838410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:49.845414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:49.845879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:49.846325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:49.847032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:49.847498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:49.847934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:49.985401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:49.993134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2784490-daf9-4d57-a852-7718a4ae6f9e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.159324 Aug 24 02:45:49.993712 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5313/6305] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:49 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:51.014428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:51.015222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:51.022689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:51.023185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:51.023633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:51.024341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:51.024833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:51.025273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:51.156706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:51.164800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00c0dd6c-9c58-4a22-b0a0-e1abdc24ca6e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.154199 Aug 24 02:45:51.165392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5314/6306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:51 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:52.186364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:52.187640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:52.194573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:52.195071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:52.195519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:52.196319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:52.196908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:52.197388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:52.342873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:52.350923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a23375b3-1818-4dd3-a0b4-aa29d1adc1a3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.168658 Aug 24 02:45:52.351493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5315/6307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:52 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:53.373659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:53.374353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:53.382028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:53.382561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:53.383017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:53.383731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:53.384224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:53.384663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:53.526893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:53.535383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81077997-c4ab-4f5d-82f7-4b64201fb6f2 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.165758 Aug 24 02:45:53.535981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5316/6308] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:53 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:54.557535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:54.558264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:54.565909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:54.566410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:54.566862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:54.567604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:54.568103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:54.568546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:54.702223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:54.710092 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-018771bd-0cba-477f-8801-27b08550e356 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.156488 Aug 24 02:45:54.710669 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5317/6309] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:54 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:55.731839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:55.732852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:55.740001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:55.740513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:55.741028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:55.741760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:55.742236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:55.742687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:55.881026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:55.889218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2826603-9ab0-4cac-8df8-dc9d1b3d6ad8 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.161244 Aug 24 02:45:55.889804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5318/6310] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:55 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:56.912153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:56.912871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:56.919673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:56.920174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:56.920621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:56.921512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:56.921830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:56.922265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:57.057109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:57.065902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0899ea1e-cff2-4d73-aed2-1836ca337281 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.157654 Aug 24 02:45:57.066489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5319/6311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:56 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:58.088020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:58.088746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:58.096455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:58.096988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:58.097450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:58.098171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:58.098643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:58.099087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:58.238775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:58.247012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a849b30-a7d2-4a74-90c3-7e24d955872a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.162881 Aug 24 02:45:58.247607 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5320/6312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:58 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:45:59.268942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:45:59.269616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:45:59.278495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:59.278997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:59.279448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:59.280159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:45:59.281211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:45:59.281653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:45:59.414301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:45:59.422708 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8f19077-ce4c-4db6-8949-9f37219f9afa tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.158147 Aug 24 02:45:59.423285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5321/6313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:45:59 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:00.444267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:00.444997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:00.451842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:00.452341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:00.452826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:00.453529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:00.454003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:00.454445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:00.583798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:00.591598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23ad271c-f43b-410e-bf95-207d978ca484 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.151237 Aug 24 02:46:00.592171 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5322/6314] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:00 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:01.613228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:01.613926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:01.620908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:01.621406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:01.621853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:01.622558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:01.623020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:01.623455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:01.765576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:01.773482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac05ef17-ba8f-454a-a9df-e2a00605df9a tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.164147 Aug 24 02:46:01.774070 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5323/6315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:01 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:02.794909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:02.795620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:02.802445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:02.802945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:02.803401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:02.804115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:02.804588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:02.805065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:02.823096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:46:02.938837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:02.946624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7ff18c35-eadb-4401-b050-47ab94c1801d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.155623 Aug 24 02:46:02.947206 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5324/6316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:02 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:03.969013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:03.969696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:03.976588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:03.977724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:03.978171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:03.978882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:03.979346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:03.979789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:04.119471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:04.127859 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76aac1a5-1028-4808-a28c-c5022d5c8092 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1689 microversion: 2.1 time: 0.162839 Aug 24 02:46:04.128373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5325/6317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:03 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:05.149904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:05.150630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:05.158184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:05.158695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:05.159150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:05.159867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:05.160342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:05.160830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:05.292306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:05.300206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7eaa5c2a-ddd9-40ba-993d-7dc0e2f21912 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1695 microversion: 2.1 time: 0.154221 Aug 24 02:46:05.300985 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5326/6318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:05 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:06.323077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:06.323743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:06.331259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:06.331764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:06.332218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:06.332959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:06.333437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:06.333887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:06.468204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:06.476568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-772b7ba5-1175-49b9-bd62-f805b3bdd6d3 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1695 microversion: 2.1 time: 0.157341 Aug 24 02:46:06.477184 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5327/6319] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:06 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:07.499588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:07.500310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:07.507198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:07.507702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:07.508163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:07.508915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:07.509389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:07.509835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:07.645148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:07.653125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fb88914-c336-4422-a2d4-6828a58c561e tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1695 microversion: 2.1 time: 0.157996 Aug 24 02:46:07.653718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5328/6320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:07 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:46:08.675917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:08.676896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:08.683661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:08.684212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:08.684774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:08.685564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:08.686199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:08.686708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:08.849748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:08.858307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-718a80b9-8457-4b2a-a6d5-fc035b61e879 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1695 microversion: 2.1 time: 0.187161 Aug 24 02:46:08.859392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5329/6321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:08 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:46:09.518145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "name": "network-vif-unplugged", "status": "completed", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:46:09.528341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:09.528873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:09.529351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:09.542140 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] Creating event network-vif-unplugged:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:46:09.547773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-23a08921-ff25-480c-bc8f-a4ea3ef1a25b req-d909da62-6f16-45de-aba8-796398952f04 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033780 Aug 24 02:46:09.548753 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5330/6322] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:46:09.882224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:46:09.883030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:09.889354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:09.890528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:09.891132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:09.891877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:09.892353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:09.892819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:10.039943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:46:10.048284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f9cee0c9-2a25-4da0-bb44-92df39e968b0 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1680 microversion: 2.1 time: 0.171242 Aug 24 02:46:10.049100 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5331/6323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:46:09 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:46:11.790675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "name": "network-vif-plugged", "status": "completed", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:46:11.805473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:11.806155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:11.806788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:11.823453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] Creating event network-vif-plugged:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:46:11.830319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77a1c7b8-8629-4b71-a9af-787dc9c2331b req-d9ac30db-d5d2-4538-99a7-6ad635eedff8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043780 Aug 24 02:46:11.831053 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5332/6324] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:46:50.316131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=50 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:46:50.316943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=42 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:46:50.544869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:46:50.547519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:46:50.554691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:50.555206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:50.555667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:50.556431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:46:50.556947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:46:50.557396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:46:50.629231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e565c4e-a1e6-4765-96fa-f1f056299a74 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action" status: 200 len: 24565 microversion: 2.1 time: 0.315519 Aug 24 02:46:50.629889 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5333/6325] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:46:50 2022] POST /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf/action => generated 24565 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 02:47:23.107398 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:47:23.108181 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:47:30.216616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:30.217234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:30.221728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:47:30.222382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:47:30.227694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:30.228194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:30.228646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:30.229676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:30.230488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:30.230940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:30.260610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:47:30.340956 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abc228bf-283d-49e2-8dcf-741c9c08791d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 204 len: 0 microversion: 2.1 time: 0.128193 Aug 24 02:47:30.341771 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5334/6326] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:47:30 2022] DELETE /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 02:47:30.349076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:47:30.360577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:30.361087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:30.361527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:30.373765 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] Creating event network-changed:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:47:30.378814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ee84da5d-38dc-41bb-9ee3-1e50301ae6f8 req-9996cd1f-d7ed-4b1c-971e-0f6d589dbca3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035629 Aug 24 02:47:30.379430 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5335/6327] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:47:30.384743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:30.385471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:30.392316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:30.393707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:30.393707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:30.394011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:30.394482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:30.394924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:30.589621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:30.598186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80deb7bf-63f3-473d-95fc-639926e180c6 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1686 microversion: 2.1 time: 0.217519 Aug 24 02:47:30.599342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5336/6328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:30 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1686 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:47:31.621844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:31.622565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:31.629988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:31.630488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:31.630931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:31.631627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:31.632087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:31.632525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:31.769808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:31.777856 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c419c213-ec90-4182-b82b-dde7c1e74971 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1686 microversion: 2.1 time: 0.159822 Aug 24 02:47:31.778437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5337/6329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:31 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:47:32.665281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05082e8d-7cd9-4343-a621-1c6d21bc31bf", "name": "network-vif-deleted", "tag": "dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:47:32.677007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:32.677717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:32.678273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:32.690816 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] Creating event network-vif-deleted:dcdcc0c2-b679-46f7-b7d0-67d0cce35b9a for instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf on n-h2-854121-3 Aug 24 02:47:32.695890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a6c3f1f1-bd77-4d4d-bcae-7ae56bd92add req-800201b8-c9a4-4262-84c4-dfcbc2c4e409 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034321 Aug 24 02:47:32.696484 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5338/6330] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:47:32.801171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:32.801911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:32.808142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:32.808646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:32.809123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:32.809834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:32.810399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:32.811118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:32.851405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:32.851405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:32.851405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:32.851405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lazy-loading 'fault' on Instance uuid 05082e8d-7cd9-4343-a621-1c6d21bc31bf {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:47:32.895937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e74d8577a94089a96fb2fd9b08b02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5931e5875204084b37acf023dd23685', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:32.904838 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0ed8e1f-cba0-4368-b6d4-b9ba4274283d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 200 len: 1355 microversion: 2.1 time: 0.108430 Aug 24 02:47:32.905431 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5339/6331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:32 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:33.927092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:33.927785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] [instance: 05082e8d-7cd9-4343-a621-1c6d21bc31bf] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:33.934506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:33.935000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:33.935444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:33.936140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:33.936601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:33.937077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:33.950933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] HTTP exception thrown: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Request method failure captured: Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf HTTP/1.1 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBY6mcUK6SKBWmvGe6pxFXCLvrQ-NcpjutPmJzGb9LWF4SnvvrFX9F3Ge0ycTQ5AfFQclVFVhtPR1AXmH3i54fXSF-1Xc_FJBVF4HGAu9bPK1YJMPZDMpyRQfxj1rjt50R-wmtSTDn5CqMpEEMpLwJFjZo-z1jYOSKF1HfjMaAwbfTcA Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5931e5875204084b37acf023dd23685"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5931e5875204084b37acf023dd23685"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5931e5875204084b37acf023dd23685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: c5931e5875204084b37acf023dd23685 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-487963692 Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 14e74d8577a94089a96fb2fd9b08b02c Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-487963692-project Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05082e8d-7cd9-4343-a621-1c6d21bc31bf'} Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:47:33.952553 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Returning 404 to user: Instance 05082e8d-7cd9-4343-a621-1c6d21bc31bf could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f67af10-787e-4f7e-b2ef-cc11d6d3e37d tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf" status: 404 len: 111 microversion: 2.1 time: 0.030787 Aug 24 02:47:33.958762 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5340/6332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:33 2022] GET /compute/v2.1/servers/05082e8d-7cd9-4343-a621-1c6d21bc31bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:47:37.130408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a93ca72-bc94-4251-9121-c69e1b5bc096 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] Calling method '.version_select at 0x7f6b904c0550>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:37.158425 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a93ca72-bc94-4251-9121-c69e1b5bc096 tempest-TestNetworkAdvancedServerOps-487963692 tempest-TestNetworkAdvancedServerOps-487963692-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914052631" status: 202 len: 0 microversion: 2.1 time: 0.032269 Aug 24 02:47:37.160854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5341/6333] 10.222.0.49 () {58 vars in 1281 bytes} [Wed Aug 24 02:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914052631 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:47:48.631183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:47:48.631945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:47:48.817306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c1b8a75-b939-43fd-877b-1aeed1816cc3 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Action: 'create', calling method: .version_select at 0x7f6b910591f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-379112130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBId++MGfiM1nLtnv8l3JJT0zJx4Bzub+rUjSPMuKf9dfWG8CTpLQZoYOM5lQq9E5yTSMe2yyXz0eJJSa+jMkfof2FfmFeQfWcPHMo2gKzu0JuQL/oWyTSUGjofGgb+7D5w=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:47:48.836829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6c1b8a75-b939-43fd-877b-1aeed1816cc3 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for project 8bdb64a1c610460c95417104d2299251. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:47:48.842345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6c1b8a75-b939-43fd-877b-1aeed1816cc3 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for user 84127fd4762644849357ce9dbfe04f67 and project 8bdb64a1c610460c95417104d2299251. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:47:48.870641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c1b8a75-b939-43fd-877b-1aeed1816cc3 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.241381 Aug 24 02:47:48.871256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5342/6334] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:47:48 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:47:49.897419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1620596934", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-379112130", "security_groups": [{"name": "tempest-secgroup-smoke-569563697"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4a978619-d1bd-4b2f-94e7-f9df0c65d6c6"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:47:50.025507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] validate_networks() for [('4a978619-d1bd-4b2f-94e7-f9df0c65d6c6', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:47:50.527771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for project 8bdb64a1c610460c95417104d2299251. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:47:50.533609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for user 84127fd4762644849357ce9dbfe04f67 and project 8bdb64a1c610460c95417104d2299251. Resources: dict_keys(['metadata_items']) {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:47:50.546804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:47:50.547234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:47:50.548291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:47:50.548740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:47:50.549169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:47:50.558352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:50.558854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:50.559311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:50.560056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:50.560527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:50.560996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:50.577647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for project 8bdb64a1c610460c95417104d2299251. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:47:50.583461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Getting quotas for user 84127fd4762644849357ce9dbfe04f67 and project 8bdb64a1c610460c95417104d2299251. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:47:50.596511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:47:50.598890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:47:50.645620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3689580b-f046-4284-9778-f2f8579208dc tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753219 Aug 24 02:47:50.646568 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5343/6335] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:47:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:47:50.658461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3399aaaf-17d3-4d83-ae52-6c29291f1b15 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:50.659560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3399aaaf-17d3-4d83-ae52-6c29291f1b15 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:50.717047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3399aaaf-17d3-4d83-ae52-6c29291f1b15 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:50.724755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3399aaaf-17d3-4d83-ae52-6c29291f1b15 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1302 microversion: 2.1 time: 0.070882 Aug 24 02:47:50.725455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5344/6336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:50 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1302 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:51.748753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-08e67ab7-1039-48ca-a460-18d04fdf0eeb tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:51.749484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-08e67ab7-1039-48ca-a460-18d04fdf0eeb tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:51.806613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-08e67ab7-1039-48ca-a460-18d04fdf0eeb tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:51.814565 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-08e67ab7-1039-48ca-a460-18d04fdf0eeb tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1302 microversion: 2.1 time: 0.071242 Aug 24 02:47:51.815145 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5345/6337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:51 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1302 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:47:52.836098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-294c6c1c-a99e-4411-a5af-caadbafd1866 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:52.836814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-294c6c1c-a99e-4411-a5af-caadbafd1866 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:52.888895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-294c6c1c-a99e-4411-a5af-caadbafd1866 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:52.896503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-294c6c1c-a99e-4411-a5af-caadbafd1866 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1302 microversion: 2.1 time: 0.064600 Aug 24 02:47:52.897092 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5346/6338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:52 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1302 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:53.919259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:53.919900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:53.927081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:53.927584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:53.928034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:53.928771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:53.929434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:53.929871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:54.001185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:54.009225 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61c9285f-b235-497e-8eff-eca8d04c2f04 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1362 microversion: 2.1 time: 0.093992 Aug 24 02:47:54.024431 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5347/6339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:53 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1362 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:55.031710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:55.032402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:55.040630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:55.041854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:55.041854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:55.042544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:55.043014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:55.044018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:55.181753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:55.190235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d081476-de1d-4aac-abd1-a52d13dbc0aa tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.162511 Aug 24 02:47:55.190817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5348/6340] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:55 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:47:55.599143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45", "tag": "02a05cbe-7285-4d12-a2ef-51f710c2e9be"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:47:55.613243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:55.613719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:55.614483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:55.626243 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] Creating event network-changed:02a05cbe-7285-4d12-a2ef-51f710c2e9be for instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 on n-h2-854121-3 Aug 24 02:47:55.631170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ecb7725a-a626-4c30-a4e5-87b553850efb req-07232539-5c7d-43fa-9bf2-40477146dc73 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037250 Aug 24 02:47:55.631768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5349/6341] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:47:56.212563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:56.213328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:56.219570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:56.220062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:56.220510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:56.221237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:56.221708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:56.222147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:56.357965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:56.370169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07c73670-ecf8-491e-972d-e3a3e9af4ace tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.162942 Aug 24 02:47:56.370754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5350/6342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:56 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:57.391860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:57.392656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:57.399522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:57.400024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:57.400475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:57.401252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:57.401721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:57.402161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:57.540909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:57.548755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4dabf40-2bc6-4154-9488-6cba815b9694 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.161345 Aug 24 02:47:57.549355 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5351/6343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:57 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:58.569820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:58.570473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:58.577548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:58.578127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:58.578594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:58.579321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:58.579800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:58.580247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:58.721321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:58.729125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4c7b9cc0-8b4a-4d86-97b4-0221f5bc02cf tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.163217 Aug 24 02:47:58.729723 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5352/6344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:58 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:47:59.751736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:47:59.752401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:47:59.759359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:59.759864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:59.760314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:59.761051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:47:59.761526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:47:59.761965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:47:59.898081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:47:59.906033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2acc1b60-ab48-4be4-9dc5-00eff7a9766b tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.158768 Aug 24 02:47:59.906615 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5353/6345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:47:59 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:00.927390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:00.928097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:00.930341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:48:00.936685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:00.937226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:00.937684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:00.938936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:00.939405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:00.939846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:01.071737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:01.079585 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ecc7b47-fbf2-4bd5-8be9-e76df433b51d tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.156039 Aug 24 02:48:01.080177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5354/6346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:00 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:02.101445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:02.102135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:02.109637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:02.110153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:02.110609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:02.111340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:02.111813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:02.112257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:02.256897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:02.266547 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc66ad37-6e57-46a0-8bfe-3ed4f757d5ae tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.168361 Aug 24 02:48:02.267149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5355/6347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:02 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:02.272297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45", "name": "network-vif-plugged", "status": "completed", "tag": "02a05cbe-7285-4d12-a2ef-51f710c2e9be"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:48:02.282306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:02.282793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:02.283233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:02.296303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] Creating event network-vif-plugged:02a05cbe-7285-4d12-a2ef-51f710c2e9be for instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 on n-h2-854121-3 Aug 24 02:48:02.301541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-efcbd084-a759-4700-af9b-6ad85aee693c req-4c8fbe6e-6bb8-449f-acfa-d441ffc6bce4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033141 Aug 24 02:48:02.302259 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5356/6348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:48:03.292038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:48:03.297669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:03.298603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:03.305231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:03.305731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:03.306179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:03.306905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:03.307349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:03.307786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:03.452181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:03.460798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9545347d-a7b2-4909-88cf-9e7ee899d612 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1427 microversion: 2.1 time: 0.169672 Aug 24 02:48:03.461391 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5357/6349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:03 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:48:04.482811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:04.483468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:04.490663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.491163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.491616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.492324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.492818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.493258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.627875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:04.635544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b10443bf-1800-4e41-bc06-d3891787c221 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1608 microversion: 2.1 time: 0.156769 Aug 24 02:48:04.636108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5358/6350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:04 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1608 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:04.656029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:04.656702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:04.662855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.663351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.663801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.664503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.664993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.665433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.804602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:04.812525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-431291c1-8eac-465b-aaf3-bf2ba570c673 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1608 microversion: 2.1 time: 0.160187 Aug 24 02:48:04.813818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5359/6351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:04 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1608 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:04.836624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:48:04.837300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:48:04.843472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.845035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.845513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.846255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:04.846721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:04.847156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:04.980238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:48:04.988519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27895f3c-28bc-469a-b976-5e0295516d6c tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1608 microversion: 2.1 time: 0.155590 Aug 24 02:48:04.989120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5360/6352] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:48:04 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1608 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:48:06.610020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45", "tag": "02a05cbe-7285-4d12-a2ef-51f710c2e9be"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:48:06.620317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:48:06.620839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:48:06.621329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:48:06.639298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] Creating event network-changed:02a05cbe-7285-4d12-a2ef-51f710c2e9be for instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 on n-h2-854121-3 Aug 24 02:48:06.644541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-21721350-19ef-46e3-bfa3-e63568fcdb61 req-5d5027e7-4701-474a-85b5-71e45f650c39 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038626 Aug 24 02:48:06.645259 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5361/6353] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:49:25.098959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:49:25.099715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=80 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:49:25.104428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:49:25.105051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:49:25.113635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:49:25.114133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:49:25.114585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:49:25.115286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:49:25.115756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:49:25.116198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:49:25.140524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a788b3c-55b5-456a-bd7c-d01b086ca1da tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043786 Aug 24 02:49:25.141127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5362/6354] 10.222.0.49 () {58 vars in 1293 bytes} [Wed Aug 24 02:49:25 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:50:43.117626 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:50:43.118384 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:50:43.128934 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:50:43.129100 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:50:55.284335 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:50:55.285068 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:53:28.726755 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 02:53:28.727755 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 02:53:28.728236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:53:28.729033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:53:28.858652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:28.859194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:28.869376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:28.869879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:28.870327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:28.871063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:28.871524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:28.871960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:28.900815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:53:28.991629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d1c27da-1130-48dc-96ee-62f1c9dc7a86 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 204 len: 0 microversion: 2.1 time: 0.266459 Aug 24 02:53:28.992078 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5363/6355] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:53:28 2022] DELETE /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:53:29.002036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:29.002776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:29.008857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:29.009360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:29.009811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:29.010515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:29.010984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:29.011555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:29.246709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:29.254694 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50740aa4-1496-4029-9fc7-f91ab48a78e7 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1732 microversion: 2.1 time: 0.256893 Aug 24 02:53:29.297631 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5364/6356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:28 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:30.276807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:30.277439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:30.287569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:30.288248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:30.288510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:30.289260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:30.289728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:30.290164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:30.295501 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45118. Aug 24 02:53:30.296163 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45116. Aug 24 02:53:30.433441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:30.442110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3f5d6e7-fdd3-4226-a316-9236a42171f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1732 microversion: 2.1 time: 0.169167 Aug 24 02:53:30.442715 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5365/6357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:30 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:31.014458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45", "name": "network-vif-deleted", "tag": "02a05cbe-7285-4d12-a2ef-51f710c2e9be"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:53:31.027723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:31.028671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:31.029300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:31.042977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] Creating event network-vif-deleted:02a05cbe-7285-4d12-a2ef-51f710c2e9be for instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 on n-h2-854121-3 Aug 24 02:53:31.049519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d25436cb-c1b8-4a6a-920f-ece6cfb9f353 req-8c9d78d7-9db3-4d74-96df-09d7025256b5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102238 Aug 24 02:53:31.050358 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5366/6358] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:53:31.465081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:31.466497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:31.474483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:31.474996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:31.475439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:31.476182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:31.476650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:31.477122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:31.520060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:31.520671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:31.521233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:31.521801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lazy-loading 'fault' on Instance uuid cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:53:31.578499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84127fd4762644849357ce9dbfe04f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bdb64a1c610460c95417104d2299251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:31.587544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47987212-e26f-440c-a6cc-ce1b5087a8f0 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 200 len: 1388 microversion: 2.1 time: 0.126774 Aug 24 02:53:31.588138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5367/6359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:31 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 1388 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:32.608974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:32.609607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:32.616702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:32.617236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:32.617718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:32.618429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:32.618896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:32.619334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:32.633218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] HTTP exception thrown: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Request method failure captured: Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 HTTP/1.1 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZFPqAUY3Ah8RIeRsOFqMiZfO75UZP5H_TUa21xZNpEZ-7GkSwMYdfMWcR1_NzcSbNobdAa9EX3hN_JTFqeg4bhS4ODlRab4UjbdWprmE0hPDrOZX3fRHxZ-qxqyAiXGf_PI160JcaZYZ72bd6IOOmvL468Gtfa4pWK7TUjZvmxSDcY Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8bdb64a1c610460c95417104d2299251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8bdb64a1c610460c95417104d2299251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 84127fd4762644849357ce9dbfe04f67 Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45'} Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:32.634939 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Returning 404 to user: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1058ae48-7964-424f-8c95-f301bd928c65 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 404 len: 111 microversion: 2.1 time: 0.031419 Aug 24 02:53:32.637843 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5368/6360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:32 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:53:33.096908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:33.097424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:33.103993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:33.104583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:33.105124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:33.105892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:33.106406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:33.106885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:33.122107 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] HTTP exception thrown: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Request method failure captured: Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 HTTP/1.1 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZFPqAUY3Ah8RIeRsOFqMiZfO75UZP5H_TUa21xZNpEZ-7GkSwMYdfMWcR1_NzcSbNobdAa9EX3hN_JTFqeg4bhS4ODlRab4UjbdWprmE0hPDrOZX3fRHxZ-qxqyAiXGf_PI160JcaZYZ72bd6IOOmvL468Gtfa4pWK7TUjZvmxSDcY Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8bdb64a1c610460c95417104d2299251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8bdb64a1c610460c95417104d2299251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 84127fd4762644849357ce9dbfe04f67 Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45'} Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:53:33.123671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Returning 404 to user: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4526802f-b1c2-410b-ad56-ad6d6973fb39 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "DELETE /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 404 len: 111 microversion: 2.1 time: 0.032187 Aug 24 02:53:33.127739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5369/6361] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:53:33 2022] DELETE /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:53:33.134207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:33.134829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] [instance: cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:33.140913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:33.141411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:33.142434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:33.143148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:33.143616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:33.144057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:33.158167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] HTTP exception thrown: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Request method failure captured: Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 HTTP/1.1 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZFPqAUY3Ah8RIeRsOFqMiZfO75UZP5H_TUa21xZNpEZ-7GkSwMYdfMWcR1_NzcSbNobdAa9EX3hN_JTFqeg4bhS4ODlRab4UjbdWprmE0hPDrOZX3fRHxZ-qxqyAiXGf_PI160JcaZYZ72bd6IOOmvL468Gtfa4pWK7TUjZvmxSDcY Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8bdb64a1c610460c95417104d2299251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8bdb64a1c610460c95417104d2299251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8bdb64a1c610460c95417104d2299251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8bdb64a1c610460c95417104d2299251 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestServerBasicOps-1893710173 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 84127fd4762644849357ce9dbfe04f67 Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestServerBasicOps-1893710173-project Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45'} Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:53:33.159736 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Returning 404 to user: Instance cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7caba32b-2714-4408-a11d-fbb9984db585 tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45" status: 404 len: 111 microversion: 2.1 time: 0.030706 Aug 24 02:53:33.163190 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5370/6362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:33 2022] GET /compute/v2.1/servers/cb5ad0f7-ae3a-4817-9c99-8f4abd5ccc45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:53:33.335305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fc898b5-3e4a-45b1-9cc2-c456f901369e tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] Calling method '.version_select at 0x7f6b904e9dc0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:33.367272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fc898b5-3e4a-45b1-9cc2-c456f901369e tempest-TestServerBasicOps-1893710173 tempest-TestServerBasicOps-1893710173-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-379112130" status: 202 len: 0 microversion: 2.1 time: 0.035936 Aug 24 02:53:33.367867 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5371/6363] 10.222.0.49 () {58 vars in 1251 bytes} [Wed Aug 24 02:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-379112130 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:53:52.166549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:53:52.167382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:53:52.307975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1866882513", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:53:52.363878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] validate_networks() for None {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:53:52.650071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:53:52.650542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:53:52.651050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:53:52.651458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:53:52.651893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:53:52.663744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:52.664246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:52.664701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:52.665508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:52.665980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:52.666427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:52.686455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Getting quotas for project d7a81a3c0a70498b975006984be54ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:53:52.692516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Getting quotas for user e6d88ce5e40c49d9a4f9419c63dbc6aa and project d7a81a3c0a70498b975006984be54ddf. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:53:52.705896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:53:52.708221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:53:52.751813 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [fee3cf72-2f78-453f-a1fb-be743bf7693a] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 02:53:53.759399 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [fee3cf72-2f78-453f-a1fb-be743bf7693a] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45246. Aug 24 02:53:53.763938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4eac5294-2b1a-43ff-b5d6-6be83203df3b tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.599345 Aug 24 02:53:53.764621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5372/6364] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:53:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:53:53.778229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9deb9cb4-8c7e-4897-a965-7a8c0cd9ddd0 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:53.778915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9deb9cb4-8c7e-4897-a965-7a8c0cd9ddd0 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:53.835763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9deb9cb4-8c7e-4897-a965-7a8c0cd9ddd0 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:53.843630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9deb9cb4-8c7e-4897-a965-7a8c0cd9ddd0 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1222 microversion: 2.1 time: 0.069094 Aug 24 02:53:53.844293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5373/6365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:53 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:54.865692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7beec063-cdd9-40c7-8439-fe0bb71df98f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:54.866308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7beec063-cdd9-40c7-8439-fe0bb71df98f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:54.920388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7beec063-cdd9-40c7-8439-fe0bb71df98f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:54.927687 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7beec063-cdd9-40c7-8439-fe0bb71df98f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1222 microversion: 2.1 time: 0.066046 Aug 24 02:53:54.928254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5374/6366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:54 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:55.950624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-276ae780-040b-426e-be56-70e310b61140 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:55.951216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-276ae780-040b-426e-be56-70e310b61140 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:56.008327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-276ae780-040b-426e-be56-70e310b61140 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:56.015501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-276ae780-040b-426e-be56-70e310b61140 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1222 microversion: 2.1 time: 0.068790 Aug 24 02:53:56.016696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5375/6367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:55 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:57.043892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:57.044511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:57.052198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:57.052704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:57.053183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:57.053898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:57.054365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:57.054805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:57.116602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:57.124643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-76af89d9-30a9-45d2-a5bf-e7b935dd18e3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1226 microversion: 2.1 time: 0.084616 Aug 24 02:53:57.125804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5376/6368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:57 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:58.147209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:58.147999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:58.155780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:58.157384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:58.157919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:58.158952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:58.159608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:58.160152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:58.227655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:58.240997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c03b7ac3-c4cc-49d9-a7d4-008e39237d6a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1292 microversion: 2.1 time: 0.096651 Aug 24 02:53:58.240997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5377/6369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:58 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:53:59.264595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:53:59.265610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:53:59.273559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:59.274065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:59.274524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:59.275336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:59.275808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:59.276252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:59.414338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:53:59.422899 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ecc74d61-0d03-4405-9ec5-fe8b7beb189a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.161966 Aug 24 02:53:59.423673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5378/6370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:53:59 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:53:59.811673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4701393-7f2c-454f-a146-ddc895a4223b", "tag": "2a957bcf-3975-43ff-b349-e39fdf9bce54"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:53:59.823819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:53:59.824751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:53:59.825205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:53:59.836863 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] Creating event network-changed:2a957bcf-3975-43ff-b349-e39fdf9bce54 for instance e4701393-7f2c-454f-a146-ddc895a4223b on n-h1-854121-3 Aug 24 02:53:59.842238 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-77e8a248-60f2-4f63-806e-e890acff146d req-e92ff1bf-40aa-410a-ab53-6ce960fbd173 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036046 Aug 24 02:53:59.842844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5379/6371] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:00.444131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:00.444930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:00.451615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:00.452110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:00.452558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:00.453855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:00.454332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:00.454769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:00.587053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:00.595532 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4dd4e3b-6275-4d9d-bd6e-3378d2342454 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.155590 Aug 24 02:54:00.596112 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5380/6372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:00 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:01.617511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:01.618156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:01.625500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:01.626004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:01.626450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:01.627160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:01.627623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:01.628191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:01.765867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:01.773803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1a7e9afe-aa70-4f39-9249-eb8f4393166a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.160388 Aug 24 02:54:01.774394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5381/6373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:01 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:02.795023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:02.795662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:02.799165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:02.804995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:02.805500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:02.805953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:02.806666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:02.807131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:02.807568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:03.215759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:03.224341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b14aed2-376d-463e-a5c3-df3e4cf75e40 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.433051 Aug 24 02:54:03.224957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5382/6374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:02 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:04.245950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:04.246575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:04.254026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:04.254532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:04.255013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:04.255712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:04.256177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:04.256613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:04.385005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:04.392662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9ec6ec8-a690-4880-8477-629bf2333d6f tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.150676 Aug 24 02:54:04.393252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5383/6375] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:04 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:05.413215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:05.413874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:05.420834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:05.421336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:05.421786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:05.422489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:05.422959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:05.423401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:05.554478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:05.562440 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5152a460-89ac-4687-a036-4ceafcaabe74 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.153065 Aug 24 02:54:05.563556 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5384/6376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:05 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:06.575200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:06.633217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4701393-7f2c-454f-a146-ddc895a4223b", "name": "network-vif-plugged", "status": "completed", "tag": "2a957bcf-3975-43ff-b349-e39fdf9bce54"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:06.648165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:06.648931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:06.649584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:06.663870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] Creating event network-vif-plugged:2a957bcf-3975-43ff-b349-e39fdf9bce54 for instance e4701393-7f2c-454f-a146-ddc895a4223b on n-h1-854121-3 Aug 24 02:54:06.670530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6ae52b01-b15a-4ecc-86f6-047a331dd270 req-fa6ebd1a-1a6a-4e44-bee3-dd14eb997614 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099660 Aug 24 02:54:06.671148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5385/6377] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:06.676340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:06.677089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:06.683407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:06.683916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:06.684381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:06.685132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:06.685611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:06.686058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:06.823007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:06.831657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71f2e48b-107a-42ad-9bc0-c65954c59c13 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.159348 Aug 24 02:54:06.832237 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5386/6378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:06 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:54:07.852299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:07.852942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:07.859963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:07.860465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:07.860965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:07.861687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:07.862230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:07.862669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:08.000413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:08.008104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52174b50-c20a-4a99-98fa-abfde71ae258 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1322 microversion: 2.1 time: 0.159812 Aug 24 02:54:08.008667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5387/6379] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:07 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:09.029192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.029830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:09.036766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.037276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.037737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.038453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.038926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.039372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.167399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:09.175080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1ba1f77-1596-4b4d-9f00-18b6b4fd3cc3 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1472 microversion: 2.1 time: 0.149788 Aug 24 02:54:09.175647 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5388/6380] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:09 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:09.244879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-71326ebe-4c26-42fa-841b-192e54ca428c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '.version_select at 0x7f6b903bf430>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.307631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-71326ebe-4c26-42fa-841b-192e54ca428c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9f31f9104e2a4903a5d90dab64357595" status: 200 len: 371 microversion: 2.1 time: 0.113906 Aug 24 02:54:09.308417 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5389/6381] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 02:54:09 2022] GET /compute/v2.1/os-quota-sets/9f31f9104e2a4903a5d90dab64357595 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:09.319841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a53e879f-2a3c-41b2-acb1-ac626c61a563 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-410555777", "id": 821057100, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:09.322768 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:54:09.322768 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:54:09.339219 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a53e879f-2a3c-41b2-acb1-ac626c61a563 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022888 Aug 24 02:54:09.339802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5390/6382] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:54:09 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:09.354152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "821057100"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:09.356550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:09.362578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.363335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.363785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.364487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.364984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.365424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.545793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0aba88428b704506a1148f72a21d1fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f31f9104e2a4903a5d90dab64357595', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:09.553408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-410555777 {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:54:09.561070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.561560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.562005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.562737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.563198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.564180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.585161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Getting quotas for project d7a81a3c0a70498b975006984be54ddf. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:54:09.590348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Getting quotas for user e6d88ce5e40c49d9a4f9419c63dbc6aa and project d7a81a3c0a70498b975006984be54ddf. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:54:09.603065 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] ram quota exceeded for 9f31f9104e2a4903a5d90dab64357595, tried to resize instance. Aug 24 02:54:09.603620 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Request method failure captured: Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action HTTP/1.1 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 38 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZK_08flDKJYzJLmSQtZ9mI92wI5X8yswq9jTrnY3Sx1AGXElkbA0Ot7S4LSadM24--cJeraT7pQFL-ojGTgYv1CSrlfeCpszkZuCZbWOhoIBf8Jrp1VrFgLXsHaauTRjXwiWM1zlGICd3tD-4PWSdYnBK1UvupMV5inUiRc7qeFp8k Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9f31f9104e2a4903a5d90dab64357595 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9f31f9104e2a4903a5d90dab64357595 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAdminNegativeTestJSON-699935176-project-admin Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aba88428b704506a1148f72a21d1fd9 Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-699935176-project-admin Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: {"resize": {"flavorRef": "821057100"}} Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4701393-7f2c-454f-a146-ddc895a4223b', 'body': {'resize': {'flavorRef': '821057100'}}} Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.605751 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:54:09.609482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9dd4b4a-0211-4bf6-b166-0b3a7175335c tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action" status: 403 len: 118 microversion: 2.1 time: 0.257356 Aug 24 02:54:09.612208 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5391/6383] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:54:09 2022] POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:54:09.616824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e634c32f-9cae-46df-8f38-40583c94c229 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.617577 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:54:09.617577 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:54:09.635127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e634c32f-9cae-46df-8f38-40583c94c229 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/821057100" status: 202 len: 0 microversion: 2.1 time: 0.022046 Aug 24 02:54:09.635702 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5392/6384] 10.222.0.49 () {58 vars in 1158 bytes} [Wed Aug 24 02:54:09 2022] DELETE /compute/v2.1/flavors/821057100 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:54:09.644048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01592bd2-3dea-4c3a-a206-5326017b31e7 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.664313 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01592bd2-3dea-4c3a-a206-5326017b31e7 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023883 Aug 24 02:54:09.664904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5393/6385] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:54:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:09.685610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f851d9e-961e-4959-bd6a-0c36c7162e16 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '.version_select at 0x7f6b903bf0d0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.764298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f851d9e-961e-4959-bd6a-0c36c7162e16 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "GET /compute/v2.1/os-quota-sets/9f31f9104e2a4903a5d90dab64357595" status: 200 len: 371 microversion: 2.1 time: 0.082320 Aug 24 02:54:09.764916 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5394/6386] 10.222.0.49 () {58 vars in 1242 bytes} [Wed Aug 24 02:54:09 2022] GET /compute/v2.1/os-quota-sets/9f31f9104e2a4903a5d90dab64357595 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:09.776819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3cae088-199e-4ecc-a256-ed4e2c1b30c9 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1784252193", "id": 1444234796, "os-flavor-access:is_public": "True"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:09.779608 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:54:09.779608 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:54:09.796415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3cae088-199e-4ecc-a256-ed4e2c1b30c9 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023256 Aug 24 02:54:09.797050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5395/6387] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:54:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:09.810237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1444234796"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:09.812485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:09.819332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.819834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.820285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.821023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.821504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.821937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.850990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0aba88428b704506a1148f72a21d1fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f31f9104e2a4903a5d90dab64357595', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:09.857451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1784252193 {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:54:09.865167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.865672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.866134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.866887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:09.867363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:09.867807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:09.888971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Getting quotas for project d7a81a3c0a70498b975006984be54ddf. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:54:09.894968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Getting quotas for user e6d88ce5e40c49d9a4f9419c63dbc6aa and project d7a81a3c0a70498b975006984be54ddf. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:54:09.897499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:09.910917 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] cores quota exceeded for 9f31f9104e2a4903a5d90dab64357595, tried to resize instance. Aug 24 02:54:09.911480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Request method failure captured: Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action HTTP/1.1 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 39 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZK_08flDKJYzJLmSQtZ9mI92wI5X8yswq9jTrnY3Sx1AGXElkbA0Ot7S4LSadM24--cJeraT7pQFL-ojGTgYv1CSrlfeCpszkZuCZbWOhoIBf8Jrp1VrFgLXsHaauTRjXwiWM1zlGICd3tD-4PWSdYnBK1UvupMV5inUiRc7qeFp8k Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 9f31f9104e2a4903a5d90dab64357595 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Role: admin,reader,member Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: admin,reader,member Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9f31f9104e2a4903a5d90dab64357595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 9f31f9104e2a4903a5d90dab64357595 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-699935176 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAdminNegativeTestJSON-699935176-project-admin Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 0aba88428b704506a1148f72a21d1fd9 Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-699935176-project-admin Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: {"resize": {"flavorRef": "1444234796"}} Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4701393-7f2c-454f-a146-ddc895a4223b', 'body': {'resize': {'flavorRef': '1444234796'}}} Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.913493 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-262c482f-825c-49cb-8848-526994cfdc58 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action" status: 403 len: 113 microversion: 2.1 time: 0.108709 Aug 24 02:54:09.916661 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5396/6388] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:54:09 2022] POST /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b/action => generated 113 bytes in 110 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:54:09.923460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a32cd46b-c98b-488d-8a73-f17d3756f7c9 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.924213 n-d-854121-3 devstack@n-api.service[128567]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 02:54:09.924213 n-d-854121-3 devstack@n-api.service[128567]: warnings.warn(msg) Aug 24 02:54:09.941675 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a32cd46b-c98b-488d-8a73-f17d3756f7c9 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "DELETE /compute/v2.1/flavors/1444234796" status: 202 len: 0 microversion: 2.1 time: 0.021740 Aug 24 02:54:09.942246 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5397/6389] 10.222.0.49 () {58 vars in 1161 bytes} [Wed Aug 24 02:54:09 2022] DELETE /compute/v2.1/flavors/1444234796 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:54:09.949928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a57fdb16-d82b-4dcb-a22e-42c061dba200 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.973563 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a57fdb16-d82b-4dcb-a22e-42c061dba200 tempest-ServersAdminNegativeTestJSON-699935176 tempest-ServersAdminNegativeTestJSON-699935176-project-admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026974 Aug 24 02:54:09.974251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5398/6390] 10.222.0.49 () {58 vars in 1146 bytes} [Wed Aug 24 02:54:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:09.994733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:09.995261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:10.001537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:10.002049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:10.002511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:10.003246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:10.003726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:10.004179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:10.008469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:10.030274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:54:10.113829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-266a3cc3-d2d2-446d-8faf-6dc3739f0b61 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 204 len: 0 microversion: 2.1 time: 0.122361 Aug 24 02:54:10.114500 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5399/6391] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:54:09 2022] DELETE /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:54:10.124855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:10.125580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:10.132046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:10.132541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:10.133038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:10.133767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:10.134242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:10.134717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:10.281738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:10.290727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff5a72fd-40e4-4de2-b1b8-06eadd483673 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1478 microversion: 2.1 time: 0.171838 Aug 24 02:54:10.291318 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5400/6392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:10 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:11.313894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:11.314803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:11.321728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:11.322227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:11.322674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:11.323409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:11.323874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:11.324328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:11.461894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:11.470436 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43fcaeec-4905-420a-aa0c-14c60b27053a tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1478 microversion: 2.1 time: 0.160752 Aug 24 02:54:11.471021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5401/6393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:11 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:12.305739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4701393-7f2c-454f-a146-ddc895a4223b", "name": "network-vif-deleted", "tag": "2a957bcf-3975-43ff-b349-e39fdf9bce54"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:12.319584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:12.319584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:12.319584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:12.333682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] Creating event network-vif-deleted:2a957bcf-3975-43ff-b349-e39fdf9bce54 for instance e4701393-7f2c-454f-a146-ddc895a4223b on n-h1-854121-3 Aug 24 02:54:12.339267 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0be0c14e-c5a6-46c9-92a4-b77f5c7d4661 req-69f1b719-2211-429a-9cb9-7d630a8af87f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Aug 24 02:54:12.340062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5402/6394] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:12.493674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:12.494395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:12.501036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:12.501481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:12.501938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:12.502662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:12.503138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:12.504031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:12.542482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:12.543354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:12.543940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:12.544583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lazy-loading 'fault' on Instance uuid e4701393-7f2c-454f-a146-ddc895a4223b {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:54:12.587770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6d88ce5e40c49d9a4f9419c63dbc6aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a81a3c0a70498b975006984be54ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:12.596327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18ab2794-fc04-4362-b29e-b672a09384f8 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 200 len: 1312 microversion: 2.1 time: 0.107413 Aug 24 02:54:12.596931 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5403/6395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:12 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:13.617901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:13.618533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] [instance: e4701393-7f2c-454f-a146-ddc895a4223b] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:13.625607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:13.626146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:13.626607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:13.627328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:13.630956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:13.630956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:13.642210 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] HTTP exception thrown: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Request method failure captured: Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b HTTP/1.1 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZK_cK3BN5jysUXEtT8xuk0DKYEyhqgsYZAv4xFr75tq-H1xwj3ll8pE2cp5arja-O4IlBAhuB_181bF-wWR8afFNPj1UXbZgn7KjA84xSxZgi4cFQnics7RW_138DHUk0vT-a1jG6rAbB5h2nYhEpa8diehhJ_PZ7jdA8CgY4SrmvA Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: d7a81a3c0a70498b975006984be54ddf Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-876852821 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d7a81a3c0a70498b975006984be54ddf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7a81a3c0a70498b975006984be54ddf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d7a81a3c0a70498b975006984be54ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d7a81a3c0a70498b975006984be54ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersAdminNegativeTestJSON-876852821 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: d7a81a3c0a70498b975006984be54ddf Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-876852821 Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersAdminNegativeTestJSON-876852821-project Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: e6d88ce5e40c49d9a4f9419c63dbc6aa Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersAdminNegativeTestJSON-876852821-project Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'e4701393-7f2c-454f-a146-ddc895a4223b'} Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:13.643909 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] Returning 404 to user: Instance e4701393-7f2c-454f-a146-ddc895a4223b could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7b659499-f70a-4bf2-8621-cd9f945ce4b2 tempest-ServersAdminNegativeTestJSON-876852821 tempest-ServersAdminNegativeTestJSON-876852821-project] 10.222.0.49 "GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b" status: 404 len: 111 microversion: 2.1 time: 0.031551 Aug 24 02:54:13.649206 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5404/6396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:13 2022] GET /compute/v2.1/servers/e4701393-7f2c-454f-a146-ddc895a4223b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:54:20.298584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:20.299955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:20.425515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1414521509", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "dfc4f7a5-980a-4828-ac8c-c57f96a9dd42"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:20.480413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] validate_networks() for [('dfc4f7a5-980a-4828-ac8c-c57f96a9dd42', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:54:20.867596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:54:20.868039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:54:20.868529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:54:20.868982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:54:20.869408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:54:20.878580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:20.879075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:20.879525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:20.880265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:20.880756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:20.881203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:20.899640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Getting quotas for project 0d1e448ca294432ba9570bac15ef91cb. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:54:20.906454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Getting quotas for user 02954448102945b283e02f07a585d9dd and project 0d1e448ca294432ba9570bac15ef91cb. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:54:20.922114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:54:20.924364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:54:20.973327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2df6b544-5529-48a2-b688-384f3db9777b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681002 Aug 24 02:54:20.973984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5405/6397] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:54:20.985100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ce126b16-2c40-4917-8b94-88037c5f3fa7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:20.985810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ce126b16-2c40-4917-8b94-88037c5f3fa7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:21.046056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ce126b16-2c40-4917-8b94-88037c5f3fa7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:21.054963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ce126b16-2c40-4917-8b94-88037c5f3fa7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1215 microversion: 2.1 time: 0.073917 Aug 24 02:54:21.055579 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5406/6398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:20 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:54:22.075701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:22.076322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:22.083691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:22.084236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:22.084760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:22.085496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:22.086001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:22.086448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:22.153172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:22.161827 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2327de8-5230-406d-acfd-ff5ac421d25c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1267 microversion: 2.1 time: 0.090003 Aug 24 02:54:22.162422 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5407/6399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:22 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:23.183472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:23.184383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:23.198936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:23.199698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:23.200269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:23.201179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:23.201906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:23.202614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:23.386263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:23.394836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1225c90-0898-478c-8fad-0317911290d1 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.215466 Aug 24 02:54:23.395763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5408/6400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:23 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:54:23.841771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:23.852401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:23.853205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:23.853824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:23.869056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] Creating event network-changed:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h2-854121-3 Aug 24 02:54:23.883764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a570bdef-88c9-4921-9322-d4116a6041f1 req-f96dbe3d-6c15-4476-a304-497a14534d44 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038334 Aug 24 02:54:23.885786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5409/6401] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:24.418252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:24.418978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:24.426074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:24.426618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:24.427076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:24.427808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:24.428290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:24.428904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:24.563224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:24.571148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e15f6a0-9b49-4095-8801-f4660db15877 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.158057 Aug 24 02:54:24.571767 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5410/6402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:24 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:25.591440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:25.592082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:25.601897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:25.602396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:25.602848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:25.603555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:25.604020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:25.604461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:25.743111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:25.751992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67373aa2-65d3-4535-b856-0fe701507bf8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.164416 Aug 24 02:54:25.752580 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5411/6403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:25 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:26.772305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:26.773125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:26.779921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:26.780422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:26.780909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:26.781677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:26.782346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:26.782982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:26.919007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:26.927697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cba5ca2-ecac-44bf-8bc2-80d2e64bf3c5 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.159225 Aug 24 02:54:26.928294 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5412/6404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:26 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:27.948455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:27.949062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:27.956403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:27.956929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:27.957377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:27.958075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:27.958541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:27.958979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:28.090010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:28.097939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af473faf-5e40-46b7-b3ac-596eb178a365 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.153385 Aug 24 02:54:28.098539 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5413/6405] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:27 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:29.120064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:29.120684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:29.128300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:29.128837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:29.129294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:29.130021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:29.130493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:29.130935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:29.268205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:29.275988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77e855fd-8388-41cb-a3cc-497dabeeb8fc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.160121 Aug 24 02:54:29.276562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5414/6406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:29 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:30.255667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "name": "network-vif-plugged", "status": "completed", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:30.266787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:30.267297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:30.267759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:30.282450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] Creating event network-vif-plugged:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h2-854121-3 Aug 24 02:54:30.287782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ef922b50-749d-4f0a-9121-da825a8096d6 req-ae464166-1605-48d0-a524-45447bfa807d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035838 Aug 24 02:54:30.288517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5415/6407] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:54:30.298560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:30.299292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:30.305790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:30.306300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:30.306763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:30.307496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:30.307970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:30.308414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:30.461248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:30.470288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5621899f-0139-4115-b2c5-f9d66b1b0c1c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.176758 Aug 24 02:54:30.471250 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5416/6408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:30 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:31.491534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:31.492128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:31.494126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:31.494836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:31.502254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:31.502755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:31.503208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:31.503920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:31.504388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:31.504851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:31.648675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:31.657192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69ea9306-e6c6-4c96-b7a6-82737d42c22d tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1315 microversion: 2.1 time: 0.169353 Aug 24 02:54:31.657777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5417/6409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:31 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:32.678932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:32.679575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:32.690925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:32.691471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:32.691921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:32.692653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:32.693164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:32.693609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:32.698118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:32.835085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:32.843385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bab356fc-8235-41d8-9555-4d81054e12bc tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1503 microversion: 2.1 time: 0.168375 Aug 24 02:54:32.844486 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5418/6410] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:32 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:32.865331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:54:32.867659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:32.874187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:32.874723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:32.875169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:32.875893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:32.876368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:32.876844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:32.955498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:32.961801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:54:32.968456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:54:32.968982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:54:32.969983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:54:32.970407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:54:32.970869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:54:33.081876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65f9a072-5938-46c7-a182-fe78cf4c6c95 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "POST /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2/action" status: 202 len: 0 microversion: 2.1 time: 0.220620 Aug 24 02:54:33.082723 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5419/6411] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:54:32 2022] POST /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:54:33.090609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:33.091231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:33.097925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:33.098421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:33.098871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:33.099581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:33.100048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:33.100489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:33.281913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:33.290056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a44d8a9a-2c63-494f-a53e-9be54f904ccd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1512 microversion: 2.1 time: 0.203145 Aug 24 02:54:33.296751 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5420/6412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:33 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:34.315295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:34.315974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:34.323347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:34.323982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:34.324522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:34.325391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:34.325800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:34.326298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:34.471479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:34.480082 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd33bea7-16f5-40bd-affb-f11e8c14b04a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1512 microversion: 2.1 time: 0.168772 Aug 24 02:54:34.480670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5421/6413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:34 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:35.501692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:35.502395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:35.509368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:35.509875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:35.510332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:35.511049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:35.511524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:35.511971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:35.655719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:35.663861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-81aa8425-9b65-41e8-abc1-f79a1b633bac tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.166043 Aug 24 02:54:35.664460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5422/6414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:35 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:36.685741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:36.686429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:36.693951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:36.694447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:36.694896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:36.695602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:36.696067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:36.696504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:36.825644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:36.833529 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-127e82b6-a460-4d49-b96f-2acfe4fc35e7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.151791 Aug 24 02:54:36.834102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5423/6415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:36 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:37.854599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:37.855281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:37.862967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:37.863714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:37.864162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:37.864905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:37.865422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:37.865804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:38.009975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:38.019541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8aa5839d-933c-4398-a429-2f795a9fe040 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.168781 Aug 24 02:54:38.020130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5424/6416] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:37 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:39.040696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:39.041423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:39.048866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:39.049371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:39.049821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:39.050524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:39.050991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:39.051431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:39.182292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:39.190893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc84601a-da7b-41d6-b105-b6bf49baeed7 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.154167 Aug 24 02:54:39.191471 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5425/6417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:39 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:40.212468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:40.213174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:40.216372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:40.222738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:40.223255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:40.223717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:40.224448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:40.224951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:40.225399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:40.359686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:40.367769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e06be583-bc6a-498f-bfac-fe4798493c8c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.159350 Aug 24 02:54:40.368345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5426/6418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:40 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:41.389598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:41.390235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:41.397587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:41.398090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:41.398550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:41.399256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:41.399730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:41.400174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:41.530854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:41.539263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab7757fe-8220-4258-b327-4b8299464af8 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.153596 Aug 24 02:54:41.539829 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5427/6419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:41 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:42.559983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:42.560601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:42.567983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:42.568478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:42.568954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:42.569654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:42.570120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:42.570554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:42.713058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:42.721455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-85657ae4-a8b7-4966-b9b1-12825a7bee15 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.165348 Aug 24 02:54:42.722029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5428/6420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:42 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:43.742296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:43.742941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:43.751060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:43.751555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:43.752003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:43.752703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:43.753193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:43.753626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:43.891421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:43.899476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbf52a62-5ba0-4cdc-b5de-f05685faeb74 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.161337 Aug 24 02:54:43.900056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5429/6421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:43 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:44.926210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:44.926827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:44.934849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:44.935514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:44.936187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:44.937846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:44.938525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:44.939232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:45.074777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:45.082575 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6222a6d-bcd0-4827-8fa1-dbddcc777f77 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.160605 Aug 24 02:54:45.083149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5430/6422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:44 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:46.104434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:46.105499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:46.114733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:46.115241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:46.115696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:46.116410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:46.116916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:46.117362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:46.246351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:46.254356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aec6cb2e-832f-4718-9c5d-7ef358c6cd10 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.155153 Aug 24 02:54:46.254934 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5431/6423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:46 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:47.274792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:47.275429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:47.282760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:47.283267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:47.283723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:47.284689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:47.285196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:47.285644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:47.418864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:47.427159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0e9361d-a86f-4a5c-865b-15873918320a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.156306 Aug 24 02:54:47.427736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5432/6424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:47 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:48.450513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:48.451255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:48.458685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:48.459192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:48.459645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:48.460356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:48.460934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:48.461379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:48.479629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:54:48.591591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:48.600134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6eda39d9-9bdc-4876-b572-09ab21c90829 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.153625 Aug 24 02:54:48.600750 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5433/6425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:48 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:49.621925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:49.622552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:49.629459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:49.629959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:49.630410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:49.631117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:49.631586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:49.632033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:49.766314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:49.774662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ad0f120-5b16-4a5a-bab8-63471d105080 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.156778 Aug 24 02:54:49.775252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5434/6426] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:49 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:50.795455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:50.796095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:50.803714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:50.804240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:50.804677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:50.805415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:50.805886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:50.806329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:50.935696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:50.943546 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68ad7488-f980-4a81-9825-56d68e19d973 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.151994 Aug 24 02:54:50.944119 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5435/6427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:50 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:51.964082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:51.964697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:51.971761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:51.972266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:51.973336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:51.974054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:51.974532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:51.974980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:52.104383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:52.112256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4000e2b-82e6-42fa-9cd0-b91037ecf37c tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.152250 Aug 24 02:54:52.112852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5436/6428] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:51 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:53.133670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:53.134326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:53.142579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:53.143122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:53.143584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:53.144308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:53.145317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:53.145765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:53.276115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:53.283957 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fda026e-d73d-4d67-9418-18883fb975d0 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.154150 Aug 24 02:54:53.284531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5437/6429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:53 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:54.306199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:54.306802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:54.314239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:54.315077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:54.315835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:54.316837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:54.317310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:54.317751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:54.444833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:54.452568 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1bd7863-b660-4cbf-a8d7-93432af83a01 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.150342 Aug 24 02:54:54.453270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5438/6430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:54 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:55.473782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:55.474435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:55.481636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:55.482141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:55.482601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:55.483317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:55.483795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:55.484244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:55.617358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:55.625165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a19c5bb-b71c-4a7e-a53a-c0330d112d6b tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.155270 Aug 24 02:54:55.625747 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5439/6431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:55 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:56.647642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:56.648269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:56.655984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:56.656490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:56.656984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:56.657673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:56.658141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:56.658586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:56.790680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:56.798346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e820d63a-6548-47dc-8322-4d9fd98a2e44 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.155330 Aug 24 02:54:56.798915 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5440/6432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:56 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:57.819364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:57.819993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:57.826914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:57.827417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:57.827873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:57.828583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:57.829085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:57.829538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:57.965256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:57.973173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-674e9109-c4d6-4b95-b62d-494cd13fd38e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.157624 Aug 24 02:54:57.973755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5441/6433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:57 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:54:58.995000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:54:58.995903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:54:59.002787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:59.003284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:59.003735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:59.004437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:54:59.004939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:54:59.005463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:54:59.132234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:54:59.140000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da0ccf93-9c34-4a9e-8b10-247df969af30 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.148918 Aug 24 02:54:59.140578 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5442/6434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:54:58 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:00.161905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:00.162557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:00.169359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:00.169854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:00.170305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:00.171006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:00.171472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:00.171907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:00.305725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:00.314558 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7237b9a-97ff-4655-956d-842ced71f015 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.156549 Aug 24 02:55:00.314997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5443/6435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:00 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:01.335769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:01.336426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:01.343384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:01.343887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:01.344346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:01.345091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:01.345571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:01.346012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:01.477009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:01.484858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02348523-4255-4aac-9a83-3daa69e01026 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.153579 Aug 24 02:55:01.485453 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5444/6436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:01 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:02.507134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:02.507758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:02.514647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:02.515150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:02.515599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:02.516334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:02.516823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:02.517260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:02.647013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:02.655571 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26812887-4de3-4237-b278-95f913d3415a tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1517 microversion: 2.1 time: 0.152884 Aug 24 02:55:02.656151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5445/6437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:02 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:03.360995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "name": "network-vif-unplugged", "status": "completed", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:03.371617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:03.372061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:03.372605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:03.387814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Creating event network-vif-unplugged:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h1-854121-3 Aug 24 02:55:03.393825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] Instance f4acb62c-a866-4756-a811-ada20dcce8a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:55:03.404797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8060dd5f-c53f-40f1-97de-355a2631895c req-37d8dd3e-97db-4f88-a7a1-762bac9be12f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047557 Aug 24 02:55:03.405788 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5446/6438] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:55:03.677703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:03.678416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:03.685458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:03.685973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:03.686420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:03.687132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:03.687604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:03.688044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:03.822572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:03.831466 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48cd6c54-ad92-47bb-923e-d8af43ec2dcd tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1516 microversion: 2.1 time: 0.158495 Aug 24 02:55:03.832061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5447/6439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:03 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:04.856579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:04.857772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:04.865986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:04.866482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:04.866931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:04.867642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:04.868328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:04.869259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:05.000377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:05.008279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e57aad54-cbc8-4305-aee3-baf867e0e26e tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1514 microversion: 2.1 time: 0.158438 Aug 24 02:55:05.008869 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5448/6440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:04 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:05.420372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:05.429842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:05.430340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:05.430943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:05.445304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Creating event network-changed:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h1-854121-3 Aug 24 02:55:05.450702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] Instance f4acb62c-a866-4756-a811-ada20dcce8a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:55:05.462093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0b469bc1-b8b1-4f3a-bbe3-49e475fe76e6 req-513c5205-13bf-4c76-b1df-f2bbe3c509d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045850 Aug 24 02:55:05.462685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5449/6441] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:55:06.030327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:06.031039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:06.038153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:06.038651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:06.039098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:06.039799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:06.040264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:06.040701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:06.173358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:06.178532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:06.184102 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-294df774-c533-4633-b80a-49b96801da41 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1514 microversion: 2.1 time: 0.158163 Aug 24 02:55:06.184667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5450/6442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:06 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:07.208293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:07.209375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:07.218413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:07.218941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:07.219405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:07.220158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:07.220638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:07.222086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:07.395228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:07.403966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f36337c4-1909-4d97-843d-c2e10e632b7f tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1514 microversion: 2.1 time: 0.201279 Aug 24 02:55:07.404549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5451/6443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:07 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:55:08.426149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:08.427296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:08.434240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:08.434736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:08.435192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:08.435897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:08.436366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:08.436838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:08.572059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:08.579825 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba287786-ab4d-4935-9645-407ea4c32659 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1511 microversion: 2.1 time: 0.157646 Aug 24 02:55:08.580419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5452/6444] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:08 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:08.599809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:08.600320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:08.606262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:08.606762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:08.607217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:08.607926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:08.608427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:08.608901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:08.644574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:55:08.698384 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Found an unconfirmed migration during delete, id: 16, status: finished Aug 24 02:55:10.278032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=56 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:10.297051 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cdb0a137-949e-4d39-bd67-6402038190c3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 204 len: 0 microversion: 2.1 time: 1.700895 Aug 24 02:55:10.297711 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5453/6445] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:55:08 2022] DELETE /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 0 bytes in 1703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:55:10.306590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:10.307311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:10.313439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:10.313946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:10.314414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:10.315186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:10.315688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:10.316107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:10.450837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:10.458607 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f025c26c-b127-4162-859f-f51d0d91f6e3 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1503 microversion: 2.1 time: 0.156334 Aug 24 02:55:10.459180 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5454/6446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:10 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:10.822431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "name": "network-vif-plugged", "status": "completed", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:10.832406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:10.833071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:10.834181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:10.846371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] Creating event network-vif-plugged:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h1-854121-3 Aug 24 02:55:10.851632 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-12c52374-300d-4be7-a6b2-58de72e461f1 req-46fb12d6-f149-4831-bffe-8c9bf2e4ef71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032862 Aug 24 02:55:10.852493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5455/6447] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:55:11.482403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:11.483454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:11.494227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:11.494656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:11.495128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:11.495854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:11.496321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:11.496793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:11.628286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:11.636990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1456ad6b-07ac-46ce-aa2a-4ec8756e5e21 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1503 microversion: 2.1 time: 0.160281 Aug 24 02:55:11.637575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5456/6448] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:11 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:12.438457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4acb62c-a866-4756-a811-ada20dcce8a2", "name": "network-vif-deleted", "tag": "80a08e40-dad1-4692-8a65-5eb1e2cfd790"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:12.452328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:12.453219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:12.457410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:12.468080 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] Creating event network-vif-deleted:80a08e40-dad1-4692-8a65-5eb1e2cfd790 for instance f4acb62c-a866-4756-a811-ada20dcce8a2 on n-h1-854121-3 Aug 24 02:55:12.474277 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-3ee1e59a-f908-44ce-af81-e88ea5aaddcf req-8599c1d4-5f83-45d9-99a8-cb7574472abe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047027 Aug 24 02:55:12.475220 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5457/6449] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:55:12.659939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:12.660575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:12.667486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:12.667987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:12.668439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:12.669175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:12.669645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:12.670090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:12.701054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:12.701553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:12.702010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:12.702475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lazy-loading 'fault' on Instance uuid f4acb62c-a866-4756-a811-ada20dcce8a2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:55:12.749123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02954448102945b283e02f07a585d9dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d1e448ca294432ba9570bac15ef91cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:12.756289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4f0c0a8-148e-4852-b2ed-3a9e25cc6140 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 200 len: 1305 microversion: 2.1 time: 0.101320 Aug 24 02:55:12.756886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5458/6450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:12 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:13.776623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:13.777306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:13.784158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.784656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.785153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.785858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.788050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.788502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.802293 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] HTTP exception thrown: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Request method failure captured: Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 HTTP/1.1 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZLc2CDb-PCcMBZcaHr_LdNHUmYBdJTtljUBXt53hkEy8R4BeY2cL8deOq-jMsvEeaWu8-zhR0YmfoU62d4-jmc_-NY5BYYgJ9QSLHBT3vmRJc0ytpCy1s8aDYMI99JSdnb_9boakYV7B0wr4SvaOzHO4xAnYqUQTgivI-LxoLl03Sk Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 02954448102945b283e02f07a585d9dd Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f4acb62c-a866-4756-a811-ada20dcce8a2'} Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.803956 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Returning 404 to user: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c175829-9937-4603-878e-5f0d7c875dc4 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 404 len: 111 microversion: 2.1 time: 0.032774 Aug 24 02:55:13.808161 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5459/6451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:13 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:55:13.820489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:13.821028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:13.826933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.827428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.827882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.828584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.829093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.829533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.847443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] HTTP exception thrown: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Request method failure captured: Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 HTTP/1.1 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZLc2CDb-PCcMBZcaHr_LdNHUmYBdJTtljUBXt53hkEy8R4BeY2cL8deOq-jMsvEeaWu8-zhR0YmfoU62d4-jmc_-NY5BYYgJ9QSLHBT3vmRJc0ytpCy1s8aDYMI99JSdnb_9boakYV7B0wr4SvaOzHO4xAnYqUQTgivI-LxoLl03Sk Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 02954448102945b283e02f07a585d9dd Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f4acb62c-a866-4756-a811-ada20dcce8a2'} Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:55:13.849523 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Returning 404 to user: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef42a681-2f0b-48d9-a5b9-fdcf3647d636 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 404 len: 111 microversion: 2.1 time: 0.034116 Aug 24 02:55:13.853539 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5460/6452] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:55:13 2022] DELETE /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:55:13.860413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:13.861053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] [instance: f4acb62c-a866-4756-a811-ada20dcce8a2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:13.867788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.868283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.868773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.869458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:13.870245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:13.870743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:13.884237 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] HTTP exception thrown: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Request method failure captured: Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 HTTP/1.1 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZLc2CDb-PCcMBZcaHr_LdNHUmYBdJTtljUBXt53hkEy8R4BeY2cL8deOq-jMsvEeaWu8-zhR0YmfoU62d4-jmc_-NY5BYYgJ9QSLHBT3vmRJc0ytpCy1s8aDYMI99JSdnb_9boakYV7B0wr4SvaOzHO4xAnYqUQTgivI-LxoLl03Sk Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0d1e448ca294432ba9570bac15ef91cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0d1e448ca294432ba9570bac15ef91cb Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-DeleteServersTestJSON-737368789 Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 02954448102945b283e02f07a585d9dd Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-DeleteServersTestJSON-737368789-project Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'f4acb62c-a866-4756-a811-ada20dcce8a2'} Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:55:13.885719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] Returning 404 to user: Instance f4acb62c-a866-4756-a811-ada20dcce8a2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5ddf026-c4db-49b9-a0e7-5b5946b3d062 tempest-DeleteServersTestJSON-737368789 tempest-DeleteServersTestJSON-737368789-project] 10.222.0.49 "GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2" status: 404 len: 111 microversion: 2.1 time: 0.030316 Aug 24 02:55:13.889906 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5461/6453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:13 2022] GET /compute/v2.1/servers/f4acb62c-a866-4756-a811-ada20dcce8a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:55:22.276370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-194956778", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "7dad8757-b163-4ce1-b6d4-2d526595099d"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:22.334933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] validate_networks() for [('7dad8757-b163-4ce1-b6d4-2d526595099d', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:55:22.727011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:55:22.727457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:55:22.727941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:55:22.728367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:55:22.728859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:55:22.738467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:22.739311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:22.739760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:22.740500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:22.740989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:22.741426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:22.759304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for project e55a83c14988486f936dc876df95225f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:55:22.764781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for user 43ec333ad2054fbca4f7c7a9225922c2 and project e55a83c14988486f936dc876df95225f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:55:22.778445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:55:22.780783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:55:22.829236 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4129336e-fc2c-4665-9a72-fd99669f3d98 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686098 Aug 24 02:55:22.830125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5462/6454] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:55:22.841546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31f636b1-8798-4aa8-8706-a1768edc044f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:22.842177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31f636b1-8798-4aa8-8706-a1768edc044f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:22.901208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31f636b1-8798-4aa8-8706-a1768edc044f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:22.910157 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31f636b1-8798-4aa8-8706-a1768edc044f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1217 microversion: 2.1 time: 0.072442 Aug 24 02:55:22.910778 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5463/6455] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:22 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:23.933045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:23.934523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:23.944857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:23.945459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:23.945988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:23.946785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:23.947331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:23.947846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:24.030430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:24.042493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-848aaa2f-dc10-46bb-8652-881550f0d816 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1277 microversion: 2.1 time: 0.115215 Aug 24 02:55:24.044390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5464/6456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:23 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:25.064487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:25.066890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:25.075589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:25.076100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:25.076558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:25.077314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:25.077786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:25.078233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:25.230371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:25.240159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-160d3a61-c19d-4234-bd2a-e44ac98d2397 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.179166 Aug 24 02:55:25.241412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5465/6457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:25 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:25.446080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:25.458000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:25.458516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:25.459240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:25.475803 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] Creating event network-changed:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h1-854121-3 Aug 24 02:55:25.481702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d94b2371-d608-43ba-8191-fac8e50dd2d6 req-22173f93-2678-4dc8-a85e-3c05dd6cc9c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039398 Aug 24 02:55:25.482340 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5466/6458] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:55:26.262569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:26.263270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:26.269447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:26.269940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:26.270478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:26.271175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:26.271640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:26.272079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:26.398752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:26.406459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4fb1c5d7-1a9a-436c-95bb-315910275cd8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.149068 Aug 24 02:55:26.407036 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5467/6459] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:26 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:27.427131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:27.427735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:27.434811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:27.435306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:27.435753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:27.436447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:27.436937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:27.437376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:27.565389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:27.573001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-568a5f30-36c1-4206-94e5-af06d39a927e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.150387 Aug 24 02:55:27.573563 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5468/6460] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:27 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:28.593491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:28.594215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:28.602614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:28.603115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:28.603585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:28.604299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:28.604868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:28.605331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:28.753549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:28.763032 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3b69335-bd0c-4c14-8a03-42fcf0065e0e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.173359 Aug 24 02:55:28.777332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5469/6461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:28 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:29.785214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:29.786333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:29.802231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:29.802764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:29.803224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:29.803932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:29.804399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:29.804875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:29.823428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:29.939874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:29.947776 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7809d79f-2f57-4fa1-a2ac-10d2e8dfae24 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.166619 Aug 24 02:55:29.948392 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5470/6462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:29 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:30.887580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "name": "network-vif-plugged", "status": "completed", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:30.897898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:30.898482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:30.898930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:30.910457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] Creating event network-vif-plugged:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h1-854121-3 Aug 24 02:55:30.915619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2a922e41-dbc8-41f9-a9fd-7c0c6d76831d req-7c7401e3-939f-43b6-a084-a1ca3c11eefd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Aug 24 02:55:30.916677 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5471/6463] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:55:30.969406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:30.970200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:30.977221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:30.977733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:30.978183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:30.978899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:30.979364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:30.979804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:31.113053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:31.122336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89b949aa-1fa3-44bb-bf8f-44a2e6d25977 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.156898 Aug 24 02:55:31.122766 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5472/6464] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:30 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:32.142774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:32.143406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:32.150520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:32.151020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:32.151478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:32.152191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:32.152664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:32.153138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:32.282074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:32.289812 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20adc372-d6a2-4097-a88e-0878384b20bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1317 microversion: 2.1 time: 0.151005 Aug 24 02:55:32.290378 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5473/6465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:32 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:33.311265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:33.311925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:33.314026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:33.314730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:33.322928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.323423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.323869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.324570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.325065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.325501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.455110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:33.464210 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e3c6e06-aafc-4a82-af93-1dbde4ef8352 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1508 microversion: 2.1 time: 0.156786 Aug 24 02:55:33.465000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5474/6466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:33 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:33.483710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:33.484269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:33.490430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.490925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.491371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.492065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.492528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.493025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.620025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:33.627861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6e2068d-a8bd-4502-84bb-062fa2e83fa2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1508 microversion: 2.1 time: 0.147758 Aug 24 02:55:33.628444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5475/6467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:33 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:33.647802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:33.650235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:33.656031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.656533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.657011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.657720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.658186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.658628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.724600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7c1bc97-f63f-4e94-b964-0759520aa203 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "PUT /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1080 microversion: 2.1 time: 0.080321 Aug 24 02:55:33.725299 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5476/6468] 10.222.0.49 () {60 vars in 1256 bytes} [Wed Aug 24 02:55:33 2022] PUT /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:33.741807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:33.742363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:33.748116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.748616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.749109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.749807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.750279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.750719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.880099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:33.887861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25334674-b444-4c5d-a16d-f6049e846ad9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1506 microversion: 2.1 time: 0.150010 Aug 24 02:55:33.888426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5477/6469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:33 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:33.908341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:33.908992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:33.915777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.916272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.916735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:33.917439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:33.917904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:33.918337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:34.044031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:34.051770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6c9f6f9-bdc3-4e41-88b7-e279a8216c51 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1506 microversion: 2.1 time: 0.147230 Aug 24 02:55:34.052350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5478/6470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:33 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:55:34.071450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:55:34.073745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:34.079469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:34.079971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:34.080428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:34.081176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:34.081657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:34.082110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:34.110121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:34.116260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:55:34.122733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:55:34.123158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:55:34.123650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:55:34.124080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:55:34.124510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:55:34.187557 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03c16b9e-a68a-463e-a117-7da1dc790d6d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37/action" status: 202 len: 0 microversion: 2.1 time: 0.119672 Aug 24 02:55:34.188164 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5479/6471] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:55:34 2022] POST /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:55:34.196556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:34.197326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:34.203393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:34.203891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:34.204339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:34.205068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:34.205529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:34.206030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:34.369462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:34.377369 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5c32da5-5629-4ac9-b056-da371621bfc7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1517 microversion: 2.1 time: 0.184400 Aug 24 02:55:34.378157 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5480/6472] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:34 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:35.397750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:35.398845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:35.405836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:35.406280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:35.406734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:35.407442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:35.407914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:35.408360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:35.547306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:35.556144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0e3dd25-a51c-4080-92ab-246531d6dc26 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1517 microversion: 2.1 time: 0.162310 Aug 24 02:55:35.556743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5481/6473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:35 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:36.577168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:36.577831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:36.585304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:36.585806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:36.586260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:36.586969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:36.587442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:36.587885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:36.720677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:36.728474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ba5d001-c1a2-4190-b309-d4564295bd09 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.155353 Aug 24 02:55:36.729079 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5482/6474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:36 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:37.749483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:37.750193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:37.757256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:37.757757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:37.758206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:37.758899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:37.759363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:37.759799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:37.887463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:37.896042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-def3c801-8c61-4d79-9658-f0ab2639c255 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.150502 Aug 24 02:55:37.896559 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5483/6475] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:37 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:38.916476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:38.917172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:38.924020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:38.924519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:38.924994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:38.925702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:38.926770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:38.927215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:39.055945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:39.063822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5162770e-f8e5-4bc2-b32f-93a6fee7297e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.151343 Aug 24 02:55:39.064628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5484/6476] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:38 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:40.085956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:40.086614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:40.093533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:40.094105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:40.094558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:40.095265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:40.095737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:40.096179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:40.464545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:40.467971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:40.473221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2675c4c3-ba75-4ec2-9172-d19436e54451 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.391596 Aug 24 02:55:40.473746 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5485/6477] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:40 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:41.494961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:41.495563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:41.498200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:55:41.504881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:41.505422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:41.505881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:41.506591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:41.507061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:41.507509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:41.635407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:41.643213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17754618-6397-4a4b-88eb-16f7504265f5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.152963 Aug 24 02:55:41.643793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5486/6478] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:41 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:42.665070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:42.665814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:42.672568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:42.673099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:42.673554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:42.674261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:42.674727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:42.675165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:42.809914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:42.821009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dca1d2d-4e2b-4be1-90fb-62177cc04ae3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.160391 Aug 24 02:55:42.821604 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5487/6479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:42 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:43.127781 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 02:55:43.128041 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 02:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 02:55:43.841956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:43.842607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:43.849696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:43.850202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:43.850659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:43.851377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:43.851853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:43.852298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:43.986490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:43.996199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79e588db-4260-4077-b763-19e1a73f1391 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158121 Aug 24 02:55:43.996949 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5488/6480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:43 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:45.021340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:45.022005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:45.029218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:45.029716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:45.030168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:45.030878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:45.031338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:45.031803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:45.179222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:45.190158 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a17d953d-5ee8-4d0f-bce1-bad806eb5bf8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.172700 Aug 24 02:55:45.190929 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5489/6481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:45 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:55:46.212652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:46.213348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:46.220363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:46.220935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:46.221371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:46.222150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:46.222595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:46.223037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:46.361060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:46.370208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eeae2828-45fe-4e25-bb18-6b00774c6197 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.161988 Aug 24 02:55:46.370872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5490/6482] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:46 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:47.394479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:47.395252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:47.402498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:47.403001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:47.403453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:47.404171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:47.404634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:47.405106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:47.543510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:47.551407 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2cd7ba60-1ae1-43b2-b109-70f4c280833e tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.160891 Aug 24 02:55:47.551980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5491/6483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:47 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:48.572121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:48.572805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:48.579929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:48.580424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:48.580910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:48.581617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:48.582085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:48.582518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:48.717895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:48.726352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7267cdd0-087b-4a26-9108-0da6ca0d0225 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158814 Aug 24 02:55:48.726924 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5492/6484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:48 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:49.749985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:49.750671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:49.757612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:49.758107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:49.758556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:49.759290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:49.759759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:49.760190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:49.894278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:49.902871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40ff7ccf-d3ed-4aef-8b66-c9059caeef9d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158095 Aug 24 02:55:49.903393 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5493/6485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:49 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:50.924527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:50.925189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:50.932621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:50.933247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:50.933705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:50.934417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:50.934892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:50.935337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:51.071403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:51.079183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef54034d-3d52-4de1-aaff-831434abe389 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158697 Aug 24 02:55:51.079764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5494/6486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:50 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:52.100823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:52.101490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:52.108379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:52.109068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:52.109524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:52.110228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:52.110692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:52.111132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:52.247398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:52.255409 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d377303-990b-4571-ba47-9108e9924aa7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158489 Aug 24 02:55:52.255978 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5495/6487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:52 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:55:53.279355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:53.279989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:53.287045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:53.287558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:53.288015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:53.288750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:53.289232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:53.289676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:53.432196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:53.444315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfcfbf35-532d-4431-82bd-4af40e20320c tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.168119 Aug 24 02:55:53.445270 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5496/6488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:53 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:54.467496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:54.468211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:54.476929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:54.477567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:54.478160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:54.479011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:54.479637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:54.480195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:54.625129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:54.634318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4873d156-404a-4857-bd0e-2dfb747a4aaf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.171856 Aug 24 02:55:54.635030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5497/6489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:54 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:55.655454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:55.656075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:55.663736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:55.664238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:55.664684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:55.665425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:55.665882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:55.666335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:55.799872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:55.808141 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3375ccb1-9eca-4e08-a625-2e47aa68b1b2 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.156628 Aug 24 02:55:55.808710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5498/6490] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:55 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:56.830005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:56.830773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:56.838927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:56.839474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:56.839966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:56.840867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:56.841460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:56.842013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:56.996424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:57.004353 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7e3a7748-ba52-42b2-9063-3f61836c4d05 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.178993 Aug 24 02:55:57.004965 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5499/6491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:56 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:58.027262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:58.027944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:58.036332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:58.036989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:58.038133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:58.039049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:58.039627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:58.040212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:58.201460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:58.210352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-160b3058-fb18-4774-bf94-eb30b1686998 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.188648 Aug 24 02:55:58.210948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5500/6492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:58 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:55:59.234706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:55:59.235406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:55:59.243304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:59.243799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:59.244247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:59.244982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:55:59.245448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:55:59.245885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:55:59.380977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:55:59.388996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd0b6655-947e-458d-bebb-5ac950017aa0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.158527 Aug 24 02:55:59.389587 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5501/6493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:55:59 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:00.410487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:00.411207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:00.417531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:00.418026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:00.418473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:00.419181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:00.419631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:00.420071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:00.440179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:00.558719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:00.567689 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43f83807-bb7b-4269-b30b-ac23e0bac2bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.160930 Aug 24 02:56:00.568242 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5502/6494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:00 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:01.591825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:01.592553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:01.599399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:01.599947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:01.600393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:01.601144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:01.601618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:01.602058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:01.742461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:01.750758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f75c52a-2b1a-4e0a-b35a-38763439baac tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.162642 Aug 24 02:56:01.751350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5503/6495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:01 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:02.772087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:02.772743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:02.779702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:02.780194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:02.780769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:02.781486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:02.781955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:02.782404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:02.926617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:02.934388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d8c202f2-361e-4e5c-82f6-ec182d47e795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1522 microversion: 2.1 time: 0.166278 Aug 24 02:56:02.934966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5504/6496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:02 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:03.959440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:03.960120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:03.967387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:03.967900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:03.968359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:03.969109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:03.969590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:03.970063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:04.114792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:04.123624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-edbfbd01-5870-4469-a414-7da1fe9ac922 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1521 microversion: 2.1 time: 0.169877 Aug 24 02:56:04.124226 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5505/6497] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:03 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:04.129009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "name": "network-vif-unplugged", "status": "completed", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:04.139226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:04.139716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:04.140210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:04.153042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Creating event network-vif-unplugged:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h2-854121-3 Aug 24 02:56:04.159265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:56:04.170516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fdcf7d8a-5c8b-4293-ae43-fe84f5becede req-6f7482a0-7e83-4610-9188-e2c2c5f80176 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045037 Aug 24 02:56:04.171421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5506/6498] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:56:05.148456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:05.149112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:05.155341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:05.155839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:05.156289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:05.157027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:05.157497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:05.157942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:05.297079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:05.304868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5deb416-4235-49f2-8ca3-ae84464e9ef6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1519 microversion: 2.1 time: 0.162208 Aug 24 02:56:05.305440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5507/6499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:05 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:06.195643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:06.206270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:06.206790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:06.207242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:06.219754 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Creating event network-changed:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h2-854121-3 Aug 24 02:56:06.225165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:56:06.235996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a7a82b13-672a-481a-af62-76668422ea27 req-91eb580f-d8ec-418d-b425-9184e0f334f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044718 Aug 24 02:56:06.236618 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5508/6500] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:06.329059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:06.330204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:06.340423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:06.341235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:06.341945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:06.343059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:06.343804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:06.344494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:06.507926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:06.516204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b29f560-6825-4dd2-a182-a4f0c3888501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1519 microversion: 2.1 time: 0.193377 Aug 24 02:56:06.516808 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5509/6501] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:06 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:07.538195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:07.538831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:07.546016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:07.546520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:07.546980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:07.547701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:07.548332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:07.548627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:07.686829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:07.694920 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f0eab55-4748-4bc9-b5d5-86300a2764d4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1519 microversion: 2.1 time: 0.161255 Aug 24 02:56:07.695521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5510/6502] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:07 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:08.718427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:08.719149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:08.726108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.726605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.727051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:08.727761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.728220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.728652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:08.861664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:08.870303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7bbe1342-21c6-4d39-b61c-fa529bc0d9da tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1516 microversion: 2.1 time: 0.155838 Aug 24 02:56:08.870883 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5511/6503] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:08 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:08.890034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:08.890590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:08.896602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.897134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.897588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:08.898296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.898769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.899219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:08.957181 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8e911859-54e6-487e-99f7-5fb9b8e732bf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37/action" status: 204 len: 0 microversion: 2.1 time: 0.070572 Aug 24 02:56:08.957839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5512/6504] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:56:08 2022] POST /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:56:08.966755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:08.967461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:08.973737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.974830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.975284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:08.975992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:08.976457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:08.976922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:09.123702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:09.132625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9d018e0-9aa4-4bc6-89d5-ddfbb4b47309 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1516 microversion: 2.1 time: 0.169984 Aug 24 02:56:09.133450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5513/6505] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:08 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:10.153701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:10.154392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:10.161605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:10.162118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:10.162573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:10.163283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:10.163755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:10.164268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:10.303562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:10.312183 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88fece20-8dbf-474a-9c95-d2cd6c499cfc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1516 microversion: 2.1 time: 0.162288 Aug 24 02:56:10.312822 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5514/6506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:10 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:10.667197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "name": "network-vif-plugged", "status": "completed", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:10.679842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:10.680347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:10.680829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:10.692417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] Creating event network-vif-plugged:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h2-854121-3 Aug 24 02:56:10.699350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0f6ab4b8-ae24-44e6-bee8-41f8490812a4 req-00b07653-3b85-41f3-902d-65972d7bbe1f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Aug 24 02:56:10.700012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5515/6507] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:11.335224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:11.336219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:11.344261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:11.344791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:11.345251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:11.345974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:11.346447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:11.346889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:11.484607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:11.493009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a59c6ac1-a81d-49e9-ba20-f4adf5f3dbd3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1508 microversion: 2.1 time: 0.162766 Aug 24 02:56:11.493527 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5516/6508] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:11 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:11.515961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:11.516583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:11.518626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=62 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:11.524534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:11.525063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:11.525519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:11.526233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:11.526701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:11.527142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:11.663914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:11.672901 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3594e81-62ff-4b92-82c4-4ca669553be5 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1508 microversion: 2.1 time: 0.160640 Aug 24 02:56:11.673565 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5517/6509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:11 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:11.698839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e687ce81-3e1f-4db3-bb02-6ad36cd2152f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'create', calling method: .version_select at 0x7f6b91004ee0>, body: {"keypair": {"name": "tempest-keypair-563971079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBWxI65FB0w5g+dKq+7cJL4+eRqq6KwKl9LuLKNwHti1BNCspT8ahv7eSx6QgH8seOc0hse1yFuiw70UErHkeeckL3tojP+C8QSFYYwf33sHSvyrtHtjxNFnOB1VttLRg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:11.716352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e687ce81-3e1f-4db3-bb02-6ad36cd2152f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for project e55a83c14988486f936dc876df95225f. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:56:11.722206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e687ce81-3e1f-4db3-bb02-6ad36cd2152f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for user 43ec333ad2054fbca4f7c7a9225922c2 and project e55a83c14988486f936dc876df95225f. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:56:11.752258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e687ce81-3e1f-4db3-bb02-6ad36cd2152f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057408 Aug 24 02:56:11.752818 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5518/6510] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:56:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:12.984826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:12.985533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:12.992710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:12.993240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:12.993695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:12.994408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:12.994891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:12.995327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:13.133600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:13.141782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-00a3783a-5594-44c6-ae19-0174a7049141 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 200 len: 1508 microversion: 2.1 time: 0.161817 Aug 24 02:56:13.142354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5519/6511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:12 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:13.162245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:13.162837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:13.169486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:13.170061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:13.170595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:13.171376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:13.171917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:13.172439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:13.188983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:13.201757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:56:13.280484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0503de72-5e07-4ff9-96ab-fa30b6f21de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 204 len: 0 microversion: 2.1 time: 0.122001 Aug 24 02:56:13.281137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5520/6512] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:56:13 2022] DELETE /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:56:13.342043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-606450606", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "7dad8757-b163-4ce1-b6d4-2d526595099d"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:13.404075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] validate_networks() for [('7dad8757-b163-4ce1-b6d4-2d526595099d', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:56:13.783422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:56:13.783991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:56:13.784624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:56:13.785247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:56:13.785843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:56:13.797742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:13.798409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:13.798861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:13.799595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:13.800057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:13.800494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:13.817645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for project e55a83c14988486f936dc876df95225f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:56:13.822922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Getting quotas for user 43ec333ad2054fbca4f7c7a9225922c2 and project e55a83c14988486f936dc876df95225f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:56:13.835126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:56:13.837551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:56:13.883709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3fdd73c-55a5-4411-b9f9-317809b23825 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546619 Aug 24 02:56:13.884361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5521/6513] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:56:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:56:13.897989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6d0ab0b-6253-4bfd-812b-27f083e4e6e1 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:13.898607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6d0ab0b-6253-4bfd-812b-27f083e4e6e1 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:13.951578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6d0ab0b-6253-4bfd-812b-27f083e4e6e1 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:13.959739 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6d0ab0b-6253-4bfd-812b-27f083e4e6e1 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1217 microversion: 2.1 time: 0.065602 Aug 24 02:56:13.960312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5522/6514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:13 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:14.981219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:14.981853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:14.988799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:14.989567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:14.990019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:14.990953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:14.991193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:14.991633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:15.058853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:15.067764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfc12b9e-512c-4879-bfd2-f8b591adb281 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1269 microversion: 2.1 time: 0.090436 Aug 24 02:56:15.069841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5523/6515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:14 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1269 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:15.557658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f9752-e157-43a2-a5c4-6a1ce232df37", "name": "network-vif-deleted", "tag": "df44a1d9-fd05-424d-a928-9a84aac45642"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:15.573560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:15.574061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:15.574703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:15.589738 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] Creating event network-vif-deleted:df44a1d9-fd05-424d-a928-9a84aac45642 for instance b71f9752-e157-43a2-a5c4-6a1ce232df37 on n-h2-854121-3 Aug 24 02:56:15.596452 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fae91bda-c890-4518-948a-eb9289e1e68f req-8b41b8f2-e9b6-41f3-8595-60a6383d6a2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043254 Aug 24 02:56:15.597939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5524/6516] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:56:16.091745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:16.092772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:16.101196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:16.101786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:16.102244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:16.102967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:16.103438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:16.103880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:16.271775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:16.280450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ee59e6b-5101-4b2d-8575-563b2bfc57de tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.193040 Aug 24 02:56:16.281067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5525/6517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:16 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:17.303879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:17.304516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:17.311881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:17.312386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:17.312866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:17.313601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:17.314069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:17.314511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:17.453600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:17.461871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15ff013d-fe1f-4d66-9649-c50b4b77c2e0 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.161925 Aug 24 02:56:17.462542 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5526/6518] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:17 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:17.619118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:17.628707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:17.629232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:17.629681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:17.640649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] Creating event network-changed:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h2-854121-3 Aug 24 02:56:17.645408 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4259cb58-a1c6-492b-a907-9b2fba9772d3 req-b38161c8-6172-411f-a84e-cb202b238a2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031144 Aug 24 02:56:17.646065 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5527/6519] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:18.483972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:18.484681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:18.491414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:18.491892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:18.492347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:18.493096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:18.493569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:18.494012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:18.627658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:18.637205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc2dd1ca-3396-4abe-aeb2-60537c3a9be3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.158126 Aug 24 02:56:18.637996 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5528/6520] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:18 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:19.659371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:19.660400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:19.670489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:19.671564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:19.672083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:19.673618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:19.675357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:19.676021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:19.827455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:19.836095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c1c5258-9fb3-4ea7-9cdb-40c11c060377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.181285 Aug 24 02:56:19.836694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5529/6521] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:19 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:20.857328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:20.857981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:20.865839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:20.866347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:20.866804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:20.868209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:20.868209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:20.868446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:21.000077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:21.008570 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c089d5f-b987-4a66-a0c0-ff499287263b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.155055 Aug 24 02:56:21.009155 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5530/6522] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:20 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:22.029510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:22.030119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:22.036990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:22.037539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:22.037992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:22.038693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:22.039157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:22.039590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:22.176975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:22.184750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dd78ac4-bd7e-4cc7-b1c4-382087d20876 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.159212 Aug 24 02:56:22.185332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5531/6523] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:22 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:22.754846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "name": "network-vif-plugged", "status": "completed", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:22.767348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:22.768417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:22.769020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:22.782677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] Creating event network-vif-plugged:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h2-854121-3 Aug 24 02:56:22.788549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-344b8f69-acb7-4a84-9cec-8a555e9b12eb req-f1dc9907-7e6d-4cab-8da8-42cd12bbf15e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037656 Aug 24 02:56:22.789181 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5532/6524] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:23.208681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:23.209640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:23.215532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:23.216020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:23.216467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:23.217190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:23.217652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:23.218087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:23.354822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:23.362761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34b935bd-fd37-40c6-920e-ab717dc1883b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1317 microversion: 2.1 time: 0.159290 Aug 24 02:56:23.363336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5533/6525] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:23 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:24.384750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:24.385398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:24.387363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:24.388110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:24.394912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.395413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.396497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.397232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.397700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.398139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.540854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:24.549714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ace1d9c-9a70-4939-bb5e-c8cae51c9a62 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1508 microversion: 2.1 time: 0.169621 Aug 24 02:56:24.550418 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5534/6526] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:24 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:24.570054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:24.570672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:24.576708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.577237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.577687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.578463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.578882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.579422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.713656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:24.721714 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29ff902e-b3f4-4f24-acef-a7bb7125cca7 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1508 microversion: 2.1 time: 0.155433 Aug 24 02:56:24.722434 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5535/6527] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:24 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:24.743293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:24.745540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:24.751580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.752068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.752514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.753247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.753710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.754148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.783363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:24.789861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:56:24.796398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:56:24.796861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:56:24.797347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:56:24.797768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:56:24.798188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:56:24.862549 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9b8bde7-234a-4c2e-b326-06938767f501 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31/action" status: 202 len: 0 microversion: 2.1 time: 0.123673 Aug 24 02:56:24.863362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5536/6528] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:56:24 2022] POST /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:56:24.872748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:24.873508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:24.881279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.882001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.882669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:24.883621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:24.884298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:24.885046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:25.062217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:25.064427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:25.071256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bbf4c7d-9fca-476c-8efb-9d00e64f4103 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1515 microversion: 2.1 time: 0.202862 Aug 24 02:56:25.071838 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5537/6529] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:24 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:26.093378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:26.094003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:26.102692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:26.103205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:26.103697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:26.104711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:26.105210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:26.105649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:26.244567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:26.255609 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3bbef45d-8e03-4048-ad5d-d415d31defe3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1515 microversion: 2.1 time: 0.165879 Aug 24 02:56:26.256209 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5538/6530] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:26 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:27.276824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:27.277457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:27.284511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:27.285051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:27.285510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:27.286235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:27.286705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:27.287152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:27.422078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:27.430381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd648965-70ac-4195-b744-3491cda674d3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.157619 Aug 24 02:56:27.430953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5539/6531] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:27 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:28.452861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:28.453884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:28.461993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:28.462494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:28.462944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:28.463663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:28.464126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:28.464565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:28.598499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:28.606921 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17df0ae0-2517-4a99-a9a7-cfc0e6161cb4 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.158580 Aug 24 02:56:28.607494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5540/6532] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:28 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:29.629313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:29.629972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:29.636924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:29.637459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:29.637907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:29.638617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:29.639089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:29.639524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:29.778672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:29.787321 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-82f47cfa-99e1-4797-a0c4-c0bd31424faf tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.161369 Aug 24 02:56:29.787903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5541/6533] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:29 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:30.808593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:30.809266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:30.815885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:30.816390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:30.816883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:30.818133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:30.818607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:30.819051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:30.961145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:30.969262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba8ee679-2387-469f-9915-003ea27070ab tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.164861 Aug 24 02:56:30.969857 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5542/6534] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:30 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:31.990579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:31.991210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:31.998078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:31.998579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:31.999038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:31.999757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:32.000253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:32.000696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:32.129388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:32.137830 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98d47f84-8d52-44c0-aadd-28aaea707efd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.151575 Aug 24 02:56:32.138405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5543/6535] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:31 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:33.159697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:33.160382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:33.167409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:33.167909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:33.168371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:33.169123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:33.169598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:33.170042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:33.308228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:33.316383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ee2762f-9b8c-45bd-b86b-261a6ddb73a6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.160639 Aug 24 02:56:33.317012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5544/6536] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:33 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:34.339184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:34.339809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:34.346824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:34.347332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:34.347787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:34.348503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:34.349555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:34.350003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:34.479245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:34.487513 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59fc56d7-0edd-4f87-8cc7-98cc1008d318 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.152325 Aug 24 02:56:34.488095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5545/6537] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:34 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:35.509963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:35.510613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:35.517648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:35.518141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:35.518593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:35.519296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:35.519759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:35.520205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:35.650909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:35.658658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0f7a14c-3020-40df-8fa7-b7cce7cd331d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.152758 Aug 24 02:56:35.659229 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5546/6538] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:35 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:36.680150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:36.680875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:36.687780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:36.688277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:36.688738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:36.689461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:36.689928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:36.690393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:36.828232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:36.836672 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35d5c9a9-b0e4-48cf-b2e8-4881785089a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.161009 Aug 24 02:56:36.837323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5547/6539] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:36 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:37.859356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:37.860065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:37.867820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:37.868320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:37.868797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:37.869496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:37.869957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:37.870396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:38.005623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:38.013534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d59b1b1-bb73-4947-af80-368025633267 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.158055 Aug 24 02:56:38.014114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5548/6540] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:37 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:39.036064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:39.036832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:39.039670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:39.045901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:39.046729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:39.047208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:39.047932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:39.048399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:39.048864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:39.188970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:39.197611 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5162046-7d8e-411d-824a-2424eb56c540 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.165968 Aug 24 02:56:39.198189 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5549/6541] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:39 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:40.220372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:40.221137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:40.228480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:40.229021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:40.229474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:40.230200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:40.230666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:40.231101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:40.363496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:40.372283 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a23911f7-0907-4d31-92fe-031129a26377 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.156223 Aug 24 02:56:40.372879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5550/6542] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:40 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:41.394136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:41.394816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:41.402303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:41.402790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:41.403235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:41.403937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:41.404399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:41.404870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:41.539063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:41.546977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9678a2f8-c724-4f11-bc17-8c271e0cf500 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.156788 Aug 24 02:56:41.547552 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5551/6543] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:41 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:42.569523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:42.570192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:42.577237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:42.577742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:42.578198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:42.578922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:42.579393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:42.579839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:42.712849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:42.720750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05fe8b16-3637-4291-aba7-59a55e7afadc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.155764 Aug 24 02:56:42.721330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5552/6544] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:42 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:43.743284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:43.743946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:43.750966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:43.751479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:43.751935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:43.752663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:43.753167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:43.753613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:43.894329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:43.903298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-18bcf1ef-329d-4d9b-910f-d17a512aff54 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.164665 Aug 24 02:56:43.904064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5553/6545] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:43 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:44.926771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:44.927442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:44.934767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:44.935282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:44.935807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:44.936523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:44.937082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:44.937518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:44.954716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:45.085606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:45.094727 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2d84fd7-3cd5-4b4a-ab7b-aba9a75dc810 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.173769 Aug 24 02:56:45.095309 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5554/6546] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:44 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:46.117776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:46.118528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:46.125394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:46.125887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:46.126335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:46.127034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:46.127494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:46.127928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:46.260833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:46.268897 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92417e34-30d4-4fc4-93c2-2ba50ac82de9 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.155836 Aug 24 02:56:46.269478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5555/6547] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:46 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:47.290352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:47.291016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:47.298059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:47.298784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:47.299238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:47.299950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:47.300447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:47.300926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:47.434294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:47.442725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-374042e9-d67b-4fc5-8eae-799015ab6931 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.155912 Aug 24 02:56:47.443312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5556/6548] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:47 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:48.464321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:48.465089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:48.471946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:48.472446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:48.472940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:48.473657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:48.474125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:48.474573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:48.605848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:48.613643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69e25e0c-1f8e-4c3b-a198-88b4135d4e67 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.153347 Aug 24 02:56:48.614998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5557/6549] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:48 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:49.634938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:49.636013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:49.643222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:49.643745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:49.644180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:49.645001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:49.645477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:49.646056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:49.776529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:49.784418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7cc985e0-5e1e-4d71-86d4-9e0c94f483a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.153416 Aug 24 02:56:49.785028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5558/6550] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:49 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:50.806246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:50.806904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:50.814016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:50.814520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:50.814980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:50.815694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:50.816171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:50.816614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:50.956040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:50.963929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02bb772d-869a-4dde-86c5-a6daf4138e01 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.161651 Aug 24 02:56:50.964526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5559/6551] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:50 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:51.985813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:51.986532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:51.993699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:51.994205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:51.994662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:51.995380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:51.995882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:51.996336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:52.126849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:52.135531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adf57519-84ec-41ae-9391-363805e67e1d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.153750 Aug 24 02:56:52.136122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5560/6552] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:51 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:53.156926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:53.157614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:53.164461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:53.164992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:53.165453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:53.166160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:53.166629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:53.167066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:53.299634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:53.307813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70dbc969-6d83-4a22-ac1b-93de3cf323c6 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1520 microversion: 2.1 time: 0.154801 Aug 24 02:56:53.308407 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5561/6553] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:53 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:54.332763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:54.333959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:54.344972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:54.345791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:54.346461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:54.347604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:54.348362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:54.349044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:54.485481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:54.494490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dcffffb1-afcf-4ac1-89a5-69de238d4884 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1519 microversion: 2.1 time: 0.168951 Aug 24 02:56:54.495064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5562/6554] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:54 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:56:54.684708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "name": "network-vif-unplugged", "status": "completed", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:54.694908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:54.695410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:54.695939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:54.709412 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Creating event network-vif-unplugged:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h1-854121-3 Aug 24 02:56:54.715296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] Instance 839ecea0-b924-44dc-8132-74f1659afe31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:56:54.726669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f8dd05c6-cc35-4e36-a4bf-840f80ec03a8 req-7bdd174f-4cce-4b41-9cb4-3f49256ebb2b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045698 Aug 24 02:56:54.727298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5563/6555] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:56:55.518237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:55.519840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:55.526492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:55.527016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:55.527471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:55.528179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:55.528641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:55.529107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:55.667364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:55.675170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20361441-a51f-409d-a824-058b28f72f70 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1517 microversion: 2.1 time: 0.162620 Aug 24 02:56:55.675752 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5564/6556] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:55 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:56.697606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:56.698265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:56.705562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:56.706056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:56.706503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:56.707201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:56.708177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:56.708639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:56.873960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:56.882546 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-375a0ae1-cc5a-4e11-96d5-c8ac0fd4124b tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1517 microversion: 2.1 time: 0.188807 Aug 24 02:56:56.883127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5565/6557] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:56 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:56.887705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:56.897589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:56.898077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:56.898522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:56.913148 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Creating event network-changed:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h1-854121-3 Aug 24 02:56:56.918599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] Instance 839ecea0-b924-44dc-8132-74f1659afe31 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:56:56.929380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-36ca1394-7156-463d-9e55-ce3638caede9 req-a002c3ab-0433-4e79-8bfd-9fbc2e1832c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045129 Aug 24 02:56:56.929986 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5566/6558] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:56:57.905060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:57.905826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:57.912696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:57.913218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:57.913670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:57.914411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:57.914874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:57.915310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:58.051375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:58.060090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba0cd872-b178-4302-b3c8-e9196bcb166f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1517 microversion: 2.1 time: 0.160185 Aug 24 02:56:58.060674 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5567/6559] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:57 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:59.081857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:59.082506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:59.089419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.089919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.090401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.091133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.091643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.092084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.460105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:59.467903 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a6cd0be-0c5d-429e-bf8b-b1975e4c3795 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1514 microversion: 2.1 time: 0.390119 Aug 24 02:56:59.468481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5568/6560] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:59 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:56:59.489248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:56:59.490068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:59.496036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.496542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.497065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.497787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.498257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.498700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.556348 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13539466-8faa-4732-8772-8c3148d30b3f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "POST /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31/action" status: 204 len: 0 microversion: 2.1 time: 0.071471 Aug 24 02:56:59.557038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5569/6561] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:56:59 2022] POST /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:56:59.565473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:56:59.566195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:56:59.572351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.572886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.573417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.574107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:56:59.574586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:56:59.575023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:56:59.593783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:56:59.719491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:56:59.728636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5100d4e-a33e-4fdc-9d47-7777c541d4cd tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1514 microversion: 2.1 time: 0.167161 Aug 24 02:56:59.729957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5570/6562] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:56:59 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:00.751443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:00.752220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:00.759201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:00.759714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:00.760172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:00.760935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:00.761412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:00.761858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:00.913750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:00.922188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7fb60f05-d9cf-447b-99f6-62d761936a8a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1514 microversion: 2.1 time: 0.175149 Aug 24 02:57:00.922955 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5571/6563] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:00 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:57:01.240160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "name": "network-vif-plugged", "status": "completed", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:01.250352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:01.250861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:01.251417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:01.264395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] Creating event network-vif-plugged:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h1-854121-3 Aug 24 02:57:01.269915 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ac8f783b-9faa-4e07-bfda-954c5be8c6bc req-60559766-1d00-4dfe-a9e1-938336cd96ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035508 Aug 24 02:57:01.270774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5572/6564] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:57:01.944558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:01.945225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:01.951450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:01.951990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:01.952450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:01.953189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:01.953665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:01.954115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.084900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:02.092797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20b529fc-4361-41fc-b738-a6fefe6653fb tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1506 microversion: 2.1 time: 0.153420 Aug 24 02:57:02.093379 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5573/6565] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:01 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:02.113481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:02.114109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:02.120353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.120899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.121356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.122066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.122538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.122986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.265172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:02.273757 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-faed1ad3-b41f-4df5-8e39-21c2229660f8 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1506 microversion: 2.1 time: 0.164000 Aug 24 02:57:02.274431 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5574/6566] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:02 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:02.295107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:02.295831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:02.302011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.302578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.303095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.303802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.304268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.304731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.443749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:02.453674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac7b755f-db21-4ec3-aa97-b581ae61728a tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1506 microversion: 2.1 time: 0.162045 Aug 24 02:57:02.454831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5575/6567] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:02 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:02.475829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:02.476469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:02.482764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.483276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.483733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.484464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.484969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.485414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.513098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:57:02.602049 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2aab8bb1-73fa-437e-87c6-212267c4218d tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 204 len: 0 microversion: 2.1 time: 0.130073 Aug 24 02:57:02.602667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5576/6568] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:57:02 2022] DELETE /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:57:02.623069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:02.623664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:02.630486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.630979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.631428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.632135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.632600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.633067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.660029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:57:02.706387 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.compute.api [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Instance is already in deleting state, ignoring this request Aug 24 02:57:02.707180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61914be8-e374-4493-bb69-933a4e75fa78 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 204 len: 0 microversion: 2.1 time: 0.088795 Aug 24 02:57:02.707956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5577/6569] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:57:02 2022] DELETE /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:57:02.716119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:02.716884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:02.724524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.725069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.725526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.726259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:02.726790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:02.727342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:02.865116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:02.873180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f76c8f5-6964-4d57-9b19-c2ce29087691 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1512 microversion: 2.1 time: 0.161371 Aug 24 02:57:02.873765 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5578/6570] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:02 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:03.895475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:03.896437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:03.903364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:03.903875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:03.904333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:03.905090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:03.905575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:03.906017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:04.038342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:04.046296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3dde986e-2fe5-43f2-a71a-bcd5930ebffa tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1512 microversion: 2.1 time: 0.155340 Aug 24 02:57:04.046879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5579/6571] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:03 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:04.962784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ecea0-b924-44dc-8132-74f1659afe31", "name": "network-vif-deleted", "tag": "08f8c324-695a-452b-a725-d8d20ab4c1df"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:04.973978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:04.974472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:04.974919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:04.990521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] Creating event network-vif-deleted:08f8c324-695a-452b-a725-d8d20ab4c1df for instance 839ecea0-b924-44dc-8132-74f1659afe31 on n-h1-854121-3 Aug 24 02:57:04.995573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1c8bc581-7103-46d0-ae1a-41e0a85181f4 req-3f813baa-76a9-44ba-96d6-dbda00c16b25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036944 Aug 24 02:57:04.996244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5580/6572] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:57:05.070175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:05.071515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:05.078052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:05.078557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:05.079004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:05.079900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:05.080369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:05.080831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:05.114019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:05.114515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:05.115215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:05.115787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lazy-loading 'fault' on Instance uuid 839ecea0-b924-44dc-8132-74f1659afe31 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 02:57:05.159078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43ec333ad2054fbca4f7c7a9225922c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55a83c14988486f936dc876df95225f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:05.167428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56d3bc66-304c-46ed-b2e2-2499fb27a387 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 200 len: 1305 microversion: 2.1 time: 0.103256 Aug 24 02:57:05.167999 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5581/6573] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:05 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:57:06.189346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:06.190018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: 839ecea0-b924-44dc-8132-74f1659afe31] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:06.197888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:06.198387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:06.198843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:06.199582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:06.200052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:06.200491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:06.215109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] HTTP exception thrown: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Request method failure captured: Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 HTTP/1.1 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZMafjPmXDmMzJZlKzqN01vhJ_dHapGQ-w_8G9e6TJ-P0sYZZOPkYBjHwt9vyacofBdU3uYrSMmyGHYFFVkBlWhWYWrvsw-KKi6XvldaKfXl4NYXiH2skxs_69K_TKAZXuciymFKfTRua-zzWxsxUuxepUrFoR8oY7w11WVeHgJx2zs Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e55a83c14988486f936dc876df95225f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e55a83c14988486f936dc876df95225f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 43ec333ad2054fbca4f7c7a9225922c2 Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '839ecea0-b924-44dc-8132-74f1659afe31'} Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:06.216874 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Returning 404 to user: Instance 839ecea0-b924-44dc-8132-74f1659afe31 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a877ece-db23-4659-a7e7-8b390b6273bc tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31" status: 404 len: 111 microversion: 2.1 time: 0.032943 Aug 24 02:57:06.222683 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5582/6574] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:06 2022] GET /compute/v2.1/servers/839ecea0-b924-44dc-8132-74f1659afe31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:57:06.227332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9262cdc4-c2cb-48da-82d5-2faa33f7fc2f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '.version_select at 0x7f6b9192f940>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:06.250253 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9262cdc4-c2cb-48da-82d5-2faa33f7fc2f tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-563971079" status: 202 len: 0 microversion: 2.1 time: 0.026093 Aug 24 02:57:06.251106 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5583/6575] 10.222.0.49 () {58 vars in 1218 bytes} [Wed Aug 24 02:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-563971079 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:57:07.196249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:07.196861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:07.204544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:07.205081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:07.205539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:07.206246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:07.206716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:07.207678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:07.220923 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] HTTP exception thrown: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Request method failure captured: Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 HTTP/1.1 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZMafjPmXDmMzJZlKzqN01vhJ_dHapGQ-w_8G9e6TJ-P0sYZZOPkYBjHwt9vyacofBdU3uYrSMmyGHYFFVkBlWhWYWrvsw-KKi6XvldaKfXl4NYXiH2skxs_69K_TKAZXuciymFKfTRua-zzWxsxUuxepUrFoR8oY7w11WVeHgJx2zs Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e55a83c14988486f936dc876df95225f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e55a83c14988486f936dc876df95225f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 43ec333ad2054fbca4f7c7a9225922c2 Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b71f9752-e157-43a2-a5c4-6a1ce232df37'} Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:57:07.222585 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Returning 404 to user: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c60cad0-3317-4506-93bf-759111f66634 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 404 len: 111 microversion: 2.1 time: 0.032346 Aug 24 02:57:07.227304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5584/6576] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:57:07 2022] DELETE /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:57:07.233222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:07.233850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] [instance: b71f9752-e157-43a2-a5c4-6a1ce232df37] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:07.240631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:07.241157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:07.241611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:07.242320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:07.242789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:07.243228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:07.257218 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] HTTP exception thrown: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Request method failure captured: Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 HTTP/1.1 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZMafjPmXDmMzJZlKzqN01vhJ_dHapGQ-w_8G9e6TJ-P0sYZZOPkYBjHwt9vyacofBdU3uYrSMmyGHYFFVkBlWhWYWrvsw-KKi6XvldaKfXl4NYXiH2skxs_69K_TKAZXuciymFKfTRua-zzWxsxUuxepUrFoR8oY7w11WVeHgJx2zs Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/e55a83c14988486f936dc876df95225f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/e55a83c14988486f936dc876df95225f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_e55a83c14988486f936dc876df95225f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: e55a83c14988486f936dc876df95225f Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1140591898 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 43ec333ad2054fbca4f7c7a9225922c2 Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerDiskConfigTestJSON-1140591898-project Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b71f9752-e157-43a2-a5c4-6a1ce232df37'} Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:57:07.258750 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] Returning 404 to user: Instance b71f9752-e157-43a2-a5c4-6a1ce232df37 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:57:07.262996 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e3fc166f-8b56-42f5-9e4e-2e9e0d9912a3 tempest-ServerDiskConfigTestJSON-1140591898 tempest-ServerDiskConfigTestJSON-1140591898-project] 10.222.0.49 "GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37" status: 404 len: 111 microversion: 2.1 time: 0.030596 Aug 24 02:57:07.264073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5585/6577] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:07 2022] GET /compute/v2.1/servers/b71f9752-e157-43a2-a5c4-6a1ce232df37 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 02:57:15.662288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc13c15c-5494-4c6d-a8e0-77c9ed7c5ddb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: .version_select at 0x7f6b925ae430>, body: {"keypair": {"name": "tempest-keypair-1453161191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO21nXcPzJx5LCTjHB2cegFE887lgI4iJ1YnShkVW0biX9Bj4M4WyOIJQ2dRVarLJ0cefZAdp2bHpCuWaO7FnB7A4c/cqCrv/yEl0+u3hYKOFBIQQgAzHKTfNiESRZHqkA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:15.668122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:57:15.682597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cc13c15c-5494-4c6d-a8e0-77c9ed7c5ddb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:57:15.687977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cc13c15c-5494-4c6d-a8e0-77c9ed7c5ddb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:57:15.717965 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc13c15c-5494-4c6d-a8e0-77c9ed7c5ddb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188948 Aug 24 02:57:15.719151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5586/6578] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 02:57:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:57:17.240476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1510253986", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f85c86-8aa8-45a1-90e8-0e96ed4115e7"}], "security_groups": [{"name": "tempest-securitygroup--1085985116"}], "key_name": "tempest-keypair-1453161191", "user_data": "}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:17.254555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:57:17.362428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] validate_networks() for [('99f85c86-8aa8-45a1-90e8-0e96ed4115e7', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:57:17.770872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:57:17.771308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:57:17.771816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:57:17.772372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:57:17.772821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:57:17.782863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:17.783358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:17.783804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:17.784546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:17.785629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:17.786094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:17.805091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:57:17.813387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:57:17.833498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:57:17.836873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:57:17.893444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f527cd07-e582-456f-bb5a-8a5c8e3f5a83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.658988 Aug 24 02:57:17.900499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5587/6579] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:57:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 02:57:17.906658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-850f917a-f46b-40b1-8925-4830a7c8021d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:17.907353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-850f917a-f46b-40b1-8925-4830a7c8021d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:17.969293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-850f917a-f46b-40b1-8925-4830a7c8021d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:17.977886 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-850f917a-f46b-40b1-8925-4830a7c8021d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1239 microversion: 2.1 time: 0.075837 Aug 24 02:57:17.978469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5588/6580] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:17 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1239 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:57:19.000018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:19.000668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:19.007821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:19.008368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:19.008850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:19.009797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:19.010464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:19.010937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:19.089096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:19.098652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f3a56ee-4d80-4c22-ae29-af4460fa818a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1291 microversion: 2.1 time: 0.102514 Aug 24 02:57:19.099519 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5589/6581] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:18 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1291 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:57:20.120411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:20.120411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:20.131590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:20.132282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:20.132761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:20.133499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:20.133978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:20.134424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:20.275413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:20.284086 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-245165a5-1882-42aa-aa45-f86d591f98f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.168230 Aug 24 02:57:20.284911 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5590/6582] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:20 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:20.469105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:20.478616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:20.479107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:20.479608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:20.492995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] Creating event network-changed:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h2-854121-3 Aug 24 02:57:20.498637 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e97605f1-4bb8-458b-a308-3631f241cb04 req-3e297b7d-3245-4754-a912-dca8666b128d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033073 Aug 24 02:57:20.499291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5591/6583] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:57:21.306951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:21.307695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:21.313933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:21.314486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:21.314954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:21.315657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:21.316685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:21.317148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:21.445643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:21.453386 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-863b1ba7-5e1c-40b4-acd9-2a0b736c1bd5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.151485 Aug 24 02:57:21.453954 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5592/6584] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:21 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:22.474276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:22.475122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:22.482125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:22.482640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:22.483329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:22.484087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:22.484564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:22.485046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:22.619369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:22.628057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89e8f6e1-f8f3-4f2c-9a4e-bef857b9d35b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.157711 Aug 24 02:57:22.629217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5593/6585] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:22 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:23.649512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:23.650112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:23.657098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:23.657611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:23.658065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:23.658787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:23.659257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:23.659837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:23.791998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:23.799835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-335c3fc1-a2b6-459d-a2d5-f5d794e399c9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.154341 Aug 24 02:57:23.801098 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5594/6586] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:23 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:24.821131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:24.821809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:24.828683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:24.829214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:24.829668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:24.830372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:24.830839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:24.831281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:24.961676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:24.969544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-012e8291-a0b7-424e-b494-06fce46ad30d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.152346 Aug 24 02:57:24.970120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5595/6587] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:24 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:25.991148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:25.991745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:25.998703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:25.999203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:25.999653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:26.000358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:26.000862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:26.001304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:26.134238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:26.141985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4ff3e0e-55ab-4fb7-97f1-57cc732be7be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.155611 Aug 24 02:57:26.142555 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5596/6588] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:25 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:27.045015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "name": "network-vif-plugged", "status": "completed", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:27.055863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:27.056370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:27.057756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:27.069937 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] Creating event network-vif-plugged:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h2-854121-3 Aug 24 02:57:27.074902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-711bfb69-242d-4143-9a80-7e7842a88a96 req-262ee312-5509-47d1-b99d-de812c7e4477 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033762 Aug 24 02:57:27.075509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5597/6589] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:57:27.162870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:27.163544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:27.170520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:27.171031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:27.171490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:27.172435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:27.172940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:27.173390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:27.310195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:27.318577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9074ed0c-033e-4c99-a0bf-36724f2fc233 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.160931 Aug 24 02:57:27.319160 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5598/6590] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:27 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:28.341921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:28.342547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:28.344655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:57:28.345583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:57:28.354676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:28.355178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:28.355892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:28.356810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:28.357277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:28.357713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:28.489297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:28.498337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a8f4638-0ce7-4b72-aa6d-37d25f2c2eb0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1365 microversion: 2.1 time: 0.161375 Aug 24 02:57:28.498975 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5599/6591] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:28 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:29.520062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:29.520661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:29.527426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:29.527997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:29.528451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:29.529182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:29.529648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:29.530083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:29.656542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:57:29.665011 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4313f320-dedd-4912-b8b4-7c9f5889790d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1552 microversion: 2.1 time: 0.149490 Aug 24 02:57:29.665583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5600/6592] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:57:29 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:57:29.685222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:57:29.685730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:57:29.691852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:29.692381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:29.692862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:29.693566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:29.694047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:29.694487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:29.771769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01b19eec-06c4-4d80-89db-6ac0a7a77f72 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090336 Aug 24 02:57:29.772353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5601/6593] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:57:29 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:57:30.849586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:57:30.859585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:57:30.860084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:57:30.860537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:57:30.872703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] Creating event network-changed:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h2-854121-3 Aug 24 02:57:30.877804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-763ad750-9ad0-4573-ae1a-ad21eab7b964 req-e7e15084-3270-4f52-8ac0-75849cf56b1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082122 Aug 24 02:57:30.878531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5602/6594] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:58:46.062090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:58:46.062857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=72 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:58:46.067357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:46.068080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:46.075461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.075967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.076442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.077172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.077649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.078101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.266332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:46.274631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-625a9405-a5b5-43d7-9f2a-4c638ebb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.215602 Aug 24 02:58:46.275193 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5603/6595] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:46 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:46.294713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:46.295322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:46.300993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.301493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.301941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.302632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.303094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.303529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.435466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:46.444864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa3797bd-5629-48b8-981d-05687bc74f62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.153505 Aug 24 02:58:46.445546 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5604/6596] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:46 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:46.467001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:46.467634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:46.474298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.474803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.475259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.475972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.476447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.476921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.604012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:46.611735 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbeb05d1-edc0-453b-8f32-5ea6fc7135b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.148595 Aug 24 02:58:46.612304 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5605/6597] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:46 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:46.632413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:58:46.634779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:46.640578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.641117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.641564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.642257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.642730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.643165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.670989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:46.677226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 02:58:46.683650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:58:46.684078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:58:46.684558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:58:46.685016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:58:46.685438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:58:46.751764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d482152f-bc27-4600-8c66-968dc4ed48b3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/action" status: 202 len: 0 microversion: 2.1 time: 0.122974 Aug 24 02:58:46.752388 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5606/6598] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:58:46 2022] POST /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 02:58:46.760461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:46.761200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:46.767503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.768049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.768571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.769316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:46.771112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:46.771112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:46.930141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:46.938709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1582a349-6d62-4961-a5b4-489c2041a991 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1680 microversion: 2.1 time: 0.181964 Aug 24 02:58:46.939435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5607/6599] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:46 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:47.960386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:47.961644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:47.969220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:47.969717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:47.970163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:47.970867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:47.971426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:47.971897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:48.105445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:48.113519 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fc34e52-9424-4980-8bb2-84b936822dc6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1680 microversion: 2.1 time: 0.156973 Aug 24 02:58:48.114195 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5608/6600] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:47 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:49.136295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:49.136991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:49.144041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:49.144539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:49.145537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:49.146293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:49.146716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:49.147153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:49.282336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:49.290271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-61596258-6701-4a52-a1b2-5005c1d334e4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1680 microversion: 2.1 time: 0.158293 Aug 24 02:58:49.290851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5609/6601] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:49 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:50.311358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:50.311982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:50.319306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:50.319799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:50.320243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:50.320973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:50.321443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:50.321878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:50.455314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:50.463652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ba44f4fb-2570-41d0-ad9a-6db831f23c05 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.156089 Aug 24 02:58:50.464233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5610/6602] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:50 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:51.485073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:51.485732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:51.492800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:51.493239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:51.493691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:51.494469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:51.494937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:51.495374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:51.627241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:51.635994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e64a80f-c456-46b0-9a3a-9447f2a5fdb2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.154867 Aug 24 02:58:51.636567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5611/6603] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:51 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:58:52.660272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:52.661433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:52.669784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:52.670286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:52.670733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:52.671445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:52.671906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:52.672338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:52.809779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:52.818262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5cdb4a41-dd86-4dbb-a366-557229330ad4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.164118 Aug 24 02:58:52.818831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5612/6604] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:52 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:53.839462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:53.840084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:53.846847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:53.847351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:53.847805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:53.848518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:53.849020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:53.849469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:53.975245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:53.982986 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64b0990e-c523-48f6-8f39-3be1a48cc703 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.147523 Aug 24 02:58:53.983566 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5613/6605] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:53 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:55.004838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:55.005510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:55.012481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:55.013007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:55.013458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:55.014153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:55.014617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:55.015089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:55.151251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:55.160383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-017d4e07-9a0a-4040-9a6d-c2c7a8c7427b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.159606 Aug 24 02:58:55.160984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5614/6606] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:54 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:56.183138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:56.183790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:56.190827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:56.191315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:56.191758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:56.192454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:56.192945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:56.193381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:56.335822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:56.344320 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97e9def7-3b91-4d2e-8d10-b65a3fd09d27 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.165094 Aug 24 02:58:56.344917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5615/6607] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:56 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:57.366360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:57.367041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:57.374061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:57.374553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:57.375000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:57.375699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:57.376158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:57.376590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:57.508985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:57.516626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f176b33-bb21-464d-87d9-98ff44edc617 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.154570 Aug 24 02:58:57.517230 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5616/6608] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:57 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:58.538925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:58.539558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:58.546522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:58.547024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:58.547470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:58.548174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:58.548647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:58.549112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:58.678532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:58.686402 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8ab2b34-e92b-4357-9531-6b9a51820248 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.151846 Aug 24 02:58:58.686974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5617/6609] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:58 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:58:59.708067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:58:59.708846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:58:59.715638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:59.716134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:59.716581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:59.717314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:58:59.717782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:58:59.718221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:58:59.722271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:58:59.854640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:58:59.862433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b0103d4-24fc-4725-a3c5-0367eceb2b7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.158811 Aug 24 02:58:59.863015 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5618/6610] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:58:59 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:00.884368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:00.885059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:00.891322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:00.891818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:00.892268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:00.892990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:00.893455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:00.893894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:01.024526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:01.032211 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f55da8b-44fc-4c75-95cd-8649afcf80e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1685 microversion: 2.1 time: 0.151769 Aug 24 02:59:01.032799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5619/6611] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:00 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:02.053809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:02.054797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:02.061853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:02.062350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:02.062801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:02.063508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:02.063969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:02.064436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:02.198716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:02.206762 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df86805c-8fbc-4c69-a657-2bfa93fdf127 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1684 microversion: 2.1 time: 0.157012 Aug 24 02:59:02.207956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5620/6612] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:02 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:02.334973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "name": "network-vif-unplugged", "status": "completed", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:02.345757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:02.346329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:02.346839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:02.358893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Creating event network-vif-unplugged:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h1-854121-3 Aug 24 02:59:02.364443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:59:02.376705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d05df164-cf51-49a1-b96a-f481c3be2333 req-a81320e3-74ee-4f69-89d5-3ce4aaea5bf0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102125 Aug 24 02:59:02.377341 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5621/6613] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:59:03.232892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:03.233738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:03.243741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:03.244250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:03.244701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:03.245436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:03.245900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:03.246349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:03.641717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:03.650383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2eaf4bb-e406-4a14-8d19-3ef05a98e996 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1684 microversion: 2.1 time: 0.422746 Aug 24 02:59:03.650781 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5622/6614] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:03 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1684 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:59:04.399896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:04.410991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:04.411474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:04.411913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:04.423862 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Creating event network-changed:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h1-854121-3 Aug 24 02:59:04.429828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:59:04.442400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a29c900c-017c-43c4-b39a-0495c6268b7f req-9b55ffb8-7a7c-4201-b25c-a36ed8a01125 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045972 Aug 24 02:59:04.443366 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5623/6615] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:59:04.674403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:04.675296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:04.683492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:04.684130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:04.684846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:04.685530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:04.686164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:04.686777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:04.828019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:04.836988 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90147ee1-26e4-4059-9aec-1f1baf87f08a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1682 microversion: 2.1 time: 0.167343 Aug 24 02:59:04.837759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5624/6616] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:04 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:05.860609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:05.862793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:05.873020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:05.873528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:05.873981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:05.874702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:05.875631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:05.875631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:06.018150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:06.026016 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2542517-5839-49bd-8bcc-31a3b798f0e6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1682 microversion: 2.1 time: 0.170306 Aug 24 02:59:06.026597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5625/6617] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:05 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:07.047721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:07.048359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:07.055894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.056553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.057047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.057757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.058222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.058661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.189697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:07.198430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02e29f15-ee4f-4531-81de-378e87d9aeb4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1679 microversion: 2.1 time: 0.154793 Aug 24 02:59:07.199014 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5626/6618] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:07 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:59:07.218915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:07.219436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:07.225810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.226435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.226958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.227770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.228502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.228851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.289555 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06c9cb32-d3df-483d-a2a3-48205b38d765 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/action" status: 204 len: 0 microversion: 2.1 time: 0.074430 Aug 24 02:59:07.290189 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5627/6619] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 02:59:07 2022] POST /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:59:07.298528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:07.299257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:07.306209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.306729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.307186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.308066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:07.308557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:07.309046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:07.444315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:07.452583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6c353661-3eab-42c1-8491-67373087d732 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1679 microversion: 2.1 time: 0.158050 Aug 24 02:59:07.453236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5628/6620] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:07 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:08.061923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "name": "network-vif-plugged", "status": "completed", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:08.080333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:08.080931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:08.081324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:08.094505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Creating event network-vif-plugged:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h1-854121-3 Aug 24 02:59:08.099996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 02:59:08.110683 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1eb735e8-59b3-4e74-9277-63845bdb7ea3 req-6f72f418-4da1-4d84-a9ae-5c527d7c8641 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112184 Aug 24 02:59:08.111296 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5629/6621] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:59:08.474219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:08.474936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:08.481266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:08.481768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:08.482220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:08.482925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:08.483388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:08.483834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:08.627460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:08.636001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0efd58a9-cdda-4c42-ae53-631802360ec5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1679 microversion: 2.1 time: 0.166036 Aug 24 02:59:08.636582 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5630/6622] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:08 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:09.657793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:09.658565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:09.665871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:09.666490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:09.667003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:09.667756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:09.668227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:09.668812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:09.801380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:09.817147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49a89e95-e156-4efa-aad8-6ab674170e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.162678 Aug 24 02:59:09.817743 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5631/6623] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:09 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:09.837803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:09.839113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:09.844915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:09.846030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:09.846030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:09.846568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:09.847041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:09.847486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:09.985838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:09.994299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ff1d6556-554a-42ca-a0ba-f7a52f9dd036 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.160290 Aug 24 02:59:09.995113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5632/6624] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:09 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:10.014344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:10.014964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:10.020650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.021183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.021637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.022342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.022817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.023261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.155114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:10.162955 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74708477-da80-402b-8e3f-90944924cce1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1671 microversion: 2.1 time: 0.152187 Aug 24 02:59:10.163530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5633/6625] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:10 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:10.183136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:10.183646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:10.189671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.190142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.190598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.191311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.192377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.192851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.217710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 02:59:10.220530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:59:10.294785 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19670cd5-f97c-4d94-a3cb-0ea1393fceaa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 204 len: 0 microversion: 2.1 time: 0.114737 Aug 24 02:59:10.295362 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5634/6626] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 02:59:10 2022] DELETE /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 02:59:10.304205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:10.304940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:10.310741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.311238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.311696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.312397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:10.312892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:10.313332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:10.448944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:10.456709 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b4c1263-231a-4acc-b0b2-f5b631a9f5df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1677 microversion: 2.1 time: 0.157010 Aug 24 02:59:10.457330 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5635/6627] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:10 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:11.478385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:11.479070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:11.485872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:11.486371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:11.486823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:11.487525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:11.487994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:11.488964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:11.622549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:11.633133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-378e2a13-a55f-4bdb-a2b4-e8462ec1b355 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1677 microversion: 2.1 time: 0.158502 Aug 24 02:59:11.634044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5636/6628] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:11 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:12.654472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:12.655251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:12.663852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:12.664704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:12.665364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:12.666340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:12.666817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:12.667434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:12.737074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:12.746560 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f8930f0-372c-43c9-afbb-9505d2137113 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 200 len: 1609 microversion: 2.1 time: 0.096061 Aug 24 02:59:12.747153 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5637/6629] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:12 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 1609 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:12.765509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d36a18e-7ca0-4a4d-9059-cd6c798d05b7", "name": "network-vif-deleted", "tag": "c40728cb-59a3-465c-95d4-eecd4556ae3d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:12.775519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:12.776015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:12.776471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:12.788333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] Creating event network-vif-deleted:c40728cb-59a3-465c-95d4-eecd4556ae3d for instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 on n-h1-854121-3 Aug 24 02:59:12.793431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0f0f552d-3bf9-4d24-8b03-4accc1b2f92d req-f48231ef-a7ff-4eed-9025-49e32c6b78be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Aug 24 02:59:12.794042 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5638/6630] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:59:13.768858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:13.769596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:13.776582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:13.777132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:13.777582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:13.778282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:13.778745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:13.779180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:13.793159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 HTTP/1.1 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1d36a18e-7ca0-4a4d-9059-cd6c798d05b7'} Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:59:13.794768 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b4f8ee1-cf18-4f22-8e05-3690df53441e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 404 len: 111 microversion: 2.1 time: 0.032432 Aug 24 02:59:13.798817 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5639/6631] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:13 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:59:13.809844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:13.810464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:13.816367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:13.816900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:13.817347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:13.818243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:13.818843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:13.819403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:13.839853 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 HTTP/1.1 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1d36a18e-7ca0-4a4d-9059-cd6c798d05b7'} Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 02:59:13.841922 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22aba85a-4a35-40f2-8712-e148b064e0ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 404 len: 111 microversion: 2.1 time: 0.038150 Aug 24 02:59:13.847308 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5640/6632] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:13 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 02:59:13.892477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-638514233", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "99f85c86-8aa8-45a1-90e8-0e96ed4115e7"}], "security_groups": [{"name": "tempest-securitygroup--1085985116"}], "key_name": "tempest-keypair-1453161191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:13.998506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] validate_networks() for [('99f85c86-8aa8-45a1-90e8-0e96ed4115e7', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 02:59:14.425337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 02:59:14.426561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 02:59:14.426982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 02:59:14.427411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 02:59:14.427870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 02:59:14.437651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:14.438149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:14.438603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:14.439348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:14.439823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:14.440266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:14.457698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 02:59:14.463043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 02:59:14.472387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:59:14.477050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 02:59:14.479376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 02:59:14.527498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5ad0789-68d2-405e-95d5-799b98083131 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.638724 Aug 24 02:59:14.528192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5641/6633] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 02:59:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 02:59:14.539235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-34a9e69d-bec7-40bb-945b-915eac518fae tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:14.539894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-34a9e69d-bec7-40bb-945b-915eac518fae tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:14.595170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-34a9e69d-bec7-40bb-945b-915eac518fae tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:14.602413 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-34a9e69d-bec7-40bb-945b-915eac518fae tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1238 microversion: 2.1 time: 0.067010 Aug 24 02:59:14.603026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5642/6634] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:14 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:15.624254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:15.624984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:15.634082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:15.634592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:15.635116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:15.636097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:15.636567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:15.637090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:15.707373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:15.715423 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-35366a07-1780-45ab-9a98-a041e41e48ee tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1308 microversion: 2.1 time: 0.095132 Aug 24 02:59:15.716209 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5643/6635] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:15 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:16.737454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:16.738169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:16.745730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:16.746225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:16.746675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:16.747382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:16.747845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:16.748280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:16.884477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:16.892490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89583bce-b21c-4695-a3b0-1110cbe15cd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.158947 Aug 24 02:59:16.893095 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5644/6636] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:16 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 02:59:16.933412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:16.943580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:16.943983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:16.944451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:16.955687 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] Creating event network-changed:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h2-854121-3 Aug 24 02:59:16.961310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-1299ebfa-dd86-46c6-8d51-2897c27bddf9 req-b80b195b-21bd-4689-b993-9d32500479ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031563 Aug 24 02:59:16.961811 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5645/6637] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:59:17.917748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:17.918455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:17.924887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:17.925392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:17.925936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:17.927247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:17.927813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:17.928316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:18.061622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:18.069467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e5d619d-13ab-4283-b0d4-2cda49660629 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.157192 Aug 24 02:59:18.070033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5646/6638] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:17 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:19.090967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:19.091648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:19.099240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:19.099734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:19.100180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:19.100907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:19.101372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:19.101804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:19.232892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:19.240989 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddccd6e5-4935-4d5c-997a-dfeb5211d8da tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.153584 Aug 24 02:59:19.241507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5647/6639] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:19 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:20.262158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:20.262843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:20.270790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:20.271396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:20.271883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:20.272589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:20.273076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:20.273512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:20.409759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:20.417496 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7cbc1d74-f674-4dc5-b44a-c90443e04bb3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.159461 Aug 24 02:59:20.418071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5648/6640] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:20 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:21.439655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:21.440306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:21.447836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:21.448342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:21.448829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:21.449556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:21.450030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:21.450471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:21.581936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:21.590309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f3fbd0d-d075-4152-8af1-d5c40962b4d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.154855 Aug 24 02:59:21.590893 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5649/6641] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:21 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:22.610836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:22.611491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:22.619913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:22.620409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:22.620904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:22.621604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:22.622233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:22.622727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:22.758134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:22.765877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afb107c5-50d7-4f43-8820-58edd617c9fa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.158979 Aug 24 02:59:22.766444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5650/6642] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:22 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:23.537539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "name": "network-vif-plugged", "status": "completed", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:23.547731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:23.548278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:23.549013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:23.569028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] Creating event network-vif-plugged:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h2-854121-3 Aug 24 02:59:23.574119 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e8723aee-824f-4b32-8ba4-7bc3b9d317e0 req-f4e188fb-04af-4129-aee6-0eb95523e0fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040295 Aug 24 02:59:23.574735 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5651/6643] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 02:59:23.789919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:23.790688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:23.797146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:23.797651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:23.798104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:23.798811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:23.799283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:23.799723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:23.932324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:23.940169 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-909d15e7-7d78-4d93-9ef1-89bf955ab9bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.156434 Aug 24 02:59:23.940769 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5652/6644] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:23 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:24.962336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:24.963098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:24.964992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:59:24.965779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:59:24.972535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:24.973601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:24.974059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:24.974776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:24.975260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:24.975702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:25.105130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:25.114472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b21d57d7-c4a7-49c6-921c-e65aa615953c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1364 microversion: 2.1 time: 0.156035 Aug 24 02:59:25.115110 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5653/6645] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:24 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:26.136120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:26.136802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:26.146272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:26.146927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:26.147483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:26.148326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:26.148991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:26.149590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:26.285547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 02:59:26.287867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 02:59:26.295005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea5741df-8dc3-4cfd-84c5-3632996f0c59 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1551 microversion: 2.1 time: 0.162706 Aug 24 02:59:26.295518 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5654/6646] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 02:59:26 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 02:59:26.316654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 02:59:26.317185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 02:59:26.324173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:26.324667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:26.325134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:26.325829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:26.326292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:26.326728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:26.409108 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5179ca2c-4cc5-49c0-aab4-3bf703c12c0b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097479 Aug 24 02:59:26.409718 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5655/6647] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 02:59:26 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 02:59:27.321827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 02:59:27.331230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 02:59:27.331725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 02:59:27.332190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 02:59:27.344818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] Creating event network-changed:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h2-854121-3 Aug 24 02:59:27.351079 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7e94858f-a08c-4de9-ac4d-6b1442f665ac req-1588de9e-ff86-4808-9079-1e2041bf6ad7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033973 Aug 24 02:59:27.351866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5656/6648] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 02:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:00:29.084111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:00:29.084885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=7 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:00:29.089895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:29.098116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:29.098648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:29.099105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:29.121666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:00:29.162055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0201af3-7819-4b65-b23c-1514c4c69a7a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action" status: 202 len: 0 microversion: 2.1 time: 0.080405 Aug 24 03:00:29.162646 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5657/6649] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:00:29 2022] POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:00:29.170884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:29.171590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:29.178703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:29.179313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:29.179834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:29.180623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:29.181190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:29.181637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:29.316111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:29.323798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f2d6fad-ce35-456f-9d49-d7ca5a350593 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.156832 Aug 24 03:00:29.324361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5658/6650] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:29 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:30.345150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:30.345851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:30.351989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:30.352493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:30.352974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:30.353677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:30.354146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:30.354586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:30.480173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:30.488359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-80836de9-53bf-4f0d-93a1-469092048b71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.147457 Aug 24 03:00:30.488967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5659/6651] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:30 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:31.511197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:31.511858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:31.518808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:31.519317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:31.519771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:31.520478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:31.520988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:31.521434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:31.653005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:31.661603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0c6030e-b432-48ea-a01e-b56ae30b76f8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.154304 Aug 24 03:00:31.662178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5660/6652] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:31 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:32.682602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:32.683240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:32.690691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:32.691189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:32.691651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:32.692385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:32.692888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:32.693329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:32.818770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:32.826636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0611fc03-c1a6-4bcb-8061-02b05e10efe7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.147923 Aug 24 03:00:32.827212 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5661/6653] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:32 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:33.847320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:33.847884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:33.854794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:33.855292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:33.855778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:33.856484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:33.856984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:33.857424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:33.989443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:33.997419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7d888eaa-f76a-4cea-80d6-d1979f1bb19e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.154117 Aug 24 03:00:33.998012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5662/6654] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:33 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:35.019686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:35.020343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:35.027162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:35.027665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:35.028127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:35.028870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:35.029343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:35.029791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:35.155458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:35.163328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc24aa43-791e-42ce-bc20-6f53a72a085f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.148107 Aug 24 03:00:35.163910 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5663/6655] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:35 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:36.183773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:36.184386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:36.191444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:36.191936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:36.192381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:36.193105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:36.193570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:36.194001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:36.320999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:36.328706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-395d4897-e427-4b82-b00b-bf7d8171b1f7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.148932 Aug 24 03:00:36.329318 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5664/6656] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:36 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:37.351245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:37.351836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:37.358596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:37.359088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:37.359535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:37.360227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:37.360688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:37.361855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:37.492561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:37.500274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-732edbdf-b76f-49cf-938d-2e670788fe25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.153354 Aug 24 03:00:37.500874 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5665/6657] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:37 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:00:38.522159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:38.522777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:38.529582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:38.530062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:38.530506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:38.531198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:38.531671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:38.532105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:38.657724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:38.666898 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b768696e-e20d-485f-866c-2350c3140444 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.148875 Aug 24 03:00:38.667471 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5666/6658] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:38 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:39.688488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:39.689678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:39.696900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:39.697596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:39.698650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:39.699412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:39.699835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:39.700279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:39.835282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:39.843121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc073dc3-c2c6-4b8e-a608-942b84b868ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1657 microversion: 2.1 time: 0.158563 Aug 24 03:00:39.843696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5667/6659] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:39 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:39.863841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:39.866258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:39.872528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:39.873059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:39.873513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:39.874218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:39.874694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:39.875133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:39.907133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:39.913084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:00:39.919691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:00:39.920131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:00:39.920622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:00:39.921079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:00:39.921510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:00:39.984618 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2afc7def-6d22-46ef-9ce6-fc36fa373828 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action" status: 202 len: 0 microversion: 2.1 time: 0.124379 Aug 24 03:00:39.985457 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5668/6660] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:00:39 2022] POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:00:39.994065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:39.994691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:40.000994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:40.001495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:40.002577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:40.003325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:40.003791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:40.004230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:40.176947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:40.186329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bfd47bdb-0306-449f-9b25-773491a99643 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.196144 Aug 24 03:00:40.187011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5669/6661] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:39 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:41.208807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:41.209474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:41.216689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:41.216920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:41.217247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:41.217973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:41.218476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:41.218919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:41.350892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:41.358745 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fee9de45-aa0f-460f-9075-e49910da12fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1680 microversion: 2.1 time: 0.154447 Aug 24 03:00:41.359325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5670/6662] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:41 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:42.379877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:42.380528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:42.387376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:42.387875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:42.388324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:42.389113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:42.389579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:42.390012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:42.395070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:00:42.524257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:42.532229 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98f2ecf0-296f-4dcf-8cdc-75f5da76d4ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1685 microversion: 2.1 time: 0.156338 Aug 24 03:00:42.532901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5671/6663] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:42 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:43.555056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:43.555871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:43.563019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:43.563523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:43.563970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:43.564675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:43.565165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:43.565873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:43.693368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:43.701190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2498d7b3-7ef8-4e53-ad38-83d7ab9e96fe tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1685 microversion: 2.1 time: 0.150256 Aug 24 03:00:43.701754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5672/6664] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:43 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:44.723655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:44.724298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:44.731397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:44.731891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:44.732362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:44.733109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:44.733605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:44.734015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:44.870659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:44.878443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58871dfe-65c3-4389-8e21-bea20639cc62 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1684 microversion: 2.1 time: 0.158773 Aug 24 03:00:44.879014 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5673/6665] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:44 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:45.081646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "name": "network-vif-unplugged", "status": "completed", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:45.091956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:45.092530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:45.092973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:45.108339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Creating event network-vif-unplugged:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h1-854121-3 Aug 24 03:00:45.114555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:00:45.125505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-547609aa-77eb-4ad3-af15-915a4e19ccc7 req-4384c6f5-0951-4c7f-ad01-5afe276d6c7d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048155 Aug 24 03:00:45.126125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5674/6666] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:00:45.901674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:45.903058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:45.909292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:45.909802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:45.910292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:45.911005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:45.911478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:45.911924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:46.045972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:46.054743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c88a2229-f990-4876-92f5-49b3e07b9d35 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1684 microversion: 2.1 time: 0.158099 Aug 24 03:00:46.055319 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5675/6667] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:45 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:47.076785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:47.077446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:47.084958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:47.085449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:47.085901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:47.086608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:47.087078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:47.087520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:47.217604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:47.225333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea01f255-e2b9-4364-b091-00b287b4c3c4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1682 microversion: 2.1 time: 0.152506 Aug 24 03:00:47.225904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5676/6668] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:47 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:47.230280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:47.243252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:47.243752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:47.244202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:47.256111 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Creating event network-changed:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h1-854121-3 Aug 24 03:00:47.261404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:00:47.272516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-61f0bc78-494a-45d9-8cf3-0e27b95d1905 req-6c92e41f-dcb3-4fd3-a53e-1849899bdec2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045493 Aug 24 03:00:47.273185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5677/6669] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:00:48.247704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:48.248456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:48.254745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:48.255246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:48.255697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:48.256404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:48.256902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:48.257342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:48.387321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:48.396054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbdc038a-0dfa-4c06-bc40-0e7194c87d55 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1682 microversion: 2.1 time: 0.153405 Aug 24 03:00:48.396760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5678/6670] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:48 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:49.418036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:49.418656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:49.426089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.426585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.427037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.427838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.428308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.428767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.561284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:49.569215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d83d3417-6b86-4fa6-a9e1-3ada54db68ff tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1678 microversion: 2.1 time: 0.155102 Aug 24 03:00:49.569779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5679/6671] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:49 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:49.590131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:49.590705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:49.597179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.597655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.598104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.598803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.599291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.599708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.657239 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da920301-3471-40c7-bbf6-a542c202a987 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action" status: 204 len: 0 microversion: 2.1 time: 0.070535 Aug 24 03:00:49.658172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5680/6672] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:00:49 2022] POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:00:49.668016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:49.668892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:49.678772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.679281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.679803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.680643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:49.681159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:49.681583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:49.845579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:49.854605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4988423-73dd-4266-a037-2bab67628846 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1678 microversion: 2.1 time: 0.190759 Aug 24 03:00:49.856626 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5681/6673] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:49 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:50.441798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "name": "network-vif-plugged", "status": "completed", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:50.466877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:50.467480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:50.468015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:50.480797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Creating event network-vif-plugged:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h1-854121-3 Aug 24 03:00:50.486680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:00:50.498352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f9a0d31e-aaf1-4112-83c2-6471a6e6e7a6 req-e66ed623-f137-4cae-accf-80836349b6ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062213 Aug 24 03:00:50.499139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5682/6674] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:00:50.878220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:50.878966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:50.885323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:50.885829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:50.886286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:50.887001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:50.887476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:50.887924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:51.018903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:51.026717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-22347d85-7995-4b41-a966-c245344534d6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1678 microversion: 2.1 time: 0.152688 Aug 24 03:00:51.027291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5683/6675] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:50 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:52.055961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:52.056586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:52.063391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.063893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.064342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.065848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.066294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.066739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.196462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:52.204381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19e1a49a-66ef-4ff3-8c24-bafcea382278 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1657 microversion: 2.1 time: 0.152421 Aug 24 03:00:52.204997 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5684/6676] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:52 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:52.223978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:52.224593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:52.230403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.230900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.231354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.232054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.232518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.232976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.360094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:52.368740 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0ee2423-0ed7-4ea6-a87f-8706fee662e3 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1657 microversion: 2.1 time: 0.148235 Aug 24 03:00:52.369311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5685/6677] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:52 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1657 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:52.388224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:52.393912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.394413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.394866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.417128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:00:52.449842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:00:52.458639 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3dc803ba-f88f-49c8-a54a-854f8c28966c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action" status: 202 len: 0 microversion: 2.1 time: 0.073816 Aug 24 03:00:52.459239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5686/6678] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:00:52 2022] POST /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:00:52.468209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:52.468956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:52.476348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.476897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.477352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.478066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:52.478555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:52.479013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:52.626394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:52.634750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03e8d49b-ca1b-4dd4-bac1-57e826e98138 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1666 microversion: 2.1 time: 0.170949 Aug 24 03:00:52.635598 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5687/6679] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:52 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:53.656136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:53.656948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:53.665319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.665837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.666266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:53.667029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.667498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.668048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:53.799362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:53.807330 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c19a300-4024-4164-a689-65a503541728 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1670 microversion: 2.1 time: 0.155211 Aug 24 03:00:53.807905 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5688/6680] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:53 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:53.827441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:53.827958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:53.834315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.834818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.835277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:53.835983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.836459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.836932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:53.863130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:00:53.936835 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26b9e61a-6d79-43e6-b72e-2e05b44f7ad0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 204 len: 0 microversion: 2.1 time: 0.112600 Aug 24 03:00:53.937455 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5689/6681] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:00:53 2022] DELETE /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:00:53.946711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:53.947469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:53.953423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.953920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.954366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:53.955069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:53.955531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:53.956797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:54.082989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:54.090990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c2e0334-9f92-4ea3-9f7d-dceaa1e8c2ac tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1676 microversion: 2.1 time: 0.148577 Aug 24 03:00:54.091562 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5690/6682] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:53 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:55.111524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:55.112812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:55.119778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:55.120278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:55.120757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:55.121467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:55.121938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:55.122383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:55.253451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:55.261201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc6fd919-c2dc-4d7e-ba2e-7eed3b55aa0c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1676 microversion: 2.1 time: 0.153522 Aug 24 03:00:55.261772 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5691/6683] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:55 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:56.247971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188fc9bf-34ab-4f2d-8204-b80bbac51728", "name": "network-vif-deleted", "tag": "165a2109-0a82-41fc-bc77-2d2f4f1fb539"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:56.260564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:56.261083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:56.261530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:56.274487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] Creating event network-vif-deleted:165a2109-0a82-41fc-bc77-2d2f4f1fb539 for instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 on n-h1-854121-3 Aug 24 03:00:56.280022 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-83976a64-6248-4545-90a3-07b9d060a3a1 req-6f40c1db-e67e-49f1-b13e-b6af4f5eb0be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 Aug 24 03:00:56.283612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5692/6684] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:00:56.289194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:56.289909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:56.296373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:56.296913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:56.297361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:56.298168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:56.298634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:56.299070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:56.367175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:56.375028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-decaa26c-391a-4dc1-8096-7ea310a1c380 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 200 len: 1323 microversion: 2.1 time: 0.090114 Aug 24 03:00:56.375620 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5693/6685] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:56 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:00:57.396903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:57.397669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:57.404734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.405326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.405787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:57.406494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.406964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.407402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:57.421325 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 HTTP/1.1 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '188fc9bf-34ab-4f2d-8204-b80bbac51728'} Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:00:57.422984 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adb5c0b9-ad39-4439-b8ae-002dbc4f17b7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 404 len: 111 microversion: 2.1 time: 0.032035 Aug 24 03:00:57.427056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5694/6686] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:57 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:00:57.437655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:57.438350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:57.444277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.444843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.445298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:57.445997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.446468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.446909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:57.461081 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 HTTP/1.1 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '188fc9bf-34ab-4f2d-8204-b80bbac51728'} Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:00:57.462769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d4dc609-cd65-47d7-925b-70dde72ad68f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 404 len: 111 microversion: 2.1 time: 0.030311 Aug 24 03:00:57.466748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5695/6687] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:57 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:00:57.514425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1703288031", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "99f85c86-8aa8-45a1-90e8-0e96ed4115e7"}], "security_groups": [{"name": "tempest-securitygroup--1085985116"}], "key_name": "tempest-keypair-1453161191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:00:57.616331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] validate_networks() for [('99f85c86-8aa8-45a1-90e8-0e96ed4115e7', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:00:57.982502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:00:57.982971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:00:57.983460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:00:57.983912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:00:57.984367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:00:57.994231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.994728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.995178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:57.995929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:57.996387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:57.996856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:58.014093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:00:58.019387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:00:58.021835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:00:58.033928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:00:58.036229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:00:58.082760 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f144282-403f-47e4-814a-23b1bc8c1a46 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.572024 Aug 24 03:00:58.083497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5696/6688] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:00:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:00:58.093972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e1a4f9c-55bf-42b0-bdd4-0a3f40293e2d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:58.094602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e1a4f9c-55bf-42b0-bdd4-0a3f40293e2d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:58.165045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e1a4f9c-55bf-42b0-bdd4-0a3f40293e2d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:58.171949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e1a4f9c-55bf-42b0-bdd4-0a3f40293e2d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1239 microversion: 2.1 time: 0.081693 Aug 24 03:00:58.172497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5697/6689] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:58 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:00:59.192962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:00:59.194302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:00:59.201384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:59.201888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:59.202722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:59.203487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:00:59.204095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:00:59.204690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:00:59.279995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:00:59.289264 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b9efaa17-2f90-4233-8986-0277ed29386f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1299 microversion: 2.1 time: 0.100273 Aug 24 03:00:59.289837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5698/6690] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:00:59 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:00.312128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:00.313518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:00.320967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:00.321770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:00.322298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:00.323082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:00.323641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:00.324271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:00.455139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:00.463520 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cba0a624-5ab0-4583-9a88-1137111029ab tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.155784 Aug 24 03:01:00.464113 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5699/6691] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:00 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:00.554409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:01:00.565131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:00.565632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:00.566084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:00.577435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] Creating event network-changed:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:01:00.582331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-90d1d98b-a45b-4e7a-bfa3-4b033f5abbeb req-2240aabb-245a-43dd-a85a-4a25da60c9af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031685 Aug 24 03:01:00.583108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5700/6692] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:01:01.486329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:01.487062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:01.493554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:01.494053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:01.494499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:01.495190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:01.495657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:01.496090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:01.626542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:01.634800 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43bbecf0-2c34-4fef-9d5f-76ebaa12ef1f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.153545 Aug 24 03:01:01.635372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5701/6693] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:01 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:02.655464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:02.656106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:02.663088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:02.663584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:02.664032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:02.664762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:02.665232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:02.665673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:02.791600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:02.799878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8c6505d-4f36-4d1a-bf55-0bc504589b81 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.147669 Aug 24 03:01:02.800448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5702/6694] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:02 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:03.821053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:03.821807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:03.828702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:03.829235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:03.829683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:03.830507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:03.830976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:03.831414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:03.963341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:03.971604 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf226215-24b6-459a-b205-47defff4999d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.153922 Aug 24 03:01:03.972173 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5703/6695] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:03 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:01:04.993008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:04.993654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:05.000579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:05.001112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:05.001572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:05.002873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:05.003350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:05.003791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:05.135010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:05.142927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c85d1898-3926-4e6e-91a8-5dc3cd228c00 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.154068 Aug 24 03:01:05.143499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5704/6696] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:04 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:06.163646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:06.164295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:06.171415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:06.171903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:06.172345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:06.173078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:06.173538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:06.174581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:06.301499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:06.309093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-349d5eac-fe84-4a1b-b549-6461936c83c0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.149287 Aug 24 03:01:06.309658 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5705/6697] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:06 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:07.330867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:07.331498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:07.338357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:07.338849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:07.339295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:07.339990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:07.340454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:07.340932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:07.344911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:01:07.472150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:07.479894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0245024b-f6b3-41aa-9a74-2957ab86c382 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.152870 Aug 24 03:01:07.480461 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5706/6698] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:07 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:01:07.891482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-plugged", "status": "completed", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:01:07.902761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:07.903751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:07.904321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:07.915995 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] Creating event network-vif-plugged:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:01:07.921356 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f35e4200-1598-436e-ac00-b032ae39686e req-da87917d-825a-49b9-88a2-f5c84f51177e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Aug 24 03:01:07.921945 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5707/6699] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:01:08.502437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:08.503139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:08.505167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:01:08.505909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:01:08.513454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:08.513948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:08.514396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:08.515091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:08.515562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:08.515994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:08.643212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:08.650801 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52e5e7ba-1a9b-4409-bdd6-e964dea3ecc2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1365 microversion: 2.1 time: 0.152601 Aug 24 03:01:08.651367 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5708/6700] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:08 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:09.672037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:09.672707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:09.679614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:09.680124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:09.680674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:09.681408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:09.681880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:09.682321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:09.813592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:01:09.821807 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f7002b9-151f-404e-89e4-68e7253aea69 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1553 microversion: 2.1 time: 0.153932 Aug 24 03:01:09.822406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5709/6701] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:01:09 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:01:09.842584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:01:09.843090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:01:09.848880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:09.849379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:09.849829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:09.850561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:09.851034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:09.851471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:10.174598 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16f2faf2-0dfd-44c8-bda8-861d739923c7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.334943 Aug 24 03:01:10.175227 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5710/6702] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 03:01:09 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/os-interface => generated 285 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:01:11.061053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:01:11.072023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:01:11.072514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:01:11.072985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:01:11.084954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] Creating event network-changed:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:01:11.090630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e965cba1-7fb9-4bbb-b2fe-a79f9a26e648 req-d0e002f5-5ce3-4a23-9335-78006708f919 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034288 Aug 24 03:01:11.091234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5711/6703] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:02:23.029146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:23.029987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=25 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:23.104795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:23.107249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:23.114023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:23.114530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:23.114987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:23.115703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:23.116169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:23.116607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:23.140261 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:02:23.140524 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/action (ip 10.222.0.49) !!! Aug 24 03:02:23.158531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:23.165715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:02:23.173219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:02:23.173652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:02:23.174138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:02:23.174561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:02:23.174982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:02:23.240994 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9344b53-823c-4291-aa12-33229a473bc7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/action" status: 202 len: 0 microversion: 2.1 time: 0.213951 Aug 24 03:02:23.244948 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5712/6704] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:02:23 2022] POST /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:02:23.250063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:23.251242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:23.257646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:23.258150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:23.258604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:23.259332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:23.259793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:23.260231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:23.433531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:23.443144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d6f1032-3d89-40ca-9784-b3f42cbea1bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1681 microversion: 2.1 time: 0.196858 Aug 24 03:02:23.443722 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5713/6705] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:23 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:24.464246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:24.464963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:24.472143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:24.472703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:24.473812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:24.474535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:24.475001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:24.475439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:24.631691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:24.640256 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad228782-856b-4314-b649-1142b348cb71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1681 microversion: 2.1 time: 0.179995 Aug 24 03:02:24.640881 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5714/6706] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:24 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:25.663543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:25.664189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:25.671284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:25.671791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:25.672255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:25.673505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:25.673983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:25.674430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:25.806501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:25.815103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6685513-f3bf-4e19-b103-2f112e6dd00a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.155508 Aug 24 03:02:25.815677 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5715/6707] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:25 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:26.835956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:26.836628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:26.843485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:26.843989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:26.844445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:26.845186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:26.845661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:26.846104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:26.974607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:26.982516 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd34a12d-e680-4b16-9da6-a5cd9435312e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.150513 Aug 24 03:02:26.983084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5716/6708] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:26 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:28.003867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:28.004503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:28.011344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:28.011837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:28.012281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:28.013000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:28.013468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:28.013902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:28.156672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:28.165305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2525283-113c-48f6-a196-70f5941eb5b2 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.165412 Aug 24 03:02:28.165870 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5717/6709] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:27 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:29.186247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:29.186902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:29.194408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:29.194945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:29.195395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:29.196133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:29.196594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:29.197071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:29.325983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:29.334346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1e725b40-6a21-4b8f-ad87-0a1fdc8dfda7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.152001 Aug 24 03:02:29.334920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5718/6710] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:29 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:30.356134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:30.356983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:30.363813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:30.364308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:30.364791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:30.365505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:30.365972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:30.366408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:30.530550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:30.539115 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31d6e772-a39c-41e6-8705-11e055bb6e79 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.187349 Aug 24 03:02:30.539707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5719/6711] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:30 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:31.560845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:31.561560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:31.568403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:31.568953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:31.569410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:31.570117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:31.570586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:31.571025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:31.703400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:31.711871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5daf2639-c9db-4374-9f27-8a5ef4b8b23d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.154957 Aug 24 03:02:31.712459 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5720/6712] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:31 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:32.733669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:32.735270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:32.742553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:32.743051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:32.743493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:32.744203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:32.744662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:32.745120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:32.888102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:32.896099 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a89d4fa5-f6a4-47af-a23f-d2fee219a294 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.166314 Aug 24 03:02:32.896875 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5721/6713] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:32 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:33.918679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:33.919336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:33.927257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:33.927597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:33.928050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:33.928816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:33.929360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:33.929791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:34.062510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:34.070942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b87b7cf-5479-4344-bbcf-794e054faf76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.156295 Aug 24 03:02:34.071507 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5722/6714] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:33 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:35.092342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:35.093046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:35.099989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:35.100498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:35.101005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:35.101714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:35.102186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:35.102632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:35.240577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:35.249326 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-adebe640-11b5-4630-b2af-0852eef14217 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.160867 Aug 24 03:02:35.249904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5723/6715] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:35 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:36.271810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:36.272412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:36.279250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:36.279744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:36.280195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:36.280917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:36.281424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:36.282552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:36.422013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:36.430007 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a2c9b6b-b544-4f49-97dd-9b8abbd99529 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.162583 Aug 24 03:02:36.430589 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5724/6716] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:36 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:37.451472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:37.452189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:37.460520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:37.461087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:37.461667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:37.462554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:37.463323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:37.463916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:37.606110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:37.614697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9f1e559d-e1b6-4e1a-9233-0ec08b1de49c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1686 microversion: 2.1 time: 0.167432 Aug 24 03:02:37.615288 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5725/6717] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:37 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:37.991824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-unplugged", "status": "completed", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:38.002889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:38.003927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:38.004548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:38.018636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Creating event network-vif-unplugged:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h1-854121-3 Aug 24 03:02:38.025026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] Instance 2462c91f-898d-4501-ade1-4c5caf4d340e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:02:38.038448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cc750ad5-bbf2-4970-be6e-36dbd1cd3cd9 req-47dc7202-7d29-4e08-b08a-c6c2e285b2d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050536 Aug 24 03:02:38.039307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5726/6718] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:02:38.637504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:38.638235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:38.645586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:38.646097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:38.646554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:38.647284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:38.647762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:38.648205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:38.667420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:38.789811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:38.797725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f18b8491-3caf-4d03-acee-409c2a6a7100 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1685 microversion: 2.1 time: 0.164539 Aug 24 03:02:38.798303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5727/6719] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:38 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:39.819457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:39.820162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:39.827419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:39.828006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:39.831071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:39.831071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:39.831071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:39.831071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:39.973408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:39.981743 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41ac29e8-5c57-466d-ba89-c5386f0a0227 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1683 microversion: 2.1 time: 0.166183 Aug 24 03:02:39.982338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5728/6720] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:39 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:40.077047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:40.087051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:40.087546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:40.087994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:40.100120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Creating event network-changed:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h1-854121-3 Aug 24 03:02:40.105633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] Instance 2462c91f-898d-4501-ade1-4c5caf4d340e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:02:40.116593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a29985af-854e-4fd6-9f30-a30d9acac6d3 req-6f343117-9c09-4457-8c09-e5dab4f689f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043063 Aug 24 03:02:40.117504 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5729/6721] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:02:41.005655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:41.006316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:41.012988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:41.013494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:41.013944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:41.014661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:41.015133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:41.015575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:41.150458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:41.158431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aff8bab8-57fd-439f-86f7-9d04e953d881 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1683 microversion: 2.1 time: 0.158529 Aug 24 03:02:41.159019 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5730/6722] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:40 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:42.179656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:42.181051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:42.188833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:42.189446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:42.189903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:42.190737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:42.191211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:42.191657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:42.350056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:42.358468 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cee89777-bde0-4edd-b9f7-10d477d5d675 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1683 microversion: 2.1 time: 0.182637 Aug 24 03:02:42.359357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5731/6723] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:42 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:43.379440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:43.380108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:43.387221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.387725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.388181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.388924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.389402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.389845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.523104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:43.531890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-068e33c1-1330-45e0-a1a6-f2f669d265df tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1680 microversion: 2.1 time: 0.155801 Aug 24 03:02:43.532483 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5732/6724] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:43 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:43.553958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:43.554668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:43.561168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.561685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.562144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.562925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.563394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.563871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.602723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.603408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.604302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.605090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.605574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.606018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.628543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:02:43.635086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:02:43.741728 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af719a42-cdbc-481f-9146-9447e315ed61 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/action" status: 202 len: 0 microversion: 2.1 time: 0.191576 Aug 24 03:02:43.742517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5733/6725] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:02:43 2022] POST /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:02:43.750995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:43.751790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:43.758401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.758908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.759360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.760235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:43.760759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:43.761630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:43.903198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:43.911829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b372b22-3deb-41d5-913b-e950baeb4a94 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.164878 Aug 24 03:02:43.912416 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5734/6726] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:43 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:44.933293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:44.933919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:44.941034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:44.941542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:44.941999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:44.942723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:44.943239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:44.943667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:45.076483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:45.085278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-851aef17-cadb-4637-ad6f-0bc6ef778242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.155851 Aug 24 03:02:45.085860 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5735/6727] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:44 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:45.090346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-plugged", "status": "completed", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:45.100318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:45.100851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:45.101305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:45.113926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Creating event network-vif-plugged:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h1-854121-3 Aug 24 03:02:45.119679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] Instance 2462c91f-898d-4501-ade1-4c5caf4d340e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:02:45.131291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-19b1f8f8-4821-41ef-9b88-1f27c5c2eadb req-6700278c-c980-440f-b7fd-f689fa7b6e11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044198 Aug 24 03:02:45.131917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5736/6728] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:02:46.110982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:46.111712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:46.118320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:46.118748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:46.119193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:46.119898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:46.120360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:46.120847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:46.268846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:46.277729 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2f8875c8-81bc-491b-92a7-b65712e65e0f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.172235 Aug 24 03:02:46.278710 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5737/6729] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:46 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:46.965206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-unplugged", "status": "completed", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:46.975666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:46.976027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:46.976480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:46.994411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Creating event network-vif-unplugged:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:02:46.994671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] Instance 2462c91f-898d-4501-ade1-4c5caf4d340e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:02:47.005882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-40ad58bc-7665-4674-ae46-3cd5716f0443 req-c6480b7c-09c8-40a8-a3ea-9392511fa25a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044560 Aug 24 03:02:47.006689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5738/6730] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:02:47.302283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:47.303975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:47.310916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:47.311406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:47.311859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:47.313141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:47.313618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:47.314061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:47.451110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:47.459126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c8457340-d012-4633-aa17-08786dea9eda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.163024 Aug 24 03:02:47.459706 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5739/6731] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:47 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:48.486174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:48.486828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:48.494158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:48.494587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:48.495054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:48.495756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:48.496226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:48.496667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:48.626265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:48.634126 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e161da8-edfe-44c0-871c-9a5a50a4a8e7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.158014 Aug 24 03:02:48.634698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5740/6732] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:48 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:02:49.023113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:49.032321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:49.032836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:49.033281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:49.044528 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Creating event network-changed:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:02:49.050374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] Instance 2462c91f-898d-4501-ade1-4c5caf4d340e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:02:49.061705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-46f90bcc-ec35-4c5a-83b2-a1e9fcbe22ea req-f48221d5-9d2b-4099-ae42-00e6ff12a6df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042275 Aug 24 03:02:49.062349 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5741/6733] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:02:49.656089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:49.656860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:49.663843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:49.664342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:49.664821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:49.665528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:49.666004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:49.666442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:49.685623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:49.804964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:49.813290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24bf321d-b28d-4845-b99a-45e438708f48 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.160906 Aug 24 03:02:49.813863 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5742/6734] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:49 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:50.834897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:50.835682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:50.844298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:50.844932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:50.845451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:50.846436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:50.846982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:50.847491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:51.010836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:51.021966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9db47bfc-98e5-4dc1-be4a-b2579d755faa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1679 microversion: 2.1 time: 0.191283 Aug 24 03:02:51.022908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5743/6735] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:50 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:52.043780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:52.044448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:52.051832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.052327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.052864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.053566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.054055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.054491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.190860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:52.198640 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9159a196-91f3-4bca-a47b-5b96b1bb4cdc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1672 microversion: 2.1 time: 0.158744 Aug 24 03:02:52.199216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5744/6736] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:52 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:52.220232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:52.220967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.232695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.364541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:52.372891 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3c86fe2-4b1c-4d1d-ba96-a90afeaf4dd4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1672 microversion: 2.1 time: 0.156959 Aug 24 03:02:52.373476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5745/6737] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:52 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:52.392651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:52.393319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:52.399262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.399774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.400237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.400979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.401456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.401909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.532674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:52.540697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65ff2418-e13c-474b-81da-96f7a2aa4e18 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1672 microversion: 2.1 time: 0.151819 Aug 24 03:02:52.542122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5746/6738] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:52 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:52.561307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:52.561831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:52.567829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.568335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.568818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.569535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.570030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.570460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.596535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:02:52.674284 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab000701-a545-481c-a3b8-6ea723e9e7bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 204 len: 0 microversion: 2.1 time: 0.116482 Aug 24 03:02:52.674914 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5747/6739] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:02:52 2022] DELETE /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:02:52.684207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:52.684945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:52.691053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.691555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.692015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.692734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:52.693248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:52.693688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:52.825749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:52.834078 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-909aff6d-f52c-4eea-b8a7-54203d227b25 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1678 microversion: 2.1 time: 0.154194 Aug 24 03:02:52.834657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5748/6740] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:52 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:53.855424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:53.856072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:53.858895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:53.860271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:02:53.866364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:53.867117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:53.867574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:53.868297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:53.868797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:53.869238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:53.997902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:54.005671 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3723faba-2df6-4b1b-89df-1a51e4e9d913 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1678 microversion: 2.1 time: 0.154233 Aug 24 03:02:54.006240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5749/6741] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:53 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:54.375239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-plugged", "status": "completed", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:54.384816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:54.385315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:54.385769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:54.399364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] Creating event network-vif-plugged:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:02:54.404172 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a6879f7d-4256-40c7-a3e8-6531b1eee42a req-c21f60d4-8f68-4df2-beea-65fb5b4c1242 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032673 Aug 24 03:02:54.405008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5750/6742] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:02:55.027570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:55.028391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:55.037962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:55.039040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:55.039501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:55.040243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:55.041200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:55.041620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:55.115978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:55.124926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78258628-a6a9-41ef-a0f5-ae8dca25798f tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 200 len: 1610 microversion: 2.1 time: 0.101322 Aug 24 03:02:55.125561 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5751/6743] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:55 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 1610 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:55.249297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2462c91f-898d-4501-ade1-4c5caf4d340e", "name": "network-vif-deleted", "tag": "7d2518d3-9175-41d3-bdd3-3c4d49e61e49"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:55.259451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:55.259949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:55.260401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:55.272288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] Creating event network-vif-deleted:7d2518d3-9175-41d3-bdd3-3c4d49e61e49 for instance 2462c91f-898d-4501-ade1-4c5caf4d340e on n-h2-854121-3 Aug 24 03:02:55.278278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5905de7b-3e31-44f2-89cb-217481132246 req-6a6de290-f358-45ac-8c62-1354587d3d94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Aug 24 03:02:55.278884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5752/6744] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:02:56.148623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:56.149467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:56.155923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.156429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.156912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.157628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.158096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.158538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.171941 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e HTTP/1.1 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2462c91f-898d-4501-ade1-4c5caf4d340e'} Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:02:56.173653 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b304a63b-3dc0-4cba-8d4a-6617560a36d1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 404 len: 111 microversion: 2.1 time: 0.031801 Aug 24 03:02:56.182029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5753/6745] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:56 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:02:56.193073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:56.193719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:56.199722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.200226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.200681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.201418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.201891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.202332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.216383 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e HTTP/1.1 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2462c91f-898d-4501-ade1-4c5caf4d340e'} Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:02:56.218021 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68805054-9640-4762-b4be-dc405fe12186 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 404 len: 111 microversion: 2.1 time: 0.031430 Aug 24 03:02:56.222865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5754/6746] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:56 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:02:56.273869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-534917242", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "99f85c86-8aa8-45a1-90e8-0e96ed4115e7"}], "security_groups": [{"name": "tempest-securitygroup--1085985116"}], "key_name": "tempest-keypair-1453161191", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:56.379414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] validate_networks() for [('99f85c86-8aa8-45a1-90e8-0e96ed4115e7', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:02:56.757608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:02:56.758049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:02:56.758544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:02:56.758971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:02:56.759401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:02:56.768704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.769167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.769618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.770360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:56.770831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:56.771273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:56.789377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:02:56.795309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:02:56.809096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:02:56.811437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:02:56.858521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04988a96-0b4b-4694-9e46-b99f61e5a931 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.588743 Aug 24 03:02:56.859748 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5755/6747] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:02:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:02:56.870718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af6164e5-65f7-4b91-9eb1-08ceebf74cda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:56.871352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af6164e5-65f7-4b91-9eb1-08ceebf74cda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:56.925953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af6164e5-65f7-4b91-9eb1-08ceebf74cda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:56.934285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af6164e5-65f7-4b91-9eb1-08ceebf74cda tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1238 microversion: 2.1 time: 0.067524 Aug 24 03:02:56.934927 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5756/6748] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:56 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:57.957400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:57.958164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:57.965335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:57.965927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:57.966647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:57.967456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:57.968227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:57.968792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:58.033716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:58.043866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-97668c32-ec95-474e-a704-b91aa90774bf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1298 microversion: 2.1 time: 0.090285 Aug 24 03:02:58.044556 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5757/6749] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:57 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:59.065839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:02:59.066513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:02:59.073649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:59.074143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:59.074595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:59.075299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:59.075763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:59.076194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:59.224428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:02:59.233245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef106e50-18c5-4a03-8cce-11044fcb9527 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.172024 Aug 24 03:02:59.233839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5758/6750] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:02:59 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:02:59.336853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:02:59.346806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:02:59.347416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:02:59.347939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:02:59.359902 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] Creating event network-changed:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:02:59.364748 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-46baf19a-c5ae-4827-86f9-694d7aa01041 req-12e3aad6-11f1-49e7-88b5-83294f1d9831 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032002 Aug 24 03:02:59.365531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5759/6751] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:03:00.256901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:00.257611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:00.263803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:00.264302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:00.264773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:00.265989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:00.266449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:00.266885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:00.400824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:00.409337 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eabad2e1-725a-4186-8516-1bd7e45f02a9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.157657 Aug 24 03:03:00.409904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5760/6752] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:00 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:01.431730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:01.432380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:01.439197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:01.439699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:01.440152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:01.440899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:01.441369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:01.441809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:01.568665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:01.576364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8c74bde9-9ce7-4222-999f-ba1dea3b51eb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.148623 Aug 24 03:03:01.576951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5761/6753] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:01 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:02.598053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:02.598662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:02.605636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:02.606174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:02.606630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:02.607353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:02.607815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:02.608255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:02.628820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:03:02.757436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:02.765085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72a82e46-fe4a-43ae-9691-0e06715b0b80 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.171080 Aug 24 03:03:02.765651 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5762/6754] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:02 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:03.786324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:03.786978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:03.794132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:03.794650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:03.795096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:03.795789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:03.796253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:03.796684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:03.930090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:03.940090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b1cb3ff-0855-4f99-a59a-70f5a562603a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.157276 Aug 24 03:03:03.940678 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5763/6755] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:03 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:04.962127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:04.962792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:04.970651 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:04.971148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:04.971605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:04.972307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:04.972793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:04.973233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:05.120763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:05.129428 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-234825bc-a459-4d6d-a199-f4f6b2cda1f6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.171169 Aug 24 03:03:05.130016 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5764/6756] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:04 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:05.329485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-plugged", "status": "completed", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:03:05.340586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:05.341134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:05.341582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:05.353149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] Creating event network-vif-plugged:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:03:05.358143 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f48ff7ac-0855-4c0c-9780-1d03889154ea req-35aaba2f-c78d-4e58-b18a-71e64a48505f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033021 Aug 24 03:03:05.359642 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5765/6757] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:03:06.154225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:06.154940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:06.161918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:06.162416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:06.162868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:06.163583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:06.164087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:06.164528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:06.298115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:06.305908 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eea78c6f-3172-467c-b41a-6407e6959c6b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1364 microversion: 2.1 time: 0.156852 Aug 24 03:03:06.306479 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5766/6758] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:06 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:07.327815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:07.329076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:07.331264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:03:07.331969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:03:07.341781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:07.342285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:07.342746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:07.343591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:07.344204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:07.344821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:07.484598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:03:07.492774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d7d129b-ba30-4ca4-a0e9-21d48d432769 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1551 microversion: 2.1 time: 0.168698 Aug 24 03:03:07.493287 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5767/6759] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:03:07 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:03:07.513321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:03:07.513825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:03:07.520272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:07.520795 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:07.521250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:07.521950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:07.522412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:07.522848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:07.600044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16c7f69d-b284-44a5-bbad-8f361bb74790 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090214 Aug 24 03:03:07.600653 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5768/6760] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 03:03:07 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:03:08.815211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:03:08.825158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:03:08.825660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:03:08.826147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:03:08.838367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] Creating event network-changed:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:03:08.843301 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-eead518c-354c-4456-93ae-9c701e65a111 req-04c01439-8ac7-4c6c-8655-0ecb69a7fc55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086113 Aug 24 03:03:08.844828 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5769/6761] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:04:22.218273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:04:22.219587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=34 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:04:22.225577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:22.226313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:22.235148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:22.235661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:22.236119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:22.236890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:22.237480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:22.237898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:22.444742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:22.452814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f75f2ea3-b6b5-4f61-b2b7-ac9cad29a479 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1670 microversion: 2.1 time: 0.239325 Aug 24 03:04:22.453398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5770/6762] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:22 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1670 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:22.474055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ef2c639-e0e3-48e3-b623-da1a9be238b0"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:04:22.476479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:22.483336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:22.483837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:22.484291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:22.485112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:22.485517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:22.485954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:22.767472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1841682b-38dd-4e5c-b902-411e889791e8 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291617 Aug 24 03:04:22.767472 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5771/6763] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:04:22 2022] POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:04:34.569416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:04:34.570190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:04:34.574408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:04:34.576776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:34.584224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:34.584755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:34.585195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:34.585911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:34.586375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:34.586820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:34.669422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:34.676745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:04:34.684411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:04:34.684882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:04:34.685883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:04:34.686312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:04:34.686738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:04:34.752746 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc2f3c34-698d-431a-aacd-b3e6f2ef8cf5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/action" status: 202 len: 0 microversion: 2.1 time: 0.185063 Aug 24 03:04:34.753291 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5772/6764] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:04:34 2022] POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:04:34.761423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:34.762073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:34.769671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:34.769858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:34.770329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:34.771073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:34.771544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:34.771987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:34.939798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:34.948304 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d400c5a8-3255-4478-bb4a-1134dd2384fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1725 microversion: 2.1 time: 0.190668 Aug 24 03:04:34.948921 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5773/6765] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:34 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:04:35.970843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:35.971483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:35.978675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:35.979179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:35.979631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:35.985703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:35.985703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:35.985703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:36.136055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:36.145493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf293d2f-361f-47da-854f-61d631afa2d5 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1725 microversion: 2.1 time: 0.178419 Aug 24 03:04:36.146080 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5774/6766] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:35 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:37.167476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:37.168166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:37.175503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:37.176002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:37.176454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:37.177220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:37.177685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:37.178124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:37.313180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:37.322186 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2454d863-9580-4c7d-85f5-7e184bc06ed4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.158735 Aug 24 03:04:37.322763 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5775/6767] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:37 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:38.344373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:38.345099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:38.351963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:38.352456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:38.352942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:38.353649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:38.354114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:38.354548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:38.492668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:38.501590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0fd017c-6cd7-4f2e-ae8c-44e6f190a2dc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.161533 Aug 24 03:04:38.502186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5776/6768] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:38 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:39.522547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:39.523235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:39.530952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:39.531469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:39.531920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:39.532652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:39.533149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:39.533618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:39.677358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:39.688024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebd251df-0da9-492a-806d-6f9947b77daa tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.169025 Aug 24 03:04:39.689043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5777/6769] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:39 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:40.714284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:40.715141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:40.722762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:40.723272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:40.723737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:40.724459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:40.724979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:40.725432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:40.886788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:40.895316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aebcf582-c97c-44de-acee-1d975e7ba4fc tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.184984 Aug 24 03:04:40.895901 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5778/6770] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:40 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:41.916961 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:41.917618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:41.925349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:41.925857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:41.926309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:41.927029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:41.927501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:41.927940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:42.060878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:42.069530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1c43d04c-bad1-4a90-80b2-b8aa643772e9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.156642 Aug 24 03:04:42.070144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5779/6771] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:41 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:43.090855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:43.092101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:43.099070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:43.099559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:43.100014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:43.100744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:43.101211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:43.101646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:43.238491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:43.248085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fefff210-1a5d-4702-a75a-9de0d72ef99e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.160602 Aug 24 03:04:43.248694 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5780/6772] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:43 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:44.270254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:44.270935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:44.278125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:44.279105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:44.279561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:44.280280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:44.280772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:44.281217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:44.425263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:44.433824 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-499c91bd-8626-4be3-a2dd-ba13cd043242 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.167453 Aug 24 03:04:44.434412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5781/6773] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:44 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:45.455967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:45.456680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:45.464059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:45.464566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:45.465043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:45.465756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:45.466755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:45.467192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:45.601296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:45.609761 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a105953-9992-484b-8e89-2df5a140cef9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.157806 Aug 24 03:04:45.610347 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5782/6774] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:45 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:46.631541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:46.632217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:46.639841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:46.640343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:46.640825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:46.641546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:46.642016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:46.642449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:46.783751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:46.792400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c03c6403-79c9-463a-9534-7801884f2056 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.164660 Aug 24 03:04:46.793031 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5783/6775] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:46 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:47.813857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:47.814566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:47.821857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:47.822367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:47.822818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:47.823543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:47.824015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:47.824489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:47.974335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:47.983077 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1227d73c-325d-4428-97a3-09fbdee501f9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.173676 Aug 24 03:04:47.983672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5784/6776] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:47 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:49.004815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:49.005574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:49.012458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:49.013512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:49.013964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:49.014675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:49.015137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:49.015573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:49.163276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:49.172254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-636c4979-34f3-4e1a-af4e-b72f35b419bb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.171261 Aug 24 03:04:49.172877 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5785/6777] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:48 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:50.194140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:50.194766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:50.201792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:50.202607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:50.203067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:50.203788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:50.204254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:50.204688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:50.350102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:50.360165 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8085c420-dc01-4685-8b61-6961927abdd6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1730 microversion: 2.1 time: 0.169920 Aug 24 03:04:50.360786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5786/6778] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:50 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:51.383641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:51.384390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:51.390979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:51.391487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:51.392003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:51.392672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:51.393180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:51.393625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:51.398162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:04:51.537455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:51.546971 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c69c2f9-e175-4c9d-9e5c-237166341678 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1729 microversion: 2.1 time: 0.167331 Aug 24 03:04:51.547719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5787/6779] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:51 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:51.688409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-unplugged", "status": "completed", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:04:51.698975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:51.699478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:51.699930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:51.712400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Creating event network-vif-unplugged:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h2-854121-3 Aug 24 03:04:51.718985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:04:51.730479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4967e02d-d0fa-4dfc-98f7-2871d4f66016 req-624b8a23-3784-44ac-9693-ea44cba35782 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097212 Aug 24 03:04:51.731268 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5788/6780] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:04:52.572761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:52.572761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:52.578099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:52.578618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:52.579069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:52.579976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:52.580611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:52.581090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:52.735981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:52.747105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2efa6c73-fff2-4a9b-94dd-ee862df1a1ef tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1729 microversion: 2.1 time: 0.181949 Aug 24 03:04:52.748039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5789/6781] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:52 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:04:53.748443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:04:53.759214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:53.759712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:53.760170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:53.773334 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Creating event network-changed:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h2-854121-3 Aug 24 03:04:53.780005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:04:53.791272 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ae7abe70-e0d7-4c64-89fa-bc1c6ab9a590 req-c6ce7c9f-f193-47cf-9619-aa7bf2213a0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047020 Aug 24 03:04:53.792072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5790/6782] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:04:53.797840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:53.798562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:53.805013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:53.805518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:53.805972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:53.806738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:53.807216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:53.807657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:53.984623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:53.994501 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-645a5fb9-7c96-4fec-ac5a-dd1faa338ccf tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.201307 Aug 24 03:04:53.995439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5791/6783] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:53 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:04:55.031826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:55.034362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:55.043559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:55.045427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:55.046480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:55.047735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:55.048529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:55.049584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:55.214566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:55.223975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7094f7b-45f1-4291-8534-fa23a03a4e6c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.199555 Aug 24 03:04:55.224579 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5792/6784] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:55 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:04:56.246187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:56.246817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:56.254641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:56.255144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:56.255594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:56.256309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:56.256804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:56.257240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:56.418316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:56.428167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92f58e63-d0ae-417e-ba4d-f243f52a4465 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.185988 Aug 24 03:04:56.428794 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5793/6785] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:56 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:57.450169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:57.451070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:57.458227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:57.458735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:57.459244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:57.459952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:57.460423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:57.460904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:57.613401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:57.622049 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b64be52c-49e6-47ba-a2a9-1c208f07199b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.175760 Aug 24 03:04:57.622634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5794/6786] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:57 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:58.644667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:58.645362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:58.652249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:58.652783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:58.653778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:58.654493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:58.654994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:58.655445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:58.795289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:58.804419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0430017f-aa36-481e-aeef-7ee36b7ac537 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.163632 Aug 24 03:04:58.805238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5795/6787] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:58 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:04:59.826318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:04:59.827006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:04:59.834402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:59.834911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:59.835362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:59.836105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:04:59.836569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:04:59.837035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:04:59.974278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:04:59.983363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7081ea20-79fa-4cad-b157-a35f5455baa4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.161119 Aug 24 03:04:59.983941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5796/6788] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:04:59 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:01.010572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:01.011221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:01.018995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:01.019504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:01.019959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:01.020681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:01.021184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:01.021628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:01.168035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:01.176793 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96f165a3-53a0-4366-bbd4-0e26392c3e83 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.173926 Aug 24 03:05:01.177390 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5797/6789] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:01 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:05:02.198996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:02.199655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:02.206759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:02.207273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:02.207725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:02.208457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:02.208964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:02.209405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:02.351599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:02.365848 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-198d30c8-0cf3-412c-aa54-1900c0cf3ca6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.170631 Aug 24 03:05:02.366638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5798/6790] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:02 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:03.394665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:03.395331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:03.402250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:03.402744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:03.403689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:03.404393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:03.404993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:03.405433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:03.542714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:03.551831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-974bfd11-079e-41f4-9d7d-e13716f9a977 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.161020 Aug 24 03:05:03.552423 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5799/6791] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:03 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:04.572986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:04.573692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:04.580594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:04.581127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:04.581584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:04.582294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:04.582763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:04.583204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:04.723836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:04.733929 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-316e5599-e04d-4b0c-b5d6-9292c4cb4b76 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.164823 Aug 24 03:05:04.734528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5800/6792] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:04 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:05.755919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:05.756539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:05.759324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=63 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:05.764995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:05.765498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:05.765952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:05.766662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:05.767135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:05.767575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:05.898912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:05.907774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4dc12cd0-97ee-438d-af7b-b169e3c1c9d7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.155832 Aug 24 03:05:05.908349 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5801/6793] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:05 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:06.928985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:06.930206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:06.937662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:06.938174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:06.938630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:06.939387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:06.940042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:06.940489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:07.133537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:07.143145 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf3f88d9-9b2b-430e-ab26-7c81db630b6e tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1727 microversion: 2.1 time: 0.218038 Aug 24 03:05:07.143739 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5802/6794] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:06 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:08.165188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:08.165823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:08.173386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.173895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.174353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.175069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.175540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.175985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.305745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:08.314587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3d4a0d1-a06a-4371-b6d8-f8519746d321 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1724 microversion: 2.1 time: 0.153306 Aug 24 03:05:08.315167 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5803/6795] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:08 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:08.334396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:08.334949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:08.340867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.341375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.341833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.342600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.343079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.343525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.361673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:08.381908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.382434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.382893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.383632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.384107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.384549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.405115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for project 8af8cb62dbf340afa7554c23f775db03. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:05:08.410323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Getting quotas for user b90081b57e2f408f9249e8bfbc756c3a and project 8af8cb62dbf340afa7554c23f775db03. Resources: {'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:05:08.510106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-573ec389-ad68-4fb0-9cf9-92c05081fd3c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/action" status: 202 len: 0 microversion: 2.1 time: 0.179011 Aug 24 03:05:08.510707 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5804/6796] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:05:08 2022] POST /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:05:08.519618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:08.520344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:08.526672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.527188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.527646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.528466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:08.528988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:08.529414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:08.671637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:08.680058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab982a6a-0c58-435b-84b2-6e84d273b809 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.164496 Aug 24 03:05:08.680634 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5805/6797] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:08 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:09.023718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-plugged", "status": "completed", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:09.034163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:09.034757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:09.035303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:09.048422 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Creating event network-vif-plugged:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h2-854121-3 Aug 24 03:05:09.053988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:05:09.064652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-ec657d00-2e03-4af2-bfdf-c52860aaeb9f req-1e99f761-f506-4858-a295-ca929f3fe1fe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100624 Aug 24 03:05:09.065419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5806/6798] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:05:09.704166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:09.704913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:09.711179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:09.711677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:09.712127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:09.712870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:09.713341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:09.713774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:09.847098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:09.855483 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2156474a-804b-4265-b5d8-f6087ea7a791 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.157153 Aug 24 03:05:09.856054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5807/6799] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:09 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:10.877357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:10.878120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:10.885291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:10.885783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:10.886229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:10.886926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:10.888125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:10.888566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:11.018635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:11.026872 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86ba752c-b8e3-4f29-84fe-fd7bc0d182f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.153465 Aug 24 03:05:11.027443 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5808/6800] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:10 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:12.049535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:12.050210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:12.057387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:12.057912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:12.058544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:12.059856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:12.060321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:12.060826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:12.196797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:12.205160 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b621b567-1d06-4b7e-b3b5-e496b90a3a3d tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.159507 Aug 24 03:05:12.206102 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5809/6801] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:12 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:13.228857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:13.229514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:13.238015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:13.238523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:13.238968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:13.239680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:13.240149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:13.240583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:13.377967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:13.386393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a09e7949-d54c-4aec-af29-be83a9587417 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.163055 Aug 24 03:05:13.386972 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5810/6802] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:13 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:05:14.352975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-unplugged", "status": "completed", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:14.364317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:14.364854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:14.365371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:14.378744 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Creating event network-vif-unplugged:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:05:14.384592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:05:14.395293 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-219845e9-731d-406a-b95d-717b111d1d6a req-bf1c6834-37ec-4590-a0d4-71f3abe772e2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046306 Aug 24 03:05:14.396125 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5811/6803] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:05:14.408654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:14.409401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:14.415679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:14.416198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:14.416650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:14.417396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:14.417869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:14.418339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:14.560683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:14.569053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb38628d-aa0d-4332-9144-4c3a54b23dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.164769 Aug 24 03:05:14.569629 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5812/6804] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:14 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:05:15.591224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:15.591841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:15.599007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:15.599442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:15.599894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:15.600615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:15.601124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:15.601556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:15.737645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:15.746583 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05ad7f4b-499e-407c-bd3f-771267627c5a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.159959 Aug 24 03:05:15.747165 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5813/6805] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:15 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:16.410502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:16.420382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:16.420916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:16.421371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:16.434599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Creating event network-changed:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:05:16.440980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:05:16.452958 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-59096545-1731-44b9-afc4-ea49e2ce9884 req-df990135-3f9b-4be4-90cc-7bec948f6ffa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045996 Aug 24 03:05:16.453585 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5814/6806] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:05:16.769084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:16.769865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:16.776975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:16.778085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:16.778619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:16.779448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:16.780034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:16.780588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:16.940926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:16.949723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b2600de4-9e0d-49f4-80ce-c70467d7fa91 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.185683 Aug 24 03:05:16.950300 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5815/6807] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:16 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:17.971505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:17.972239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:17.979638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:17.980207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:17.980695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:17.981990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:17.982453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:17.982889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:18.118942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:18.127631 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16eab0c3-6716-4911-88b9-daff300ee9a7 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.160048 Aug 24 03:05:18.128223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5816/6808] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:17 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:19.150218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:19.150908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:19.153352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:19.159950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:19.160457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:19.160969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:19.161698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:19.162164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:19.162603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:19.317590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:19.326624 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f542f196-66cc-45e2-8c33-9707867644e1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.180545 Aug 24 03:05:19.327420 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5817/6809] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:19 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:20.348177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:20.348858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:20.355727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:20.356232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:20.356683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:20.357415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:20.357882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:20.358323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:20.491740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:20.501242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a3abaa8-f128-444b-a7b4-f6ab48a61cea tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.156760 Aug 24 03:05:20.501755 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5818/6810] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:20 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:21.522088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:21.522716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:21.529806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:21.530355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:21.530761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:21.531482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:21.531952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:21.532391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:21.536664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:21.670727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:21.679247 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8777105-daed-42d5-a99c-f442b5bf60be tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.161160 Aug 24 03:05:21.679832 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5819/6811] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:21 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:22.701598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:22.702259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:22.709317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:22.709821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:22.710276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:22.710990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:22.711458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:22.711898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:22.846198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:22.854561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-398119f9-69fe-4734-ad02-f2f8620231fb tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.157503 Aug 24 03:05:22.855130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5820/6812] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:22 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:23.877383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:23.878069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:23.884980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:23.885474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:23.885923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:23.886627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:23.887652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:23.888094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:24.020208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:24.028673 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e0d6da89-aa80-4b7d-8eb1-438838b53029 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.155169 Aug 24 03:05:24.029282 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5821/6813] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:23 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:25.050058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:25.050723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:25.057597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:25.058093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:25.058537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:25.059229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:25.059721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:25.060160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:25.187736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:25.195954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19bd5af3-a400-45dd-8a5d-4c0203037dd9 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.149772 Aug 24 03:05:25.196522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5822/6814] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:25 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:26.217567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:26.218197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:26.225121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:26.226196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:26.226654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:26.227384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:26.227878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:26.228300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:26.365812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:26.374962 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f36418e7-7893-476e-acf4-c314084e91af tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.161925 Aug 24 03:05:26.375653 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5823/6815] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:26 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:27.397409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:27.398230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:27.406088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:27.406591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:27.407169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:27.407928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:27.408419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:27.408919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:27.544340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:27.553690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5e25bc1-5c5b-427f-8858-2297c3db1db6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.160151 Aug 24 03:05:27.554302 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5824/6816] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:27 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:28.575886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:28.576580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:28.583612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:28.584119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:28.584571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:28.585323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:28.585803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:28.586250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:28.732478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:28.741251 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc811c7e-0a9d-46b7-bea8-6ca4e58619b4 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1723 microversion: 2.1 time: 0.169693 Aug 24 03:05:28.741859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5825/6817] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:28 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:05:29.764101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:29.764836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:29.772050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:29.772555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:29.773031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:29.773749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:29.774214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:29.774655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:29.913033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:29.921258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5bfcb5b1-48f8-428b-9e96-3cc6e8560e82 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1716 microversion: 2.1 time: 0.161638 Aug 24 03:05:29.921820 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5826/6818] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:29 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:29.943289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:29.943721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:29.950699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:29.951207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:29.951660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:29.952375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:29.952869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:29.953315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.082424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:30.091289 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ed0d6217-8d5d-49b8-af28-86b3b93b2c7c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1716 microversion: 2.1 time: 0.152089 Aug 24 03:05:30.091865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5827/6819] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:29 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:30.112095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:30.112741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:30.119332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.119839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.120336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.121128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.121596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.122067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.256762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:30.265737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04a79c49-874e-48e4-b383-e5eb284b7e2b tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1716 microversion: 2.1 time: 0.157561 Aug 24 03:05:30.266328 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5828/6820] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:30 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:30.286318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:30.286828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:30.293064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.293566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.294019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.294731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.295194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.295630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.330687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:05:30.414414 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-080709d6-71c2-413e-877d-f227df435030 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 204 len: 0 microversion: 2.1 time: 0.131614 Aug 24 03:05:30.415007 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5829/6821] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:05:30 2022] DELETE /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:05:30.423899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:30.424551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:30.430854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.431356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.431802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.432510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:30.433006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:30.433475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:30.568654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:30.577702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-40916831-19de-49ff-b717-914a313d901a tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1722 microversion: 2.1 time: 0.158183 Aug 24 03:05:30.578278 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5830/6822] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:30 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:31.599673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:31.600351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:31.608197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:31.608700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:31.609187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:31.609905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:31.610378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:31.610824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:31.751143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:31.760101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e15e0354-4021-479d-8dc0-2e67a294f919 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1722 microversion: 2.1 time: 0.164250 Aug 24 03:05:31.760695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5831/6823] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:31 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:31.818382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-plugged", "status": "completed", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:31.829373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:31.829798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:31.830285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:31.846972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] Creating event network-vif-plugged:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:05:31.852476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6c5bf88e-b687-4d13-89d5-5a310499cb00 req-4420e766-7882-458a-b60e-cd7a052c9e3d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037859 Aug 24 03:05:31.853583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5832/6824] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:05:32.783366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:32.784191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:32.791399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:32.791910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:32.792372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:32.793633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:32.794110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:32.794567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:32.942714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:32.960938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a5ad51a-6cb6-4df9-8bf7-7d98ffe4ff2c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1722 microversion: 2.1 time: 0.181911 Aug 24 03:05:32.961939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5833/6825] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:32 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:33.597826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05407993-e521-41fd-b49d-4f8a4cfd9e11", "name": "network-vif-deleted", "tag": "0f5b6f81-d6bf-4f1b-9c15-2922adf23e24"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:33.608964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:33.609476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:33.609930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:33.623525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] Creating event network-vif-deleted:0f5b6f81-d6bf-4f1b-9c15-2922adf23e24 for instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 on n-h1-854121-3 Aug 24 03:05:33.630248 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-421f441d-6f46-4fd3-8fff-f9c1ba40eb49 req-bcd0276a-0748-4e28-827c-535709ca2509 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036156 Aug 24 03:05:33.631043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5834/6826] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:05:33.986720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:33.987494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:33.994854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:33.995364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:33.995819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:33.997137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:33.997611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:33.998140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:34.017320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:34.066272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:34.075109 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4a883e16-ddc3-405e-8f07-0b08d63ba18c tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1369 microversion: 2.1 time: 0.092541 Aug 24 03:05:34.075687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5835/6827] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:33 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:35.096876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:35.097528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:35.104953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:35.105458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:35.105923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:35.106654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:35.107177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:35.107613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:35.173916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:35.182382 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4f18f65-820f-4e00-8e7f-f1b007d4b5ec tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1369 microversion: 2.1 time: 0.089556 Aug 24 03:05:35.182951 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5836/6828] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:35 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:36.204580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:36.205214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:36.207895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:36.213450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:36.213952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:36.214396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:36.215115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:36.215577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:36.216015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:36.281927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:36.290258 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bcd3f546-24a5-474c-bb7c-e0fae9588254 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1369 microversion: 2.1 time: 0.089729 Aug 24 03:05:36.290831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5837/6829] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:36 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:37.371762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:37.372461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:37.379800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:37.380316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:37.380804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:37.381531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:37.381998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:37.382437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:37.446137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b90081b57e2f408f9249e8bfbc756c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af8cb62dbf340afa7554c23f775db03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:37.455860 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c26c2968-3b64-4432-9450-c6d5e03afc58 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 200 len: 1369 microversion: 2.1 time: 0.088670 Aug 24 03:05:37.456459 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5838/6830] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:37 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:38.475745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:38.476374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:38.483420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:38.483926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:38.484382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:38.485126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:38.485596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:38.486038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:38.502363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 HTTP/1.1 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05407993-e521-41fd-b49d-4f8a4cfd9e11'} Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:38.503991 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-451b268b-bcea-46ad-8b19-64e46e9fe172 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 404 len: 111 microversion: 2.1 time: 0.033719 Aug 24 03:05:38.508551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5839/6831] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:38 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:38.565537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:38.567710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:38.574229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:38.574717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:38.575166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:38.575945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:38.576442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:38.576909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:38.590037 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-volume_attachments HTTP/1.1 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '05407993-e521-41fd-b49d-4f8a4cfd9e11'} Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:38.591630 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9fd6d8a0-ee9a-4f6e-9c3b-e0db3cfcd657 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031445 Aug 24 03:05:38.595672 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5840/6832] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:05:38 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:41.923886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:41.925157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:41.933227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:41.933843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:41.934299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:41.935015 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:41.935487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:41.936033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:41.949763 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 HTTP/1.1 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05407993-e521-41fd-b49d-4f8a4cfd9e11'} Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:41.951372 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f9dad39-49c5-4061-b377-43b90e9e8154 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 404 len: 111 microversion: 2.1 time: 0.033314 Aug 24 03:05:41.955478 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5841/6833] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:05:41 2022] DELETE /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:41.961069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:41.961690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 05407993-e521-41fd-b49d-4f8a4cfd9e11] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:41.968103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:41.968601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:41.969083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:41.969785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:41.970254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:41.970698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:41.984554 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 HTTP/1.1 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '05407993-e521-41fd-b49d-4f8a4cfd9e11'} Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:41.986107 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 05407993-e521-41fd-b49d-4f8a4cfd9e11 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74204b46-66f9-4e98-9d8f-7dd6fd9ee890 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11" status: 404 len: 111 microversion: 2.1 time: 0.030005 Aug 24 03:05:41.990361 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5842/6834] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:41 2022] GET /compute/v2.1/servers/05407993-e521-41fd-b49d-4f8a4cfd9e11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:41.995998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:41.996502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.002587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.003097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.003550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.004268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.004764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.005208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.019661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e HTTP/1.1 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2462c91f-898d-4501-ade1-4c5caf4d340e'} Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.021304 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c52eda93-02fd-44a8-854f-a6294e412bd1 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 404 len: 111 microversion: 2.1 time: 0.030617 Aug 24 03:05:42.025673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5843/6835] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:05:41 2022] DELETE /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:42.031911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.032542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 2462c91f-898d-4501-ade1-4c5caf4d340e] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.038881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.039393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.039848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.040578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.041081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.041556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.057551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e HTTP/1.1 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '2462c91f-898d-4501-ade1-4c5caf4d340e'} Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.059139 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 2462c91f-898d-4501-ade1-4c5caf4d340e could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1a52d61-9df0-47b4-ad19-427f703fbf71 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e" status: 404 len: 111 microversion: 2.1 time: 0.032549 Aug 24 03:05:42.067008 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5844/6836] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:42 2022] GET /compute/v2.1/servers/2462c91f-898d-4501-ade1-4c5caf4d340e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:42.069973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.070517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.076982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.077524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.077973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.078725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.079187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.079624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.094725 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 HTTP/1.1 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '188fc9bf-34ab-4f2d-8204-b80bbac51728'} Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.096378 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f19f0e9c-ba17-4a6a-9cda-f384559b2c26 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 404 len: 111 microversion: 2.1 time: 0.032106 Aug 24 03:05:42.103813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5845/6837] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:05:42 2022] DELETE /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:42.106897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.107518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 188fc9bf-34ab-4f2d-8204-b80bbac51728] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.113787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.114545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.114937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.115544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.116004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.116436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.130909 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 HTTP/1.1 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '188fc9bf-34ab-4f2d-8204-b80bbac51728'} Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.132466 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 188fc9bf-34ab-4f2d-8204-b80bbac51728 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f31b639-ce70-4e34-9332-161d582316f0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728" status: 404 len: 111 microversion: 2.1 time: 0.031351 Aug 24 03:05:42.137028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5846/6838] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:42 2022] GET /compute/v2.1/servers/188fc9bf-34ab-4f2d-8204-b80bbac51728 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:42.142930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.143431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.149734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.150167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.150614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.151310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.151799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.152231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.165750 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 HTTP/1.1 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1d36a18e-7ca0-4a4d-9059-cd6c798d05b7'} Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.167301 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-260f5ccd-9a5d-4fae-8ff1-a45feb7ff7b6 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 404 len: 111 microversion: 2.1 time: 0.029554 Aug 24 03:05:42.171290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5847/6839] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:05:42 2022] DELETE /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:05:42.177198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.177811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [instance: 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:42.184308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.184822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.185271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.185970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:42.186430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:42.186864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:42.200527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] HTTP exception thrown: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Request method failure captured: Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 HTTP/1.1 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZOL6PANP92sx9U00ahcjqaa87vucH_-NYDTKbFhRORkSkHSR7O_XzTlcy9rsI8TQiKovWyGVdV-4XTsAOEKe7QJRatHpAU0gtL6uMcJAZ1PW94sgxn0XwJyeY3-vuX7VXV8cfrERmy6CfkmmTDM1t6MyYmOTtFitds8FPMEIGtTzHo Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8af8cb62dbf340afa7554c23f775db03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8af8cb62dbf340afa7554c23f775db03 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServerActionsTestJSON-2079881232 Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: b90081b57e2f408f9249e8bfbc756c3a Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServerActionsTestJSON-2079881232-project Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '1d36a18e-7ca0-4a4d-9059-cd6c798d05b7'} Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:05:42.202146 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Returning 404 to user: Instance 1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f41d7a0c-1a8d-48a6-92df-2c5cc03000b0 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7" status: 404 len: 111 microversion: 2.1 time: 0.029997 Aug 24 03:05:42.209691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5848/6840] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:42 2022] GET /compute/v2.1/servers/1d36a18e-7ca0-4a4d-9059-cd6c798d05b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:05:42.211897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58cd5e09-2c36-43ef-99be-e5c7b209a092 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] Calling method '.version_select at 0x7f6b9269bca0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:42.216229 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-58cd5e09-2c36-43ef-99be-e5c7b209a092 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [f453edae-6459-4870-82e9-e93e63086404] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:05:43.223519 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-58cd5e09-2c36-43ef-99be-e5c7b209a092 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] [f453edae-6459-4870-82e9-e93e63086404] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 46954. Aug 24 03:05:43.251357 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58cd5e09-2c36-43ef-99be-e5c7b209a092 tempest-ServerActionsTestJSON-2079881232 tempest-ServerActionsTestJSON-2079881232-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453161191" status: 202 len: 0 microversion: 2.1 time: 1.042857 Aug 24 03:05:43.251966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5849/6841] 10.222.0.49 () {58 vars in 1221 bytes} [Wed Aug 24 03:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453161191 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:05:52.257876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=40 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:05:52.405536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2025971144", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8b4f3600-701d-447d-a45b-6ff76b50d50f"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:52.463732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] validate_networks() for [('8b4f3600-701d-447d-a45b-6ff76b50d50f', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:05:52.885709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:05:52.886193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:05:52.886692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:05:52.887127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:05:52.887552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:05:52.897232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:52.897735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:52.899767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:52.899767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:52.899767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:52.900058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:52.919879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Getting quotas for project 5aea0d1015f5484b8b1488bbfee3174f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:05:52.925803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Getting quotas for user 6d274e4c400043a2922c5fbfe7762f9f and project 5aea0d1015f5484b8b1488bbfee3174f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:05:52.947932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:05:52.952026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:05:53.018192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86c69145-248a-4407-8012-f960ee3e6c3c tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.763912 Aug 24 03:05:53.019460 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5850/6842] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:05:53.041870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78113a42-c7a4-4f4c-853b-d9fb48694637 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:53.043648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-78113a42-c7a4-4f4c-853b-d9fb48694637 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:53.108180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-78113a42-c7a4-4f4c-853b-d9fb48694637 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:53.116885 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78113a42-c7a4-4f4c-853b-d9fb48694637 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1217 microversion: 2.1 time: 0.081830 Aug 24 03:05:53.117490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5851/6843] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:53 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:54.140409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:54.141877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:54.152928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:54.153725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:54.154363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:54.155261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:54.155904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:54.156501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:54.261813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:54.273633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-88761018-075b-4aae-b593-da582ce6809a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1277 microversion: 2.1 time: 0.136914 Aug 24 03:05:54.287323 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5852/6844] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:54 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1277 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:55.297127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:55.297990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:55.304521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:55.305390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:55.305986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:55.307043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:55.307655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:55.308237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:55.488869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:55.499197 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc89ff7e-69a5-489b-8337-3c7a3c0b20ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.207743 Aug 24 03:05:55.514624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5853/6845] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:55 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:55.738997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b0077ae-3987-4875-aa1d-759433478ae0", "tag": "bbd27acc-2d24-4700-aff5-3190c3ad8302"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:05:55.756630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:55.757163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:55.757611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:55.776139 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] Creating event network-changed:bbd27acc-2d24-4700-aff5-3190c3ad8302 for instance 9b0077ae-3987-4875-aa1d-759433478ae0 on n-h2-854121-3 Aug 24 03:05:55.781411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c58b72b4-e1f1-4bb8-9d94-67965b24c460 req-6c78fffe-c0d4-4c6a-8a57-e9ebad9aeb0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052045 Aug 24 03:05:55.782028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5854/6846] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:05:56.523161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:56.523979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:56.531137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:56.531638 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:56.532092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:56.532832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:56.533411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:56.533848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:56.683421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:56.695487 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2ddf270-0adb-4e54-857a-80c4535c1083 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.177216 Aug 24 03:05:56.696530 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5855/6847] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:56 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:05:57.717954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:57.718630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:57.726175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:57.726674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:57.727129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:57.727901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:57.728377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:57.728849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:57.866121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:57.875001 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-995d7b5d-b1cc-43aa-aa72-5a57f1c7ae8f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.161442 Aug 24 03:05:57.875623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5856/6848] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:57 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:05:58.895842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:05:58.896572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:05:58.903501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:58.904003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:58.904612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:58.905387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:05:58.905863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:05:58.906314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:05:59.048740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:05:59.063561 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f1aeb26-59d8-4d30-8a4f-28b867e852d0 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.171048 Aug 24 03:05:59.064543 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5857/6849] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:05:58 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:00.087384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:00.088067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:00.095823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:00.096343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:00.096843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:00.097572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:00.098047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:00.098496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:00.255250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:00.263058 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-225692cb-b09d-482b-b846-e67c3c055221 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.179555 Aug 24 03:06:00.263636 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5858/6850] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:00 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:01.235794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0077ae-3987-4875-aa1d-759433478ae0", "name": "network-vif-plugged", "status": "completed", "tag": "bbd27acc-2d24-4700-aff5-3190c3ad8302"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:01.249426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:01.249936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:01.250382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:01.532112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] Creating event network-vif-plugged:bbd27acc-2d24-4700-aff5-3190c3ad8302 for instance 9b0077ae-3987-4875-aa1d-759433478ae0 on n-h2-854121-3 Aug 24 03:06:01.537187 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-59296141-7751-4aa1-b9b4-f9131baf9cea req-1f265c7c-3371-4a33-97cb-2012b0cc4b3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305131 Aug 24 03:06:01.537814 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5859/6851] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:06:01.543445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:01.544155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:01.551033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:01.551533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:01.552010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:01.552748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:01.553227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:01.553666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:01.691197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:01.702137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56852001-fb02-4985-b448-8ab4856b726d tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.163084 Aug 24 03:06:01.702725 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5860/6852] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:01 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:06:02.723521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:02.724183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:02.738123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:02.738688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:02.739189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:02.739986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:02.740564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:02.740963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:02.881076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:02.894354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0ca2b3fd-cfac-471a-9e2b-9a4d78a4a586 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1317 microversion: 2.1 time: 0.174757 Aug 24 03:06:02.894990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5861/6853] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:02 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:03.914422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:03.915048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:03.917173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:03.917905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:03.924612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:03.925224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:03.925678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:03.926402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:03.926874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:03.927318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:04.063445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:04.071415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac4d7a4f-5c97-46f7-a1fb-ced0c00bb4fe tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.160848 Aug 24 03:06:04.071996 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5862/6854] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:03 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:04.132649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1646564853", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8b4f3600-701d-447d-a45b-6ff76b50d50f"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:04.188249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] validate_networks() for [('8b4f3600-701d-447d-a45b-6ff76b50d50f', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:06:04.860368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:06:04.860842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:06:04.861339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:06:04.861769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:06:04.862195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:06:04.872282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:04.872815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:04.873268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:04.874010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:04.874486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:04.874926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:04.892855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Getting quotas for project 5aea0d1015f5484b8b1488bbfee3174f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:06:04.898879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Getting quotas for user 6d274e4c400043a2922c5fbfe7762f9f and project 5aea0d1015f5484b8b1488bbfee3174f. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:06:04.921005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:06:04.924513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:06:04.972622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4ed175b-3e28-4747-a09b-670a0539584f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843773 Aug 24 03:06:04.973348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5863/6855] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:06:04.985086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0c75118-47b4-4467-b47a-ef7802af0d43 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:04.985724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0c75118-47b4-4467-b47a-ef7802af0d43 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:05.042775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0c75118-47b4-4467-b47a-ef7802af0d43 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:05.049933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0c75118-47b4-4467-b47a-ef7802af0d43 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1217 microversion: 2.1 time: 0.068852 Aug 24 03:06:05.050510 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5864/6856] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:04 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:06.073683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:06.074351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:06.082744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:06.083229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:06.083678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:06.084393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:06.084897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:06.085336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:06.151360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:06.159927 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b14b6da-c36e-4a73-9259-59c394580a55 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1269 microversion: 2.1 time: 0.090695 Aug 24 03:06:06.160514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5865/6857] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:06 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:07.181452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:07.182761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:07.187572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:07.192508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:07.193046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:07.193687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:07.194488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:07.194963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:07.195407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:07.340526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:07.357418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfffa60b-a180-4043-9d29-14b7702fbae8 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.180088 Aug 24 03:06:07.362465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5866/6858] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:07 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:07.628280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8ee465-7657-40f8-b367-e22480488fc2", "tag": "96f83b2e-1b90-4e20-b626-8cf5782583b5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:07.644892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:07.645791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:07.646565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:07.666642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] Creating event network-changed:96f83b2e-1b90-4e20-b626-8cf5782583b5 for instance 9b8ee465-7657-40f8-b367-e22480488fc2 on n-h1-854121-3 Aug 24 03:06:07.673602 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-82537e28-31af-4245-b7ea-863194dd9a16 req-78b74dcd-319e-44b1-9366-86134a69d0db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051650 Aug 24 03:06:07.674224 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5867/6859] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:06:08.391814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:08.392501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:08.400161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:08.400668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:08.401152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:08.401878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:08.402351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:08.402789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:08.555078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:08.562893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e527cd90-5e7b-4dbf-8b11-9e066ba6d8e2 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.175980 Aug 24 03:06:08.563465 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5868/6860] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:08 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:09.583722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:09.584401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:09.591887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:09.592403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:09.592893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:09.593615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:09.594087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:09.594531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:09.727014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:09.734925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14604a0a-d4d3-48e1-92d4-4399e2928a7a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.155178 Aug 24 03:06:09.735516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5869/6861] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:09 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:10.755607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:10.756658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:10.764730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:10.765258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:10.765713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:10.766442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:10.766967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:10.767367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:10.909517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:10.917371 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb5838ef-b46b-4299-b4b2-91a77a95cccc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.165778 Aug 24 03:06:10.917956 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5870/6862] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:10 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:11.943125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:11.944702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:11.954411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:11.955046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:11.955502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:11.956233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:11.956702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:11.957175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:12.108914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:12.112492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:12.117842 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7755353c-db65-4120-839e-c4cd58b5bcc9 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.181640 Aug 24 03:06:12.118458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5871/6863] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:11 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:06:13.140058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:13.140983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:13.147612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:13.148119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:13.148583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:13.149339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:13.149819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:13.150259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:13.287305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:13.295323 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-851a25a1-789a-4f1b-a2e7-d069dd412e87 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.159988 Aug 24 03:06:13.295912 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5872/6864] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:13 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:13.973402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8ee465-7657-40f8-b367-e22480488fc2", "name": "network-vif-plugged", "status": "completed", "tag": "96f83b2e-1b90-4e20-b626-8cf5782583b5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:13.985868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:13.986367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:13.986913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:14.002012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] Creating event network-vif-plugged:96f83b2e-1b90-4e20-b626-8cf5782583b5 for instance 9b8ee465-7657-40f8-b367-e22480488fc2 on n-h1-854121-3 Aug 24 03:06:14.007132 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-51490bcf-5466-4326-b106-3c5f06f4ca7a req-9aa29c42-9355-45d5-a5ab-ed9260257626 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037341 Aug 24 03:06:14.007738 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5873/6865] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:06:14.318284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:14.319008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:14.326020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:14.326532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:14.326992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:14.327728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:14.328206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:14.328653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:14.470995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:14.479015 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27eee1d8-7bdb-49e8-83b0-39b0aef6e5c6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1317 microversion: 2.1 time: 0.165755 Aug 24 03:06:14.479616 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5874/6866] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:14 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:15.500455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:15.501139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:15.503101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:15.503829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:15.511274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.511796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.512250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.513038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.513550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.514076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.665088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:15.675892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-50a104af-9731-4cec-b59d-cbef46b84007 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1505 microversion: 2.1 time: 0.179247 Aug 24 03:06:15.676962 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5875/6867] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:15 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:15.697267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:15.698342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:15.704537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.705073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.705528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.706247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.706725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.707165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.734174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:06:15.814164 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f479dc1f-24a2-478f-9251-10771509148a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 204 len: 0 microversion: 2.1 time: 0.120667 Aug 24 03:06:15.814773 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5876/6868] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:06:15 2022] DELETE /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:06:15.823773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:15.824611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:15.831435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.831947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.832407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.833164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:15.833637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:15.834085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:15.969578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:15.979964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b814014f-e6a0-41cf-b2eb-6b6872636929 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1511 microversion: 2.1 time: 0.160820 Aug 24 03:06:15.980551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5877/6869] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:15 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:17.001409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:17.002046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:17.009071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:17.009576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:17.010028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:17.010740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:17.011211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:17.011654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:17.149903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:17.159592 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af9f9ef3-3ed3-4af4-a586-b90356f1f6fc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1511 microversion: 2.1 time: 0.162189 Aug 24 03:06:17.160197 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5878/6870] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:16 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:17.902484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8ee465-7657-40f8-b367-e22480488fc2", "name": "network-vif-deleted", "tag": "96f83b2e-1b90-4e20-b626-8cf5782583b5"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:17.920582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:17.921355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:17.922019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:17.936629 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] Creating event network-vif-deleted:96f83b2e-1b90-4e20-b626-8cf5782583b5 for instance 9b8ee465-7657-40f8-b367-e22480488fc2 on n-h1-854121-3 Aug 24 03:06:17.943242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-00c44a6e-66f8-4312-8e41-76660e54718e req-50d0d6f7-644d-410e-823c-9f246fc00c31 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048624 Aug 24 03:06:17.944427 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5879/6871] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:06:18.181156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:18.181877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:18.189157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:18.189659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:18.190109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:18.190811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:18.191274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:18.191709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:18.226900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:18.227396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:18.227851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:18.228342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lazy-loading 'fault' on Instance uuid 9b8ee465-7657-40f8-b367-e22480488fc2 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:06:18.271945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:18.279795 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33a75d8f-e112-43f5-bfc9-9b2e5c6ad0cd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 200 len: 1307 microversion: 2.1 time: 0.102931 Aug 24 03:06:18.280369 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5880/6872] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:18 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:19.300222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:19.300893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.308388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.308927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.309381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.310089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.310562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.311006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.326024 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 HTTP/1.1 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b8ee465-7657-40f8-b367-e22480488fc2'} Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.327713 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 404 to user: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28fc3c90-340d-426a-b80f-776010ca479f tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 404 len: 111 microversion: 2.1 time: 0.032960 Aug 24 03:06:19.332928 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5881/6873] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:19 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:06:19.339117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:19.339819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.346030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.346528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.346986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.347694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.348164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.348605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.485184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:19.498147 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cfe70760-8857-4058-8c04-d53f39181eb6 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.162797 Aug 24 03:06:19.499172 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5882/6874] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:19 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:19.519186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:19.521543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 358312bd-3d8a-42da-9ace-53ab47d1c669] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.527153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/358312bd-3d8a-42da-9ace-53ab47d1c669/action HTTP/1.1 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 32 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: {"resize": {"flavorRef": "452"}} Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '358312bd-3d8a-42da-9ace-53ab47d1c669', 'body': {'resize': {'flavorRef': '452'}}} Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:06:19.528769 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 404 to user: Instance 358312bd-3d8a-42da-9ace-53ab47d1c669 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3043e978-632d-4327-b50a-2ec3a04cded5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "POST /compute/v2.1/servers/358312bd-3d8a-42da-9ace-53ab47d1c669/action" status: 404 len: 111 microversion: 2.1 time: 0.015150 Aug 24 03:06:19.532482 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5883/6875] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:06:19 2022] POST /compute/v2.1/servers/358312bd-3d8a-42da-9ace-53ab47d1c669/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:06:19.540056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:19.540833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.548133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.548644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.549135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.549852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.550329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.550778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.678705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:19.686630 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7c92bab-d990-4acb-8676-4c614605af6a tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.151028 Aug 24 03:06:19.687447 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5884/6876] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:19 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:06:19.708051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:19.708828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.715822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.716333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.716815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.717544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.718017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.718481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.855858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:19.863984 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b44c4ed-8d48-4da3-8d1b-5d9e1345b3a5 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.159780 Aug 24 03:06:19.864564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5885/6877] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:19 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:19.885710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "576c3e2a-dd4a-40dc-af36-9a796274dbde"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:19.888329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.894633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.895134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.895581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.896296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.896797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.897232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.926164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:19.932324 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action HTTP/1.1 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 65 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: {"resize": {"flavorRef": "576c3e2a-dd4a-40dc-af36-9a796274dbde"}} Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: exception: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b0077ae-3987-4875-aa1d-759433478ae0', 'body': {'resize': {'flavorRef': '576c3e2a-dd4a-40dc-af36-9a796274dbde'}}} Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:19.934208 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 400 to user: Flavor 576c3e2a-dd4a-40dc-af36-9a796274dbde could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e4a786b-a0c4-4dd4-a8be-b2bf0ae439f3 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action" status: 400 len: 107 microversion: 2.1 time: 0.054493 Aug 24 03:06:19.938491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5886/6878] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:06:19 2022] POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action => generated 107 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:06:19.944269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:19.944924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:19.951900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.952400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.952893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:19.953682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:19.954146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:19.954584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.091240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:20.099542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-271b60a3-d5bd-42a9-80e8-2a881c1ab980 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.158936 Aug 24 03:06:20.100124 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5887/6879] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:19 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:20.121822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.122445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.128540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.129072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.129527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.130236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.130700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.131132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.268735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:20.276654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e22109d-2f68-4f9e-b188-87418177defd tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.159546 Aug 24 03:06:20.277269 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5888/6880] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:20 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:20.297609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ea3632b-af6d-4c25-8d5e-8a29d95a5463 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ea3632b-af6d-4c25-8d5e-8a29d95a5463 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: request: POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action HTTP/1.1 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 29 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: {"resize": {"flavorRef": ""}} Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b0077ae-3987-4875-aa1d-759433478ae0', 'body': {'resize': {'flavorRef': ''}}} Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise error Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi '' Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.301267 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ea3632b-af6d-4c25-8d5e-8a29d95a5463 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ea3632b-af6d-4c25-8d5e-8a29d95a5463 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action" status: 400 len: 113 microversion: 2.1 time: 0.009282 Aug 24 03:06:20.306374 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5889/6881] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:06:20 2022] POST /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 03:06:20.312538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.313186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.320340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.320879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.321330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.322044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.322509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.322947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.481233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:20.486790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:20.495244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f7537ad-152d-4e16-a4e4-2e57f0ad63ba tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1505 microversion: 2.1 time: 0.187052 Aug 24 03:06:20.495973 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5890/6882] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:20 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1505 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:06:20.520372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.520949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.528275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.528806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.529261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.529977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.530444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.530882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.548294 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 HTTP/1.1 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b8ee465-7657-40f8-b367-e22480488fc2'} Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:06:20.549937 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 404 to user: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1ae7a3b6-c74e-4c0b-91c5-8bde5675b43e tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 404 len: 111 microversion: 2.1 time: 0.035579 Aug 24 03:06:20.558254 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5891/6883] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:06:20 2022] DELETE /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:06:20.561069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.561729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b8ee465-7657-40f8-b367-e22480488fc2] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.568021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.568530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.569004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.569714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.570210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.570643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.584603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 HTTP/1.1 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b8ee465-7657-40f8-b367-e22480488fc2'} Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:20.586180 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 404 to user: Instance 9b8ee465-7657-40f8-b367-e22480488fc2 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d14c1078-eb0d-4275-a158-1c38407f5121 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2" status: 404 len: 111 microversion: 2.1 time: 0.030645 Aug 24 03:06:20.591335 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5892/6884] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:20 2022] GET /compute/v2.1/servers/9b8ee465-7657-40f8-b367-e22480488fc2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:06:20.597246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.597758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.604895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.605402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.605855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.606579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.607052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.607492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.635123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:06:20.728658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7acc6c1d-7159-4604-a126-cf1b85890acc tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 204 len: 0 microversion: 2.1 time: 0.134840 Aug 24 03:06:20.730561 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5893/6885] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:06:20 2022] DELETE /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:06:20.739442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:20.740159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:20.746577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.747099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.747554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.748271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:20.748761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:20.749204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:20.884181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:20.892918 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8245c891-9f9e-45da-b053-d2edc9bf2820 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1511 microversion: 2.1 time: 0.157703 Aug 24 03:06:20.893501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5894/6886] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:20 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:21.921379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:21.922073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:21.929404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:21.929904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:21.930381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:21.931125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:21.931589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:21.932783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:22.077717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:22.086088 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b63f88f-2896-4c84-8169-6a0d4eb13f22 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1511 microversion: 2.1 time: 0.169937 Aug 24 03:06:22.086668 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5895/6887] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:21 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:06:22.955740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b0077ae-3987-4875-aa1d-759433478ae0", "name": "network-vif-deleted", "tag": "bbd27acc-2d24-4700-aff5-3190c3ad8302"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:22.967786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:22.968294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:22.968770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:22.985964 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] Creating event network-vif-deleted:bbd27acc-2d24-4700-aff5-3190c3ad8302 for instance 9b0077ae-3987-4875-aa1d-759433478ae0 on n-h2-854121-3 Aug 24 03:06:22.991231 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-207508e2-1875-40a9-82f9-2963b4473e93 req-87c0ffb5-d8b4-4a54-84a8-d120680d0f4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039209 Aug 24 03:06:22.992176 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5896/6888] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:06:23.108137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:23.108881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:23.115580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:23.116085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:23.116532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:23.117291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:23.117755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:23.118195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:23.153902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:23.154311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:23.154766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:23.155235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lazy-loading 'fault' on Instance uuid 9b0077ae-3987-4875-aa1d-759433478ae0 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:06:23.205716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d274e4c400043a2922c5fbfe7762f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aea0d1015f5484b8b1488bbfee3174f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:23.214499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-017dd66b-0e29-405a-ab7c-e76efd66adfa tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 200 len: 1307 microversion: 2.1 time: 0.111486 Aug 24 03:06:23.215065 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5897/6889] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:23 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:24.238111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:24.238735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] [instance: 9b0077ae-3987-4875-aa1d-759433478ae0] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:24.246315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:24.246832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:24.247290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:24.248021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:24.248498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:24.249038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:24.263658 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] HTTP exception thrown: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Request method failure captured: Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 HTTP/1.1 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZWQiteOyRJlRSbAJtQ47pf7k36QWjLysh9gi5li3uumYuQi1pqpumGj4eOqgfTV2lMOZnDI69zjAiLh6EAvw29GZB9k_5Axojy9wSBGXprwnUd5eYE9i2QwiIUT6pGA0ahAPBfAAKvAJ6-srBwpkQQj11UzohiVGnN30a4Loq7bJ94 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5aea0d1015f5484b8b1488bbfee3174f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5aea0d1015f5484b8b1488bbfee3174f Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-ServersNegativeTestJSON-711671029 Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 6d274e4c400043a2922c5fbfe7762f9f Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-ServersNegativeTestJSON-711671029-project Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '9b0077ae-3987-4875-aa1d-759433478ae0'} Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:06:24.265334 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] Returning 404 to user: Instance 9b0077ae-3987-4875-aa1d-759433478ae0 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b17fd754-9682-4021-a030-3cb4aea8a8c7 tempest-ServersNegativeTestJSON-711671029 tempest-ServersNegativeTestJSON-711671029-project] 10.222.0.49 "GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0" status: 404 len: 111 microversion: 2.1 time: 0.032805 Aug 24 03:06:24.269868 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5898/6890] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:24 2022] GET /compute/v2.1/servers/9b0077ae-3987-4875-aa1d-759433478ae0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:06:56.582980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:56.584524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:06:56.792214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dbf5f7b-0fe1-4e6d-a795-82f883fef386 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: .version_select at 0x7f6b91ebeaf0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1803656165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUz3uGvGKIVaVZFl655yAA0olfsR6rQ2x/YYP9KsjefDw/2Jy1Wqtz57B/f+HBE6zQ+fdIuLUksRS7zVCViGAKfj0c24rQD5KtLl+HFIHOkj5ViJ3adirJ9KkkqifG4Dg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:56.809658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9dbf5f7b-0fe1-4e6d-a795-82f883fef386 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:06:56.815146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9dbf5f7b-0fe1-4e6d-a795-82f883fef386 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:06:56.842966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dbf5f7b-0fe1-4e6d-a795-82f883fef386 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.265429 Aug 24 03:06:56.843890 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5899/6891] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:06:56 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:06:56.895760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-435794658", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1803656165", "networks": [{"uuid": "d35ca01f-eec4-4fb7-aee0-90ea28a9f810"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:06:56.954289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] validate_networks() for [('d35ca01f-eec4-4fb7-aee0-90ea28a9f810', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:06:57.346820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:06:57.347259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:06:57.347744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:06:57.348173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:06:57.348594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:06:57.358889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:57.359384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:57.359831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:57.360569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:57.361063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:57.361584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:57.386934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:06:57.392262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:06:57.405096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:06:57.407418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:06:57.453916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-681f7fa3-7ba9-4696-a271-87f8e4711d86 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562098 Aug 24 03:06:57.454756 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5900/6892] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:06:57.465696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6fc16e86-54c6-42cd-8685-0d7fb7ca4e18 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:57.466373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6fc16e86-54c6-42cd-8685-0d7fb7ca4e18 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:57.521308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6fc16e86-54c6-42cd-8685-0d7fb7ca4e18 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:57.529530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6fc16e86-54c6-42cd-8685-0d7fb7ca4e18 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1262 microversion: 2.1 time: 0.068229 Aug 24 03:06:57.536289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5901/6893] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:57 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:58.551513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:58.552243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:58.559351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:58.559866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:58.560885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:58.561078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:58.561548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:58.562164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:58.627020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:58.646661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c26018ac-e909-4c08-92ec-edb0d5ea427f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1314 microversion: 2.1 time: 0.099383 Aug 24 03:06:58.647186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5902/6894] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:58 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1314 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:06:59.671037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:06:59.672176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:06:59.680971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:59.681644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:59.682164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:59.683143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:06:59.683803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:06:59.684254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:06:59.830151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:06:59.839381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-289f1e09-a145-46fb-a064-1b33a90c1f49 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.174664 Aug 24 03:06:59.840469 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5903/6895] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:06:59 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:00.575770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d9bedc-92a2-4075-a330-a1d5fbd2b558", "tag": "e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:00.596030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:00.596827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:00.597632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:00.625666 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] Creating event network-changed:e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b for instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 on n-h1-854121-3 Aug 24 03:07:00.631474 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e9f401a6-a7f0-4137-886e-a1dc851a8611 req-8fcf3721-1fc7-44ca-a35a-48cfea0313a4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070017 Aug 24 03:07:00.632655 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5904/6896] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:00.861483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:00.862197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:00.870167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:00.870680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:00.871142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:00.871881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:00.872356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:00.872841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:01.005821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:01.014035 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2a8a130-f76f-4789-9688-94cbffe0c24c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.157681 Aug 24 03:07:01.014623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5905/6897] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:00 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:02.035594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:02.036216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:02.043381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:02.043880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:02.044411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:02.045146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:02.045610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:02.046047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:02.193553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:02.202662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7141e56-e641-42df-bc55-19b14b1e4473 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.170794 Aug 24 03:07:02.206689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5906/6898] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:02 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:03.223690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:03.225072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:03.232977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:03.233489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:03.233945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:03.234702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:03.235180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:03.235621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:03.393294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:03.401621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1292902-01d2-4941-94c6-b8974d473b64 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.181876 Aug 24 03:07:03.402221 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5907/6899] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:03 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:04.423720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:04.424353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:04.432514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:04.433052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:04.433512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:04.434244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:04.434721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:04.435168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:04.566751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:04.574601 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36d5f435-43eb-4fee-b543-1514d794bc69 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.154809 Aug 24 03:07:04.575177 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5908/6900] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:04 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:05.594935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:05.595610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:05.603133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:05.603565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:05.604020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:05.604768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:05.605229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:05.605670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:05.748909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:05.757074 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-203b5966-7f8b-40ea-95d1-297a64d47415 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.165904 Aug 24 03:07:05.757659 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5909/6901] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:05 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:06.778212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:06.778903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:06.785779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:06.786278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:06.786732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:06.787435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:06.787898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:06.788333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:06.917924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:06.926130 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3f5f94a1-a6a4-425a-9542-f920e7f695e3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.151893 Aug 24 03:07:06.926708 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5910/6902] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:06 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:07.948880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:07.949508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:07.951663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:07.952412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:07.959055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:07.959593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:07.960077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:07.960817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:07.961285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:07.961773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:08.096064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:08.104090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a53ceb74-1d37-4e8e-91ee-589b3e6b51b9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.159854 Aug 24 03:07:08.104660 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5911/6903] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:07 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:08.325082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d9bedc-92a2-4075-a330-a1d5fbd2b558", "name": "network-vif-plugged", "status": "completed", "tag": "e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:08.335816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:08.337686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:08.338247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:08.354261 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] Creating event network-vif-plugged:e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b for instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 on n-h1-854121-3 Aug 24 03:07:08.359650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-601fa3be-996f-4b59-b87d-45a85554c7ec req-1807d1a2-51b4-4b51-92b6-a20860571ad5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038581 Aug 24 03:07:08.360652 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5912/6904] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:09.125035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:09.125738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:09.132762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:09.133261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:09.134202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:09.134899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:09.135363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:09.135799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:09.266158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:09.273826 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d4a9a6b-60fb-40af-8041-e8611853897d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1362 microversion: 2.1 time: 0.153060 Aug 24 03:07:09.275108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5913/6905] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:09 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:10.296051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:10.296678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:10.303646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:10.304142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:10.304586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:10.305511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:10.305855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:10.306294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:10.438034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:10.446577 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-56777c2d-d9a0-4e7b-8af1-22ac42f5fdc6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1554 microversion: 2.1 time: 0.154055 Aug 24 03:07:10.447163 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5914/6906] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:10 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:10.467021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:10.467650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:10.473786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:10.474301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:10.474764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:10.475487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:10.475966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:10.476415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:10.874181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:10.882075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f7f1de1-7f22-4e31-8ea9-bbd858aab96f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1554 microversion: 2.1 time: 0.418870 Aug 24 03:07:10.882681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5915/6907] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:10 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1554 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:12.596558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86ecf34b-2394-4995-9d79-d5a69a285977"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:12.599141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:12.607259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:12.607766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:12.608219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:12.608985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:12.609452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:12.609890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:12.871028 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad55a568-c4a5-43d7-8e73-a20f3040d4d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278440 Aug 24 03:07:12.871675 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5916/6908] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:07:12 2022] POST /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:23.581256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:23.582038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:23.586855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:23.587456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:23.595592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:23.596084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:23.596529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:23.597272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:23.597737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:23.598171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:23.679692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lazy-loading 'services' on Instance uuid 99d9bedc-92a2-4075-a330-a1d5fbd2b558 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:07:23.752643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-345053ec-6726-45f5-9204-e4f72565ed6d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments/86ecf34b-2394-4995-9d79-d5a69a285977" status: 202 len: 0 microversion: 2.1 time: 0.172777 Aug 24 03:07:23.753211 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5917/6909] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:07:23 2022] DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments/86ecf34b-2394-4995-9d79-d5a69a285977 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:07:23.762512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:23.765050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:23.771902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:23.772393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:23.772937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:23.774216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:23.774697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:23.775137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:23.805146 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa5ffeef-29b1-4f72-99bb-0a9033332bce tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047337 Aug 24 03:07:23.805719 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5918/6910] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:23 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:24.817735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:24.819920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:24.826887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:24.827393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:24.827852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:24.828575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:24.829084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:24.829534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:24.863512 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1c739d8-8085-45b0-93a7-b85534c39f9f tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049755 Aug 24 03:07:24.864068 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5919/6911] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:24 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:25.876461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:25.878749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:25.886658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:25.887159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:25.887611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:25.888333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:25.888825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:25.889267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:25.921828 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26182d0f-bad9-4ed0-89fb-9504169c3ea7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049428 Aug 24 03:07:25.925136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5920/6912] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:25 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:26.934456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:26.936775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:26.943741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:26.944245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:26.944696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:26.945435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:26.945906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:26.946344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:26.978773 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a97a1fa-a48e-4281-9932-5c865e0651b8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048214 Aug 24 03:07:26.979551 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5921/6913] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:26 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:27.991402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:27.993597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:28.000945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:28.001445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:28.001896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:28.003119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:28.003119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:28.003584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:28.034476 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e83b1c99-d2db-4f8d-ada0-dbd139fa501c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Aug 24 03:07:28.035280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5922/6914] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:27 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:29.046945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:29.049214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:29.056377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:29.056929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:29.057397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:29.058115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:29.058593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:29.059043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:29.089042 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a2b5437f-565d-4265-9965-52aff0d33afb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046054 Aug 24 03:07:29.089612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5923/6915] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:07:29 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:07:29.099569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:29.100436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:29.105865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:29.106369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:29.106824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:29.107533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:29.108012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:29.108458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:29.182702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 is not attached to volume 86ecf34b-2394-4995-9d79-d5a69a285977 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments/86ecf34b-2394-4995-9d79-d5a69a285977 HTTP/1.1 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 is not attached to volume 86ecf34b-2394-4995-9d79-d5a69a285977 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '99d9bedc-92a2-4075-a330-a1d5fbd2b558', 'id': '86ecf34b-2394-4995-9d79-d5a69a285977'} Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 86ecf34b-2394-4995-9d79-d5a69a285977. Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 is not attached to volume 86ecf34b-2394-4995-9d79-d5a69a285977 Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:07:29.204474 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 is not attached to volume 86ecf34b-2394-4995-9d79-d5a69a285977 Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 is not attached to volume 86ecf34b-2394-4995-9d79-d5a69a285977 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4e4ceb9d-b600-426a-b816-db81ae17a165 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments/86ecf34b-2394-4995-9d79-d5a69a285977" status: 404 len: 154 microversion: 2.1 time: 0.110111 Aug 24 03:07:29.212401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5924/6916] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:07:29 2022] DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558/os-volume_attachments/86ecf34b-2394-4995-9d79-d5a69a285977 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:07:32.552989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:32.553544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:32.561277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:32.561743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:32.562200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:32.562932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:32.563402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:32.563852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:32.594499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:07:32.689469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4cea93d4-ba85-43d4-96b4-73728302e4ba tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 204 len: 0 microversion: 2.1 time: 0.140795 Aug 24 03:07:32.691151 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5925/6917] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:07:32 2022] DELETE /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:07:32.700783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:32.701571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:32.708988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:32.709498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:32.709959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:32.710687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:32.711201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:32.711642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:32.842938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:32.851049 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-72d964a9-d53e-46c3-8032-8d8199127a44 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1560 microversion: 2.1 time: 0.154651 Aug 24 03:07:32.852130 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5926/6918] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:32 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:07:33.873057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:33.873735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:33.880800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:33.881299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:33.881755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:33.882482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:33.883841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:33.884284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:34.015289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:34.023106 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-db259ac6-a5a7-4949-a561-443220f7a6aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1560 microversion: 2.1 time: 0.154274 Aug 24 03:07:34.023737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5927/6919] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:33 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:34.982921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d9bedc-92a2-4075-a330-a1d5fbd2b558", "name": "network-vif-deleted", "tag": "e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:34.994609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:34.995349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:34.995876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:35.009005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] Creating event network-vif-deleted:e296ab40-a4d2-4b0f-a4b7-4fd49a5cf16b for instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 on n-h1-854121-3 Aug 24 03:07:35.016311 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-80021f50-06f5-4cf4-9bef-c29db2b11e58 req-575c8b1c-72e8-40e4-9f0c-8ad2e929003c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037324 Aug 24 03:07:35.016974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5928/6920] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:35.045995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:35.046721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:35.054295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:35.054993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:35.056063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:35.056910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:35.057588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:35.058036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:35.126932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:35.137893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b505d559-90b4-4c9d-962a-b19a318ec610 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 200 len: 1347 microversion: 2.1 time: 0.097439 Aug 24 03:07:35.138363 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5929/6921] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:35 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:36.160060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:36.160773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: 99d9bedc-92a2-4075-a330-a1d5fbd2b558] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:36.167988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:36.168499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:36.168988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:36.169722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:36.170197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:36.170646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:36.185188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 HTTP/1.1 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '99d9bedc-92a2-4075-a330-a1d5fbd2b558'} Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:07:36.186929 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance 99d9bedc-92a2-4075-a330-a1d5fbd2b558 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dfb6d628-90f5-40b0-a38f-f90f17aace1d tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558" status: 404 len: 111 microversion: 2.1 time: 0.032615 Aug 24 03:07:36.191404 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5930/6922] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:36 2022] GET /compute/v2.1/servers/99d9bedc-92a2-4075-a330-a1d5fbd2b558 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:07:36.197525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31b561ae-dd16-47c5-b6c8-594a10275d71 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '.version_select at 0x7f6b91e871f0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:36.218208 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31b561ae-dd16-47c5-b6c8-594a10275d71 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1803656165" status: 202 len: 0 microversion: 2.1 time: 0.024801 Aug 24 03:07:36.218796 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5931/6923] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 03:07:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1803656165 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:07:36.237238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ae6c3846-ea61-47ab-a3a8-111956ab7600 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: .version_select at 0x7f6b91257790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-487896397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND1gFSOM3bDnSRfpcC83l4YeCp8MJuAvzOjAa4fbaak78jSPb7PjPaD+/yLL2inBDxyOPz3lB6AxELKyweUdN4I0jODNqc0WMkPn7lljEMrR9CZniC8aQSaTrJY2j5uLA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:36.255046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ae6c3846-ea61-47ab-a3a8-111956ab7600 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:07:36.261251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-ae6c3846-ea61-47ab-a3a8-111956ab7600 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:07:36.284377 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ae6c3846-ea61-47ab-a3a8-111956ab7600 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051196 Aug 24 03:07:36.285011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5932/6924] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:07:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:07:36.337368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-622791708", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-487896397", "networks": [{"uuid": "d35ca01f-eec4-4fb7-aee0-90ea28a9f810"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:36.390069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] validate_networks() for [('d35ca01f-eec4-4fb7-aee0-90ea28a9f810', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:07:36.758195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:07:36.758639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:07:36.759128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:07:36.759560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:07:36.759988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:07:36.768953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:36.769387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:36.769842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:36.770583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:36.771084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:36.771523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:36.789955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:07:36.795384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:07:36.808330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:07:36.810707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:07:36.857702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9bfd3f9c-8c27-48f5-9135-77240a10e332 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524208 Aug 24 03:07:36.858354 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5933/6925] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:07:36.868927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67d7c377-6eaf-485d-9515-84eb5289116c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:36.869831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67d7c377-6eaf-485d-9515-84eb5289116c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:36.923982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67d7c377-6eaf-485d-9515-84eb5289116c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:36.934270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67d7c377-6eaf-485d-9515-84eb5289116c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1261 microversion: 2.1 time: 0.069074 Aug 24 03:07:36.934852 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5934/6926] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:36 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:37.956192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:37.957880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:37.965516 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:37.966345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:37.967173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:37.968244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:37.968965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:37.969640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:38.043784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:38.052804 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6837fae9-502e-45db-8991-3f27e0a71ec3 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1321 microversion: 2.1 time: 0.100806 Aug 24 03:07:38.053474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5935/6927] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:37 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1321 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:39.075824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:39.076498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:39.083944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:39.084452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:39.084942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:39.085676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:39.086190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:39.086634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:39.092524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:39.250973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:39.259866 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9c16c05e-6dfe-4d9e-815d-1d0ab4fb6fdf tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.188374 Aug 24 03:07:39.260458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5936/6928] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:39 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:39.271003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdfef2c1-8cbb-439d-88a3-48e951d7f0f6", "tag": "673f64bd-ca8e-4f1c-9d48-fbfbd95cab12"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:39.283781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:39.284552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:39.285267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:39.297314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] Creating event network-changed:673f64bd-ca8e-4f1c-9d48-fbfbd95cab12 for instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 on n-h2-854121-3 Aug 24 03:07:39.302543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-66761031-3800-4dc8-b559-341cd8b89501 req-b260a466-3cfb-46f0-83d6-34c958573702 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Aug 24 03:07:39.303688 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5937/6929] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:07:40.286872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:40.287637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:40.294703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:40.295204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:40.295653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:40.296374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:40.296872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:40.297309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:40.445064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:40.453103 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbfc67a0-5830-45e1-8efe-2b0771202256 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.171318 Aug 24 03:07:40.453676 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5938/6930] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:40 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:41.474603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:41.475285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:41.482797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:41.483286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:41.483730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:41.484430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:41.484920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:41.485357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:41.617415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:41.625512 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-475036be-b069-4fd2-9fbc-54dc914d9d5b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.154831 Aug 24 03:07:41.626081 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5939/6931] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:41 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:42.646745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:42.647402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:42.655116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:42.655621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:42.656082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:42.656833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:42.657311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:42.657756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:42.786538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:42.794245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-564e3f9f-c1f4-406d-ade7-50d30ec4369c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.151497 Aug 24 03:07:42.794815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5940/6932] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:42 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:43.815320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:43.815949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:43.823212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:43.823711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:43.824167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:43.824903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:43.825374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:43.825815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:43.975711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:43.987435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ada1b3e7-5af6-4520-8b8b-868880a826f7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.175971 Aug 24 03:07:43.988040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5941/6933] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:43 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:45.009330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:45.009995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:45.016953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:45.017460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:45.017913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:45.018620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:45.019088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:45.019528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:45.150860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:45.160244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c43779f2-532b-451a-abb5-4c6abc042ab6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.155399 Aug 24 03:07:45.160942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5942/6934] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:45 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:46.079029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfef2c1-8cbb-439d-88a3-48e951d7f0f6", "name": "network-vif-plugged", "status": "completed", "tag": "673f64bd-ca8e-4f1c-9d48-fbfbd95cab12"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:46.090990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:46.091583 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:46.092020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:46.103609 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] Creating event network-vif-plugged:673f64bd-ca8e-4f1c-9d48-fbfbd95cab12 for instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 on n-h2-854121-3 Aug 24 03:07:46.108636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-447e543a-5378-4dd3-8ec0-f829fbe51913 req-f73483b5-eeaf-43f0-b61a-937e5215f050 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033854 Aug 24 03:07:46.109293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5943/6935] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:07:46.184088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:46.184854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:46.195829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:46.196744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:46.197637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:46.198889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:46.199589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:46.200108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:46.335674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:46.344095 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-74f6381c-d89c-4443-ab80-f3ec4fe7fa84 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.164603 Aug 24 03:07:46.344677 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5944/6936] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:46 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:47.366090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:47.366761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:47.368772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:47.369492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:47.376350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:47.376881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:47.377336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:47.378055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:47.378527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:47.378970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:47.519698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:47.527680 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc20032e-83b9-4561-9c36-d022a031b857 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1361 microversion: 2.1 time: 0.165457 Aug 24 03:07:47.528348 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5945/6937] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:47 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:48.548736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:48.549359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:48.557122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:48.557643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:48.558084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:48.558792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:48.559266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:48.559708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:48.687470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:48.695296 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84856f50-3a5b-4a56-b3e8-1794fddaa046 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1553 microversion: 2.1 time: 0.150532 Aug 24 03:07:48.695847 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5946/6938] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:48 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:48.715074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:07:48.715720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:48.721441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:48.721936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:48.722384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:48.723082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:48.723544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:48.724016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:48.864140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:07:48.873848 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc70e39c-1d62-4084-a2f9-50fd6e5661d6 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1553 microversion: 2.1 time: 0.162196 Aug 24 03:07:48.874436 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5947/6939] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:07:48 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:07:50.377061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:07:50.379418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:07:50.383859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:07:50.387821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:50.388327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:50.388813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:50.389542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:07:50.390018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:07:50.390464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:07:50.662651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d0e9cbcd-a717-4e96-9b37-75c2777ead68 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289504 Aug 24 03:07:50.663281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5948/6940] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:07:50 2022] POST /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:01.368341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:01.373670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:01.374273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:01.381053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:01.381550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:01.381998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:01.382722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:01.383187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:01.383623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:01.462914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lazy-loading 'services' on Instance uuid fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:08:01.532110 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1246a4e5-aa79-4ddb-b370-13969e77c417 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments/fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28" status: 202 len: 0 microversion: 2.1 time: 0.165908 Aug 24 03:08:01.532764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5949/6941] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:08:01 2022] DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments/fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:08:01.542167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:01.544567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:01.551432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:01.551945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:01.552414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:01.553173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:01.553644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:01.554089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:01.584309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efe1f54b-f8ed-449a-aade-afaf671bd553 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047027 Aug 24 03:08:01.584913 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5950/6942] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:01 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:02.597523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:02.599733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:02.607656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:02.608163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:02.608620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:02.609371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:02.609901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:02.610349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:02.644054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4a11ec4-d3a5-40a7-98d9-d9377e80f27e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050524 Aug 24 03:08:02.644649 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5951/6943] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:02 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:03.655757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:03.658040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:03.665884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:03.666395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:03.666847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:03.667571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:03.668045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:03.668490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:03.700818 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ec7251e-1a9b-40dd-863b-7509762857aa tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Aug 24 03:08:03.701438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5952/6944] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:03 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:04.712422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:04.715437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:04.722792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:04.723411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:04.723939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:04.724781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:04.725323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:04.725880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:04.759864 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7ce6412-dc16-4b03-bc8d-302f922f8ef9 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051417 Aug 24 03:08:04.764471 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5953/6945] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:04 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:05.773591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:05.776062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:05.783977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:05.784624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:05.785157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:05.785930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:05.786525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:05.787068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:05.821570 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b740e002-4cdf-4b72-9591-d5e00ae149bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052753 Aug 24 03:08:05.822466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5954/6946] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:05 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:06.834083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:06.836260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:06.843246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:06.843739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:06.844188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:06.844915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:06.845381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:06.845933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:06.875282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0495dad1-dfb6-41ad-914d-6d0df41e7d20 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045249 Aug 24 03:08:06.875842 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5955/6947] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:06 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:08:06.887332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:06.887834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:06.893862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:06.894359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:06.894807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:06.895520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:06.895976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:06.896413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:06.971723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 is not attached to volume fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments/fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 HTTP/1.1 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 is not attached to volume fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'fdfef2c1-8cbb-439d-88a3-48e951d7f0f6', 'id': 'fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28'} Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28. Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 is not attached to volume fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:06.973409 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 is not attached to volume fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 is not attached to volume fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b598d06-eba9-49eb-91d0-98d27c9cb246 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments/fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28" status: 404 len: 154 microversion: 2.1 time: 0.091582 Aug 24 03:08:06.978005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5956/6948] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:08:06 2022] DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6/os-volume_attachments/fe5f5a14-0d4b-4ef3-b7f6-056e62d2df28 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:08:10.329082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:10.329790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:10.338030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:10.338524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:10.338981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:10.339690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:10.340161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:10.340605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:10.369264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:08:10.459210 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6cf8bfe-d20e-4a45-be5e-35b3da4370bb tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 204 len: 0 microversion: 2.1 time: 0.134249 Aug 24 03:08:10.459950 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5957/6949] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:08:10 2022] DELETE /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:08:10.469643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:10.470375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:10.477451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:10.477966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:10.478425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:10.479187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:10.479662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:10.480107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:10.617591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:10.626404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d00f5a7-37b1-42ce-869e-dc7349bc6c83 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1559 microversion: 2.1 time: 0.161172 Aug 24 03:08:10.627040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5958/6950] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:10 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:11.648257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:11.648930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:11.656110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:11.656607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:11.657083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:11.657793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:11.658258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:11.658694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:11.791449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:11.799472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64648e54-4566-4334-846c-72a52226d8e7 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1559 microversion: 2.1 time: 0.155789 Aug 24 03:08:11.800043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5959/6951] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:11 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:12.813522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdfef2c1-8cbb-439d-88a3-48e951d7f0f6", "name": "network-vif-deleted", "tag": "673f64bd-ca8e-4f1c-9d48-fbfbd95cab12"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:12.826337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:12.827006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:12.827726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:12.846913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] Creating event network-vif-deleted:673f64bd-ca8e-4f1c-9d48-fbfbd95cab12 for instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 on n-h2-854121-3 Aug 24 03:08:12.856686 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e3bb5147-03c2-4678-899b-554bfafd9c88 req-2fd824cf-e882-4bca-889e-aeaa2e7ea95d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046826 Aug 24 03:08:12.857462 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5960/6952] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:08:12.871930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:12.873383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:12.880232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:12.880769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:12.881408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:12.883388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:12.883388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:12.883866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:12.959660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:12.968636 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41f3a854-409c-4c46-b66a-b3b89fa2c004 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 200 len: 1346 microversion: 2.1 time: 0.100642 Aug 24 03:08:12.969271 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5961/6953] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:12 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:08:13.989579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:13.990269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: fdfef2c1-8cbb-439d-88a3-48e951d7f0f6] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:13.997528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:13.998037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:13.998496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:13.999211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:13.999717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:14.000160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:14.014797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 HTTP/1.1 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'fdfef2c1-8cbb-439d-88a3-48e951d7f0f6'} Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:14.016481 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e25b012d-7303-425d-9e83-47cd7bfc4272 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6" status: 404 len: 111 microversion: 2.1 time: 0.032315 Aug 24 03:08:14.021159 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5962/6954] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:13 2022] GET /compute/v2.1/servers/fdfef2c1-8cbb-439d-88a3-48e951d7f0f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:08:14.027515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f2962a0-5a55-49e0-91fd-c4e4c3dddb89 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '.version_select at 0x7f6b910cb4c0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:14.047731 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f2962a0-5a55-49e0-91fd-c4e4c3dddb89 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-487896397" status: 202 len: 0 microversion: 2.1 time: 0.023962 Aug 24 03:08:14.048316 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5963/6955] 10.222.0.49 () {58 vars in 1275 bytes} [Wed Aug 24 03:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-487896397 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:08:14.065762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-643c7820-7f4f-45e1-80ef-3653c9578043 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: .version_select at 0x7f6b9143b040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1514894402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD12B2tUqG4d/pp77qlQ9Who3LcUcBtHGUkK/QZh9wFWuohNsCi3OEO0VXD4KpJCVU7HojNwL+DeWTx1NWbRUqiPcJPXbeACehVmHlsWH/KT1N0smVAwfzgomVQZVn/vow=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:14.082784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-643c7820-7f4f-45e1-80ef-3653c9578043 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:08:14.088925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-643c7820-7f4f-45e1-80ef-3653c9578043 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:08:14.112162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-643c7820-7f4f-45e1-80ef-3653c9578043 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050349 Aug 24 03:08:14.112785 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5964/6956] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:08:14 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:14.165268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-108696668", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1514894402", "networks": [{"uuid": "d35ca01f-eec4-4fb7-aee0-90ea28a9f810"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:14.217736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] validate_networks() for [('d35ca01f-eec4-4fb7-aee0-90ea28a9f810', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:08:14.612050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:08:14.612518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:08:14.613033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:08:14.613606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:08:14.614036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:08:14.624260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:14.624782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:14.625232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:14.625965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:14.626429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:14.626863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:14.644188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:08:14.649480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Getting quotas for user d3683d5a7f5e432e9c0bdfc14a96116a and project 8beda81bb20d4384af85632c2b56de3d. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:08:14.662157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:08:14.665211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:08:14.711774 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3195be0b-f77c-48bf-8883-5158a6d6e603 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550528 Aug 24 03:08:14.712516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5965/6957] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:08:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:08:14.723282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-33b69867-d8fc-4870-b573-4b4af438078b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:14.723907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-33b69867-d8fc-4870-b573-4b4af438078b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:14.787118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-33b69867-d8fc-4870-b573-4b4af438078b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:14.797033 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-33b69867-d8fc-4870-b573-4b4af438078b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1262 microversion: 2.1 time: 0.077667 Aug 24 03:08:14.798040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5966/6958] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:14 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:15.821799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:15.822568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:15.831300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:15.831880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:15.832333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:15.833073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:15.833542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:15.834052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:15.915289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:15.925531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2213cbc9-fc89-4747-827c-0a6e2acfbd10 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1322 microversion: 2.1 time: 0.109585 Aug 24 03:08:15.926329 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5967/6959] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:15 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:16.948401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:16.949181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:16.956585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:16.957329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:16.958004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:16.958703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:16.959422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:16.959936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:16.965018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:17.101228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:17.109240 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-489fc37c-35cc-4269-9b50-a16c8ae2b76b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.165387 Aug 24 03:08:17.109842 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5968/6960] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:16 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:17.176624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b4f896-e204-4636-a38d-05f71087d988", "tag": "4e132246-0fb9-46dd-9e43-72b985a76d6b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:17.188404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:17.188847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:17.189298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:17.201550 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] Creating event network-changed:4e132246-0fb9-46dd-9e43-72b985a76d6b for instance b2b4f896-e204-4636-a38d-05f71087d988 on n-h2-854121-3 Aug 24 03:08:17.206876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f0428c47-fa8a-473b-9178-d2516a87a234 req-439547ad-c2e2-4399-ac44-78f99878c6a0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034208 Aug 24 03:08:17.207490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5969/6961] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:08:18.132293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:18.132960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:18.139278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:18.139850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:18.140312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:18.141055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:18.141515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:18.141950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:18.276676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:18.285484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb1b7788-e884-445d-8252-32ddb0ffb27a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.158272 Aug 24 03:08:18.286084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5970/6962] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:18 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:19.308090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:19.308760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:19.315640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:19.316137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:19.316588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:19.317323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:19.317794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:19.318233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:19.450664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:19.458359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5f420b89-065b-48ff-9fcd-c9cf23f94a58 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.154861 Aug 24 03:08:19.458932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5971/6963] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:19 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:20.479641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:20.480285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:20.487342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:20.487838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:20.488288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:20.489018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:20.489483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:20.489921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:20.640504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:20.648797 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-58c2f4a8-c283-446d-8766-670898ed89f8 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.173012 Aug 24 03:08:20.649514 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5972/6964] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:20 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:21.669798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:21.670554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:21.677751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:21.678252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:21.678736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:21.679460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:21.679927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:21.680382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:21.814149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:21.822149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-69245c92-8041-4798-8329-cb613ad09e5e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.156243 Aug 24 03:08:21.822727 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5973/6965] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:21 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:22.185485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b4f896-e204-4636-a38d-05f71087d988", "name": "network-vif-plugged", "status": "completed", "tag": "4e132246-0fb9-46dd-9e43-72b985a76d6b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:22.197136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:22.197136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:22.197351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:22.210447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] Creating event network-vif-plugged:4e132246-0fb9-46dd-9e43-72b985a76d6b for instance b2b4f896-e204-4636-a38d-05f71087d988 on n-h2-854121-3 Aug 24 03:08:22.215857 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a3f91585-7b5d-4961-acae-f392fc6cb1f1 req-c852ed25-fc0f-4ceb-9dbf-9e41403fd1ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034205 Aug 24 03:08:22.216520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5974/6966] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:22.845267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:22.845959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:22.852698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:22.853333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:22.853786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:22.854495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:22.854960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:22.855397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:22.992322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:23.000654 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc77b414-e532-4619-b067-3894d1ce5a5c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1362 microversion: 2.1 time: 0.160561 Aug 24 03:08:23.001293 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5975/6967] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:22 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:24.021456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:24.022210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:24.029366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:24.029871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:24.030327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:24.031052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:24.031529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:24.031989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:24.167582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:24.175596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9d70208-9fd1-42d9-bbe6-d302fa77a340 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1554 microversion: 2.1 time: 0.158153 Aug 24 03:08:24.176183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5976/6968] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:24 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:24.197156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:24.197789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:24.204263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:24.204823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:24.205257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:24.205978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:24.206448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:24.206889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:24.350235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:24.359196 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8f5350e-4a8f-442b-8fed-57db6c344895 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1554 microversion: 2.1 time: 0.166463 Aug 24 03:08:24.359804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5977/6969] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:24 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:25.854365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "954428f2-36d1-450a-8de5-382a76077753"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:25.856760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:25.858840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:25.859555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:25.866854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:25.867359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:25.867811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:25.868560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:25.869057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:25.869497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:26.151770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28b45de3-9ced-4de7-950f-240489f5903a tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "POST /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301705 Aug 24 03:08:26.152401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5978/6970] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:08:25 2022] POST /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:36.836969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:36.837864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:08:36.842016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:36.842649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:36.850201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:36.851264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:36.851743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:36.852440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:36.852942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:36.853381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:36.934763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lazy-loading 'services' on Instance uuid b2b4f896-e204-4636-a38d-05f71087d988 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:08:37.009758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9e4da6d-63bc-4442-870a-ce40a78d77dc tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments/954428f2-36d1-450a-8de5-382a76077753" status: 202 len: 0 microversion: 2.1 time: 0.175054 Aug 24 03:08:37.010366 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5979/6971] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:08:36 2022] DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments/954428f2-36d1-450a-8de5-382a76077753 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:08:37.018865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:37.021246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:37.028639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:37.029245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:37.029728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:37.030668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:37.031790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:37.032190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:37.063226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f529fd8c-0005-4eae-b203-34482cb0a7a2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 Aug 24 03:08:37.063798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5980/6972] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:37 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:38.075696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:38.077926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:38.085036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:38.085537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:38.085997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:38.086706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:38.087177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:38.087618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:38.118381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96a20b45-46b8-4711-a08e-7db6f771257e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046714 Aug 24 03:08:38.118954 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5981/6973] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:38 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:39.131099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:39.133799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:39.142361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:39.142864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:39.143312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:39.144028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:39.144492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:39.144959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:39.179340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b1323f8-56ea-46bc-8b2c-7fc235b128a5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052193 Aug 24 03:08:39.180370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5982/6974] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:39 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:40.192433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:40.194671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:40.201676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:40.202173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:40.202617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:40.203326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:40.203789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:40.204225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:40.235493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dc2fc4b7-3336-4289-984b-4026e8981390 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Aug 24 03:08:40.235493 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5983/6975] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:40 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:41.247634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:41.249981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:41.257138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:41.257711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:41.258300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:41.259075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:41.259546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:41.259982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:41.293507 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a9ce996-ab69-4cf2-b17b-260c14ad0d4b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050106 Aug 24 03:08:41.294086 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5984/6976] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:41 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:42.306429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:42.308552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:42.315543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:42.316050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:42.316504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:42.317242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:42.317714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:42.318157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:42.346726 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17e11963-3a7e-426b-9c1c-a6e3aaa6959c tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045042 Aug 24 03:08:42.347289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5985/6977] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:08:42 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:08:42.357865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:42.358372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:42.364047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:42.364540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:42.365029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:42.365738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:42.366778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:42.367222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:42.440094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance b2b4f896-e204-4636-a38d-05f71087d988 is not attached to volume 954428f2-36d1-450a-8de5-382a76077753 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments/954428f2-36d1-450a-8de5-382a76077753 HTTP/1.1 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b2b4f896-e204-4636-a38d-05f71087d988 is not attached to volume 954428f2-36d1-450a-8de5-382a76077753 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'b2b4f896-e204-4636-a38d-05f71087d988', 'id': '954428f2-36d1-450a-8de5-382a76077753'} Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 954428f2-36d1-450a-8de5-382a76077753. Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b4f896-e204-4636-a38d-05f71087d988 is not attached to volume 954428f2-36d1-450a-8de5-382a76077753 Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:42.441719 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b4f896-e204-4636-a38d-05f71087d988 is not attached to volume 954428f2-36d1-450a-8de5-382a76077753 Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance b2b4f896-e204-4636-a38d-05f71087d988 is not attached to volume 954428f2-36d1-450a-8de5-382a76077753 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02f8a131-e67f-4fa3-9dfd-7ebf5736e4ee tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments/954428f2-36d1-450a-8de5-382a76077753" status: 404 len: 154 microversion: 2.1 time: 0.089167 Aug 24 03:08:42.446298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5986/6978] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:08:42 2022] DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988/os-volume_attachments/954428f2-36d1-450a-8de5-382a76077753 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:08:45.783896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:45.784546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:45.792411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:45.792960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:45.793415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:45.794133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:45.794602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:45.795038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:45.821767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:08:45.897340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fb09a0a1-fdd5-4ca0-98d1-c1b7a2ea75e2 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 204 len: 0 microversion: 2.1 time: 0.116931 Aug 24 03:08:45.898191 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5987/6979] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:08:45 2022] DELETE /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:08:45.907799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:45.908518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:45.914636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:45.915138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:45.915590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:45.916348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:45.916778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:45.917219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:46.046622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:46.055397 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cea4c472-8ea3-44cf-b4df-fd7a1bb6967e tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1560 microversion: 2.1 time: 0.151954 Aug 24 03:08:46.056256 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5988/6980] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:45 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:47.076789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:47.077460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:47.084357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:47.085450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:47.085900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:47.086594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:47.087055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:47.087489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:47.216331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:47.224035 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f02822ae-0bf1-4ca6-b9c3-92d68b58fa31 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1560 microversion: 2.1 time: 0.151165 Aug 24 03:08:47.224597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5989/6981] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:47 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:48.245056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:48.246158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:48.252986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:48.253483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:48.253939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:48.254642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:48.255107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:48.255539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:48.387937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3683d5a7f5e432e9c0bdfc14a96116a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8beda81bb20d4384af85632c2b56de3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:08:48.396622 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b5058f9-45dc-471e-8983-121699ea832b tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 200 len: 1560 microversion: 2.1 time: 0.155442 Aug 24 03:08:48.397241 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5990/6982] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:48 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:08:48.542596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b4f896-e204-4636-a38d-05f71087d988", "name": "network-vif-deleted", "tag": "4e132246-0fb9-46dd-9e43-72b985a76d6b"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:08:48.553017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:48.553515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:48.553967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:48.568340 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] Creating event network-vif-deleted:4e132246-0fb9-46dd-9e43-72b985a76d6b for instance b2b4f896-e204-4636-a38d-05f71087d988 on n-h2-854121-3 Aug 24 03:08:48.574889 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-efbfd829-7dd0-46fd-9bd8-4bccce6fd8a6 req-22ca1f29-2780-4aed-b91a-bc2fa51187a2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036013 Aug 24 03:08:48.575502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5991/6983] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:08:49.420788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:49.421428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] [instance: b2b4f896-e204-4636-a38d-05f71087d988] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:08:49.428926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:49.429625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:49.430621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:49.431316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:08:49.431780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:08:49.432220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:08:49.445832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] HTTP exception thrown: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Request method failure captured: Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 HTTP/1.1 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZXL-5Jbuli9EvVKkZVjo29KRyS2IroYgxZdG1Ex3TZXq3uOFrJ4ZyrnCneG2Bjz143e1FLVZt4c_YipAfvExeTvuAmX6-BqDx_v_DniE2DCLG9mOseNRBMH-Vq8z1xEd0ofFl4zRSJ7Q1cGvEKLq8yjFcla2DhpUpXgVjuWaA2HP9M Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8beda81bb20d4384af85632c2b56de3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 8beda81bb20d4384af85632c2b56de3d Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-912612956 Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d3683d5a7f5e432e9c0bdfc14a96116a Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestEncryptedCinderVolumes-912612956-project Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b2b4f896-e204-4636-a38d-05f71087d988'} Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:08:49.447985 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Returning 404 to user: Instance b2b4f896-e204-4636-a38d-05f71087d988 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bddef254-702f-43e4-bc73-b429edc17eea tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988" status: 404 len: 111 microversion: 2.1 time: 0.033979 Aug 24 03:08:49.452953 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5992/6984] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:08:49 2022] GET /compute/v2.1/servers/b2b4f896-e204-4636-a38d-05f71087d988 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:08:49.457630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-14281ddf-2cc0-4af7-b6f2-383d172afab5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] Calling method '.version_select at 0x7f6b913e8820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:08:49.477205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-14281ddf-2cc0-4af7-b6f2-383d172afab5 tempest-TestEncryptedCinderVolumes-912612956 tempest-TestEncryptedCinderVolumes-912612956-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1514894402" status: 202 len: 0 microversion: 2.1 time: 0.022955 Aug 24 03:08:49.477760 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5993/6985] 10.222.0.49 () {58 vars in 1278 bytes} [Wed Aug 24 03:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1514894402 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:09:16.350261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3dd978c1-c30a-4349-8d27-3a5e1c6dcffd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: .version_select at 0x7f6b914e8040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-472408647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmj2fKP4S/x7KPyI2OYy7fTyW0Ol0NcZO9Qdr9q7Gg1oUr0/22sYtLkXzcvFoaY8CyQo7xK2WvmfA3ajxkYPik/6xQ7XyOAAuCGxFRZhblIaW0T+7TPXU3jVSt4YNX0vg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:16.358830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:16.359620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:16.372349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3dd978c1-c30a-4349-8d27-3a5e1c6dcffd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for project 0453382431364216a62bb99145b771b3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:09:16.379010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-3dd978c1-c30a-4349-8d27-3a5e1c6dcffd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for user acfff7a88a5b478ba032d534ddbf183f and project 0453382431364216a62bb99145b771b3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:09:16.406057 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3dd978c1-c30a-4349-8d27-3a5e1c6dcffd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060590 Aug 24 03:09:16.406657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5994/6986] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:09:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:16.457813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1436888627", "imageRef": "b6ae42c6-225d-47ac-9495-519f9b4be661", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-472408647", "networks": [{"uuid": "35129145-08db-4f7b-8d27-756780989b31"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:16.508806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] validate_networks() for [('35129145-08db-4f7b-8d27-756780989b31', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:09:16.889620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:09:16.890057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:09:16.890572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:09:16.890995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:09:16.891421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:09:16.900828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:16.901334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:16.901789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:16.902544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:16.903016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:16.903460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:16.921271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for project 0453382431364216a62bb99145b771b3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:09:16.926570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for user acfff7a88a5b478ba032d534ddbf183f and project 0453382431364216a62bb99145b771b3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:09:16.939533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:09:16.941785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b6ae42c6-225d-47ac-9495-519f9b4be661',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:09:16.992894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-106ab85b-52c6-4477-bd25-0422c39130ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538875 Aug 24 03:09:16.993544 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5995/6987] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:09:17.003966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-07c9df73-75db-459b-ac92-a79d34cb48c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:17.004580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-07c9df73-75db-459b-ac92-a79d34cb48c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:17.059146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-07c9df73-75db-459b-ac92-a79d34cb48c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:17.066180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-07c9df73-75db-459b-ac92-a79d34cb48c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1258 microversion: 2.1 time: 0.065875 Aug 24 03:09:17.066775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5996/6988] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:16 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:18.088250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:18.088899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:18.096710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:18.097237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:18.097689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:18.099234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:18.100129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:18.100744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:18.167241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:18.175499 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f5e28fa2-df84-45a0-94c1-16576853474b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1318 microversion: 2.1 time: 0.092759 Aug 24 03:09:18.176458 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5997/6989] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:18 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:19.196870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:19.197585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:19.205570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:19.206078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:19.206541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:19.207267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:19.207744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:19.208188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:19.363128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:19.373977 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b1fe7a2-fa2d-4419-980d-531ba66700a9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.180978 Aug 24 03:09:19.374917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5998/6990] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:19 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:20.396122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:20.397952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:20.406090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:20.406717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:20.407166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:20.408057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:20.408674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:20.409283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:20.546518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:20.554764 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-acabd032-7a2b-455b-8cff-d0fb53fdbd2a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.162494 Aug 24 03:09:20.555608 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 5999/6991] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:20 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:21.578275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:21.580353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:21.589910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:21.590675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:21.591299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:21.592054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:21.592734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:21.593195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:21.736275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:21.744459 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3e07218-b177-4cf4-bec8-b359934156ed tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.171839 Aug 24 03:09:21.745307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6000/6992] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:21 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:22.765911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:22.766642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:22.774705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:22.775673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:22.776451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:22.777572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:22.778352 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:22.779211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:23.102925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:23.110699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7975cb1e-d7b0-465e-bc39-75847b06c1d6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.348733 Aug 24 03:09:23.111850 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6001/6993] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:22 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:24.131555 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:24.132393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:24.139751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:24.140261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:24.140747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:24.141465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:24.153390 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:24.153899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:24.297784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:24.306655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5511d6cd-6360-4b4f-8897-9fd7bbe5fc07 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.179004 Aug 24 03:09:24.307262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6002/6994] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:24 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:25.327521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:25.328225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:25.335177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:25.335692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:25.336147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:25.336915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:25.337550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:25.337996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:25.474856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:25.485876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-52e9098d-fe31-4220-aea9-f67e06196b26 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.161986 Aug 24 03:09:25.486812 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6003/6995] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:25 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:09:26.508107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:26.508778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:26.515682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:26.516185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:26.516639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:26.517366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:26.517839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:26.518282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:26.645508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:26.653893 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06546b14-eac8-4876-9db7-7ad5e54e298f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.150341 Aug 24 03:09:26.654467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6004/6996] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:26 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:27.674455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:27.675310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:27.676861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:27.677708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:27.684146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:27.684641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:27.685112 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:27.685814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:27.686274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:27.686767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:27.817388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:27.825030 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-282e3924-2780-41aa-b664-6cc870ed6674 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.154552 Aug 24 03:09:27.825600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6005/6997] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:27 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:28.845891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:28.846527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:28.854082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:28.854581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:28.855034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:28.855743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:28.856210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:28.856652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:28.988348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:28.996961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-41569e81-3f1d-48ef-83bc-3a17d846268d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.154969 Aug 24 03:09:28.997540 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6006/6998] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:28 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:30.017939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:30.018605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:30.025604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:30.026107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:30.026553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:30.027264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:30.027730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:30.028310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:30.164832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:30.172534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-128e6910-eb2c-40c3-a859-742ff04f8d9d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.158565 Aug 24 03:09:30.173140 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6007/6999] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:30 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:30.265248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:30.274997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:30.275411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:30.275849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:30.286753 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] Creating event network-changed:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:09:30.292278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c5128cdb-bcfc-4961-85b1-9ba4b7b12c42 req-ca074371-4349-4199-a100-77fb6ad677a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030744 Aug 24 03:09:30.293066 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6008/7000] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:31.196095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:31.196831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:31.203138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:31.203643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:31.204107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:31.204845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:31.205323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:31.205768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:31.334284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:31.342628 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-047c4124-9c33-473b-a0bb-a15efec67a8f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.152278 Aug 24 03:09:31.343213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6009/7001] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:31 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:32.363273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:32.363901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:32.370804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:32.371556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:32.372006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:32.372707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:32.373199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:32.373636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:32.499451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:32.507626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3fc51383-d6db-424b-8248-71d41a8f6953 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.147723 Aug 24 03:09:32.508198 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6010/7002] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:32 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:33.527704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:33.528345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:33.535119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:33.535619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:33.536071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:33.536800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:33.537299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:33.537745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:33.668004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:33.675662 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8a0bd83-3c04-45e1-875e-a79472b06f63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.151926 Aug 24 03:09:33.676233 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6011/7003] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:33 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:34.696101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:34.696696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:34.703483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:34.703971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:34.704414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:34.705137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:34.705603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:34.706037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:34.831821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:34.839505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3db61398-0640-435b-a63c-72b25a229988 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.147990 Aug 24 03:09:34.840073 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6012/7004] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:34 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:35.860742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:35.861414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:35.868927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:35.869424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:35.869871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:35.870574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:35.871285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:35.871720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:36.003316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:36.007479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:36.012890 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54707b10-1bc0-400a-8a38-b6c01b9ecb17 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.156020 Aug 24 03:09:36.013474 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6013/7005] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:35 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:36.528577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "name": "network-vif-plugged", "status": "completed", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:36.538287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:36.539151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:36.539275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:36.550469 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] Creating event network-vif-plugged:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:09:36.555276 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-85f57be7-1e6b-44e8-ab91-5066f1455657 req-876edb91-cd1b-4f99-9bc2-dc82668258cd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Aug 24 03:09:36.555865 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6014/7006] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:37.034793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:37.035505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:37.041815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:37.042320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:37.042774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:37.043479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:37.043952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:37.044394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:37.173235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:37.181121 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2dd063f9-9fc9-4bd5-8984-b5cfef19b800 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1358 microversion: 2.1 time: 0.151388 Aug 24 03:09:37.181695 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6015/7007] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:37 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:38.202065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:38.202728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:38.209669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.210259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.210711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.211438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.211905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.212343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.344628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:38.352480 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f7c0cfce-4b80-412c-9351-c009475531c9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1547 microversion: 2.1 time: 0.154604 Aug 24 03:09:38.353103 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6016/7008] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:38 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:38.373155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:38.373775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:38.379431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.379932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.380384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.381128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.381600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.382087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.508899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:38.516626 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-383b020a-25d3-43e1-a24b-b0bf7999b3ea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1547 microversion: 2.1 time: 0.147225 Aug 24 03:09:38.517220 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6017/7009] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:38 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:38.536224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:38.540853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:38.541626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Searching by: {'deleted': False, 'project_id': '0453382431364216a62bb99145b771b3'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:09:38.546669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.547153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.547597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.548331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.548817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.549251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.573123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:09:38.599391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b01735c7-b6b7-4031-84bd-f07505482f6a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066747 Aug 24 03:09:38.599896 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6018/7010] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 03:09:38 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:38.610637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:38.611246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:38.616830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.617323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.617768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.618458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:38.618923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:38.619364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:38.744429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:38.752438 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-538ac382-6b6f-4c09-81f0-e2e86321bc0b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1547 microversion: 2.1 time: 0.145352 Aug 24 03:09:38.753049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6019/7011] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:38 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:40.286824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd853ab9-97c1-4a11-a056-e16d2cca9749"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:40.289220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:40.296029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:40.296521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:40.297005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:40.297698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:40.298158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:40.298591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:40.737419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32c8a79b-ade3-40ef-86c9-9026283fea8a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454333 Aug 24 03:09:40.742147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6020/7012] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:09:40 2022] POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:53.740284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:53.741226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:53.741859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:09:53.746777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:53.747498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:53.757115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:53.757617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:53.758071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:53.758778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:53.759249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:53.759694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:53.893244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:53.901625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f6fa1f7-de4d-44b9-a5e6-b1cee0f9df63 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1593 microversion: 2.1 time: 0.163324 Aug 24 03:09:53.902219 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6021/7013] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:53 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1593 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:09:55.544178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:55.554864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:55.555549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:55.556264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:55.568408 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] Creating event network-changed:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:09:55.573935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9d1477a4-adc2-42bd-b515-248af5686328 req-f07e228d-9da2-4c49-94a1-7960fd7884f5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098523 Aug 24 03:09:55.575213 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6022/7014] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:09:56.466789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-478316992"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:56.467433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:56.474113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:56.474619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:56.475677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:56.476394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:56.476896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:56.477341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:56.616677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Adding security group 21ec3770-e8a3-4f13-8a9d-fd8133f001ef to port b5744999-4e51-41a9-98bd-bbbab7a5675a Aug 24 03:09:56.935814 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-02ab3ffb-5536-46d4-9fd2-f0f3bd36a440 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action" status: 202 len: 0 microversion: 2.1 time: 0.473278 Aug 24 03:09:56.936495 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6023/7015] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:09:56 2022] POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:09:56.945586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:09:56.946219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:09:56.952605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:56.953144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:56.953599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:56.955220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:56.955721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:56.956344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:57.378522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:09:57.386926 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20d04809-1940-41a5-b65a-42120cfb4d66 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1758 microversion: 2.1 time: 0.445917 Aug 24 03:09:57.387516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6024/7016] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:09:56 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1758 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:09:57.589621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:09:57.599696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:09:57.600694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:09:57.601155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:09:57.612122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] Creating event network-changed:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:09:57.617715 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e388e091-84dd-4cdc-b12f-f26b95cbfe81 req-9702a882-5395-4a11-be6c-2a6c86f97a5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Aug 24 03:09:57.618280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6025/7017] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:12:18.320388 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 03:12:18.321945 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:12:18.322588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:12:18.323515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:12:18.328305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:12:18.331134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:12:18.338102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:18.338603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:18.339057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:18.339764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:18.340234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:18.340682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:18.413400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c3c1b89b-572d-4d5d-b300-6b9d7f696e90 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action" status: 202 len: 0 microversion: 2.1 time: 0.094459 Aug 24 03:12:18.414063 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6026/7018] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:12:18 2022] POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:12:18.424201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:12:18.424951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:12:18.431490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:18.432047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:18.432591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:18.433428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:18.433922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:18.434467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:18.586782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:12:18.595200 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8b964a16-e743-46f9-b3ab-4bf182640896 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1760 microversion: 2.1 time: 0.175837 Aug 24 03:12:18.595996 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6027/7019] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:12:18 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:12:19.617725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:12:19.618410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:12:19.628882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:19.629387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:19.629843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:19.630549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:19.631018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:19.631457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:19.635507 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48260. Aug 24 03:12:19.641466 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 48258. Aug 24 03:12:19.782647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:12:19.791632 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ebb62fb-459d-41ae-9493-e95f85858f9a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1765 microversion: 2.1 time: 0.177823 Aug 24 03:12:19.792207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6028/7020] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:12:19 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1765 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:12:20.813876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:12:20.814521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:12:20.822484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:20.822985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:20.823447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:20.824175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:12:20.824681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:12:20.825161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:12:20.968570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:12:20.977020 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5a95149c-61a2-4e3b-aff7-f38c397aac27 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1758 microversion: 2.1 time: 0.167071 Aug 24 03:12:20.977603 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6029/7021] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:12:20 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:12:23.160020 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:12:23.160703 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:12:23.243213 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:12:23.243362 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:14:00.590254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:00.591032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:00.596521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-478316992"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:00.597094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:00.604930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:00.605429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:00.605885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:00.606616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:00.607084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:00.607530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:00.734359 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Removing security group 21ec3770-e8a3-4f13-8a9d-fd8133f001ef from port b5744999-4e51-41a9-98bd-bbbab7a5675a Aug 24 03:14:01.030936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90dd3ac8-0675-4a49-8097-96ae1a3d613c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action" status: 202 len: 0 microversion: 2.1 time: 0.442562 Aug 24 03:14:01.031587 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6030/7022] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:14:00 2022] POST /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:14:01.041170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:01.052210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:01.052524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:01.053731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:01.069339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] Creating event network-changed:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:14:01.075817 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d0f9e198-1f44-49c3-94c3-5f3bfe7bdeb4 req-d731af2a-6e3e-4946-8c8c-b3421757469d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038229 Aug 24 03:14:01.076845 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6031/7023] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:14:02.187402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:02.188078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:02.198590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:02.199105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:02.199568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:02.200298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:02.200815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:02.201268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:02.294179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lazy-loading 'services' on Instance uuid 785e4ea7-519b-4684-9d30-5570eaf493c4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:14:02.380705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-12dfa141-e2ec-40c0-9b4e-2317a1ee74e9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments/dd853ab9-97c1-4a11-a056-e16d2cca9749" status: 202 len: 0 microversion: 2.1 time: 0.199760 Aug 24 03:14:02.384471 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6032/7024] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:14:02 2022] DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments/dd853ab9-97c1-4a11-a056-e16d2cca9749 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:14:02.390446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:02.393527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:02.400389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:02.400956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:02.401407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:02.402144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:02.402728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:02.403386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:02.435619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d7f5936-33fe-4921-b6e7-3768817301fc tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049622 Aug 24 03:14:02.436207 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6033/7025] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:02 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:03.093736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:03.103706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:03.104197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:03.104644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:03.115858 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] Creating event network-changed:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:14:03.120780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-29970592-9216-484b-b8d8-ef91a3fb13a4 req-8d64e282-4d54-4eb2-89af-2a87fb223cb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 Aug 24 03:14:03.121372 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6034/7026] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:14:03.451012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:03.453628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:03.460340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:03.460952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:03.461487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:03.462272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:03.462818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:03.463289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:03.497336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-26441fad-cce2-4959-8be9-77f4ecb0c37d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051589 Aug 24 03:14:03.497336 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6035/7027] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:03 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:04.510916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:04.513070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:04.520963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:04.521466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:04.521915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:04.522647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:04.523108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:04.523529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:04.555055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b14fad4-da5b-41bf-8c2f-724a3477abd6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048242 Aug 24 03:14:04.555644 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6036/7028] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:04 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:05.567542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:05.569783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:05.576688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:05.577228 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:05.577683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:05.578395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:05.578863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:05.579306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:05.608619 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d2e5807-5061-4f39-9f42-8be343cb9b91 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 03:14:05.609139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6037/7029] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:05 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:06.690644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:06.692864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:06.699043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:06.699550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:06.700008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:06.700746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:06.701223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:06.701672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:06.733449 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e46fddc9-8fc9-4b30-8c26-3948af1bff39 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115735 Aug 24 03:14:06.734035 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6038/7030] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:06 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:07.746000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:07.748191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:07.755509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:07.756017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:07.756477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:07.757221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:07.757695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:07.758142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:07.787053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93eb6528-73b1-4d51-b8e1-630d13092198 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045061 Aug 24 03:14:07.787620 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6039/7031] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:14:07 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:14:07.797433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:07.797941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:07.804237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:07.804771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:07.805232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:07.805939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:07.806412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:07.806856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:07.879851 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] HTTP exception thrown: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 is not attached to volume dd853ab9-97c1-4a11-a056-e16d2cca9749 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Request method failure captured: Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments/dd853ab9-97c1-4a11-a056-e16d2cca9749 HTTP/1.1 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZZNtAI3CjuZY30Mw6Ot2ZmCUZYYZ_qUH_Pjk7fHP9TESipdAZwz3sxVd6K884TyXv2wyMDIl2Sg3BpvOC0Vru0E9CDzo91F9gxyEqONcjFH3WKUc4G4gKLBFX6m0zJJW5p_FN5UNExaS2WThcgRNYdLV86ziUCWO9xUOG3dk2wtOgg Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0453382431364216a62bb99145b771b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0453382431364216a62bb99145b771b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: acfff7a88a5b478ba032d534ddbf183f Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 is not attached to volume dd853ab9-97c1-4a11-a056-e16d2cca9749 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': '785e4ea7-519b-4684-9d30-5570eaf493c4', 'id': 'dd853ab9-97c1-4a11-a056-e16d2cca9749'} Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dd853ab9-97c1-4a11-a056-e16d2cca9749. Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 is not attached to volume dd853ab9-97c1-4a11-a056-e16d2cca9749 Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:14:07.881802 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 is not attached to volume dd853ab9-97c1-4a11-a056-e16d2cca9749 Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Returning 404 to user: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 is not attached to volume dd853ab9-97c1-4a11-a056-e16d2cca9749 {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67a72f88-dc07-4242-833a-2941cddc82b8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments/dd853ab9-97c1-4a11-a056-e16d2cca9749" status: 404 len: 154 microversion: 2.1 time: 0.089449 Aug 24 03:14:07.886517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6040/7032] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:14:07 2022] DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4/os-volume_attachments/dd853ab9-97c1-4a11-a056-e16d2cca9749 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:14:11.133772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:11.134359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:11.142791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:11.143298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:11.143757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:11.144472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:11.144981 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:11.145432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:11.169891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:14:11.258961 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4352eaaa-e824-4f76-905e-cb52910214c0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 204 len: 0 microversion: 2.1 time: 0.128438 Aug 24 03:14:11.259597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6041/7033] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:14:11 2022] DELETE /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:14:11.270876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:11.271678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:11.277798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:11.278299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:11.278783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:11.279494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:11.279989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:11.280458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:11.424550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:11.432737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bf5da9cd-4aa4-490e-be32-a7a93cca725f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1553 microversion: 2.1 time: 0.167863 Aug 24 03:14:11.433351 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6042/7034] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:11 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:12.456643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:12.457336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:12.464253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:12.464690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:12.465173 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:12.465875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:12.466340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:12.466778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:12.601832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:12.609758 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15ed47cb-67ed-4e73-9841-2bc159488fd1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1553 microversion: 2.1 time: 0.157350 Aug 24 03:14:12.610528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6043/7035] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:12 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:13.631401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:13.632279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:13.656433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:13.656982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:13.658018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:13.658753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:13.659230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:13.659714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:13.729702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:13.738059 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-641d7d6c-8194-4526-9d32-6de9899b424f tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 200 len: 1511 microversion: 2.1 time: 0.110657 Aug 24 03:14:13.738622 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6044/7036] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:13 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 1511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:14:13.805500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785e4ea7-519b-4684-9d30-5570eaf493c4", "name": "network-vif-deleted", "tag": "b5744999-4e51-41a9-98bd-bbbab7a5675a"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:13.817893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:13.818473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:13.818926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:13.830010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] Creating event network-vif-deleted:b5744999-4e51-41a9-98bd-bbbab7a5675a for instance 785e4ea7-519b-4684-9d30-5570eaf493c4 on n-h2-854121-3 Aug 24 03:14:13.834651 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-481d3c96-aa1e-4869-a8f2-1e82fe5b06a6 req-6d9ef8bc-c8fa-4cb0-8eb8-9c7e04860717 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091863 Aug 24 03:14:13.835439 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6045/7037] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:14:14.760739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:14.761467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: 785e4ea7-519b-4684-9d30-5570eaf493c4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:14.768265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:14.768789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:14.769247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:14.769953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:14.770425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:14.770868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:14.784616 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] HTTP exception thrown: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Request method failure captured: Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 HTTP/1.1 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZZNtAI3CjuZY30Mw6Ot2ZmCUZYYZ_qUH_Pjk7fHP9TESipdAZwz3sxVd6K884TyXv2wyMDIl2Sg3BpvOC0Vru0E9CDzo91F9gxyEqONcjFH3WKUc4G4gKLBFX6m0zJJW5p_FN5UNExaS2WThcgRNYdLV86ziUCWO9xUOG3dk2wtOgg Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0453382431364216a62bb99145b771b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0453382431364216a62bb99145b771b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: acfff7a88a5b478ba032d534ddbf183f Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '785e4ea7-519b-4684-9d30-5570eaf493c4'} Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:14:14.786260 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Returning 404 to user: Instance 785e4ea7-519b-4684-9d30-5570eaf493c4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8cf42b81-e207-4988-a956-c1c68685b030 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4" status: 404 len: 111 microversion: 2.1 time: 0.032077 Aug 24 03:14:14.790346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6046/7038] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:14 2022] GET /compute/v2.1/servers/785e4ea7-519b-4684-9d30-5570eaf493c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:14:14.796036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0072a14a-2cec-4a56-b327-d3a6ca0c7120 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '.version_select at 0x7f6b913dd3a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:14.819282 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0072a14a-2cec-4a56-b327-d3a6ca0c7120 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-472408647" status: 202 len: 0 microversion: 2.1 time: 0.026809 Aug 24 03:14:14.819872 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6047/7039] 10.222.0.49 () {58 vars in 1269 bytes} [Wed Aug 24 03:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-472408647 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:14:23.910798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78ce5c94-5b17-45a1-95da-c4d28d8393c4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: .version_select at 0x7f6b91756b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1531612990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2/rDOWUbz6I+Ok9nFgbsf0xUPv4we5n7Ec78UH844s9Trafij/PkBJbAHb3IoKMO++m7p/p6/DNbQ8O7eORDRgDCvGezXI5CUYlYssma4OIOktmtpMWARr35TFCXnqiA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:23.928541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-78ce5c94-5b17-45a1-95da-c4d28d8393c4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for project 0453382431364216a62bb99145b771b3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:14:23.933751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-78ce5c94-5b17-45a1-95da-c4d28d8393c4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for user acfff7a88a5b478ba032d534ddbf183f and project 0453382431364216a62bb99145b771b3. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:14:23.957904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78ce5c94-5b17-45a1-95da-c4d28d8393c4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051255 Aug 24 03:14:23.958502 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6048/7040] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:14:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:24.007331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-296389921", "imageRef": "5c979169-2e37-470e-b091-2de705a5d48b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1531612990", "networks": [{"uuid": "35129145-08db-4f7b-8d27-756780989b31"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:24.150650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] validate_networks() for [('35129145-08db-4f7b-8d27-756780989b31', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:14:24.571438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:14:24.571873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:14:24.572361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:14:24.572818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:14:24.573248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:14:24.582735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:24.583258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:24.583705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:24.584436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:24.584931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:24.585367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:24.592862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:24.606246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for project 0453382431364216a62bb99145b771b3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:14:24.611537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Getting quotas for user acfff7a88a5b478ba032d534ddbf183f and project 0453382431364216a62bb99145b771b3. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:14:24.624286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:14:24.626844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c979169-2e37-470e-b091-2de705a5d48b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:14:24.673050 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-20d7c8b0-f0bc-441f-9dc9-d66b65bf1345 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669451 Aug 24 03:14:24.673696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6049/7041] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:14:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:14:24.684040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-381f6f38-21b1-4a83-bd83-00165dca7d67 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:24.684665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-381f6f38-21b1-4a83-bd83-00165dca7d67 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:24.738507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-381f6f38-21b1-4a83-bd83-00165dca7d67 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:24.745913 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-381f6f38-21b1-4a83-bd83-00165dca7d67 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1258 microversion: 2.1 time: 0.065455 Aug 24 03:14:24.746693 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6050/7042] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:24 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:25.769064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:25.769791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:25.778116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:25.778688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:25.779363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:25.780157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:25.780625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:25.781090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:25.848727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:25.856942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6b70d8d0-6884-435e-8243-3332212b9af4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1318 microversion: 2.1 time: 0.093282 Aug 24 03:14:25.857740 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6051/7043] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:25 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:26.880474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:26.881207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:26.888362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:26.889060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:26.889513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:26.890234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:26.890711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:26.891149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:27.028886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:27.037525 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ac126eb1-3708-470a-b378-a29596d4ffb6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.162586 Aug 24 03:14:27.038394 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6052/7044] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:26 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:28.058324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:28.058976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:28.065898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:28.066392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:28.066841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:28.067541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:28.068009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:28.068450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:28.208379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:28.218135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e6c9d7c-4111-4900-aa4e-6cb71695080b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.163635 Aug 24 03:14:28.218735 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6053/7045] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:28 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:29.240170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:29.243945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:29.250808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:29.251835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:29.252296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:29.253045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:29.253519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:29.253963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:29.404646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:29.413983 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aa2c8b50-44d2-434a-a6a9-905861bfa17a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.177583 Aug 24 03:14:29.414574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6054/7046] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:29 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:14:30.441853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:30.443023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:30.454967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:30.455944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:30.456684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:30.457756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:30.458924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:30.459609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:30.637570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:30.645891 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06fd3343-131c-440a-89db-7594b2dad680 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.209321 Aug 24 03:14:30.646459 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6055/7047] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:30 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:14:31.666731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:31.667434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:31.670420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:31.682511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:31.817724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:31.826101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-03609ff3-b352-4da1-b19f-215e5017c2d9 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.163310 Aug 24 03:14:31.829686 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6056/7048] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:31 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:32.848533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:32.849479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:32.856777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:32.857295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:32.857750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:32.858551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:32.859024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:32.859468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:33.000130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:33.008778 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98a8ed75-f622-4bf2-95d4-83a4a840d25d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.164720 Aug 24 03:14:33.009363 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6057/7049] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:32 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:34.030582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:34.031246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:34.038783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:34.039365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:34.039825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:34.040634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:34.041273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:34.041702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:34.179793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:34.187690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-af594abd-8bbf-40a1-86f1-f7e089bbfeeb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.160926 Aug 24 03:14:34.188387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6058/7050] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:34 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:35.209013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:35.209667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:35.211549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:35.212267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:35.219056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:35.219558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:35.220010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:35.220796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:35.221216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:35.221658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:35.357220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:35.365641 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afe25e1c-f607-43ea-989b-b7d8858e402d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.160537 Aug 24 03:14:35.366272 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6059/7051] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:35 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:36.386674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:36.387319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:36.394908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:36.395413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:36.395870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:36.396579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:36.397082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:36.397528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:36.523514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:36.531213 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b7022571-5935-4a93-aadd-7975904ae52c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.148493 Aug 24 03:14:36.531813 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6060/7052] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:36 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:37.551231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:37.551881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:37.558942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:37.559445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:37.559902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:37.560615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:37.561118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:37.561564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:37.692147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:37.699920 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-620b94d7-aaa6-4e87-bce7-c667fd6c2de2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.152626 Aug 24 03:14:37.700497 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6061/7053] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:37 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:38.487887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:38.497397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:38.497886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:38.498338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:38.509681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] Creating event network-changed:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:14:38.515013 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d4c5e0eb-2022-4426-ab18-c064b719ea79 req-d371adad-36a2-47d8-a701-c4dc0db9b334 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Aug 24 03:14:38.515687 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6062/7054] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:38.723378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:38.724099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:38.730785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:38.731213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:38.731669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:38.732401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:38.732909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:38.733358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:38.870493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:38.878553 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6675757-3518-4c1b-9378-05d0ed3c6465 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.160967 Aug 24 03:14:38.879137 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6063/7055] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:38 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:39.899733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:39.900391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:39.907846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:39.908350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:39.908827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:39.909539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:39.910012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:39.910486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:40.039968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:40.048395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b7c4e01-992c-4394-94c3-d8cbb03729e6 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.152117 Aug 24 03:14:40.048972 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6064/7056] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:39 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:41.069910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:41.070616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:41.077501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:41.078000 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:41.078451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:41.079150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:41.079618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:41.080055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:41.212997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:41.220621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7dc7b37-9427-4cd0-9d25-aa49ff6dd385 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.154690 Aug 24 03:14:41.221216 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6065/7057] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:41 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:42.241325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:42.241959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:42.248932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:42.249435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:42.250157 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:42.251362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:42.251831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:42.252276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:42.378249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:42.386104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0722f934-a382-41ea-ae25-c544eca8c024 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.148794 Aug 24 03:14:42.386692 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6066/7058] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:42 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:43.407498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:43.408125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:43.415030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:43.415531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:43.415986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:43.416691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:43.417264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:43.417709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:43.549889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:43.557642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-795b3f5f-8d25-4275-9d99-54b4128bb21a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.154130 Aug 24 03:14:43.558211 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6067/7059] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:43 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:44.546032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "name": "network-vif-plugged", "status": "completed", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:44.556569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:44.557225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:44.557773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:44.561523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:44.569395 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] Creating event network-vif-plugged:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:14:44.574437 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5ec32617-5e6b-4d72-877b-e34eae96721f req-7724656d-31d9-4869-bdb1-26a0fcd39596 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088157 Aug 24 03:14:44.575047 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6068/7060] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:44.580199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:44.580941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:44.586965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:44.587457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:44.587905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:44.588609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:44.589101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:44.589534 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:44.720551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:44.728659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39c7d6e8-afe5-4974-a1fe-2f5f34366257 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.152424 Aug 24 03:14:44.729260 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6069/7061] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:44 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:14:45.748646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:45.749341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:45.757252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:45.757744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:45.758193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:45.758895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:45.759360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:45.759799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:45.885063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:45.892678 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-afcafe94-2a58-4743-aec2-4f9ead9ae6dd tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1358 microversion: 2.1 time: 0.148027 Aug 24 03:14:45.893260 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6070/7062] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:45 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:46.913768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:46.914449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:46.921372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:46.921867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:46.922831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:46.923564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:46.924029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:46.924467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.055183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:47.064870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7647d995-44b7-4db6-841f-26dbe1fdc1c7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1546 microversion: 2.1 time: 0.154753 Aug 24 03:14:47.065516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6071/7063] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:46 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:14:47.084078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:47.084701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:47.090476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.091084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.091962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.092872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.093344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.093846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.220649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:47.228511 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f8bf7523-90ac-4d08-b38e-96fb36fba269 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1546 microversion: 2.1 time: 0.147929 Aug 24 03:14:47.229120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6072/7064] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:47 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:47.248518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:47.253877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:47.254658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Searching by: {'deleted': False, 'project_id': '0453382431364216a62bb99145b771b3'} {{(pid=128567) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 03:14:47.259996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.260479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.260972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.261717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.262186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.262624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.288867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.multi_cell_list [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128567) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 03:14:47.315442 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e9d57778-47d9-442a-9139-dea1a49d30d0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070616 Aug 24 03:14:47.316021 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6073/7065] 10.222.0.49 () {58 vars in 1125 bytes} [Wed Aug 24 03:14:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:47.327009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:14:47.327637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:47.333489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.333993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.334455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.335165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:47.335643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:47.336090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:47.466105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:14:47.474447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0815bf1d-ffa5-4342-aa1d-2a89c479df56 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1546 microversion: 2.1 time: 0.151153 Aug 24 03:14:47.475026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6074/7066] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:47 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:14:48.968882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1548a35-c698-4440-9093-d30503abdd5f"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:14:48.971728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:14:48.978672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:48.979201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:48.979656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:48.980361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:14:48.980861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:14:48.981305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:14:49.246647 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c4ddc09d-f658-4de5-9554-82f4c078a4e7 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281586 Aug 24 03:14:49.252597 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6075/7067] 10.222.0.49 () {60 vars in 1323 bytes} [Wed Aug 24 03:14:48 2022] POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:14:59.993257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:59.994045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=39 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:59.994704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:14:59.999025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:00.000138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:00.008852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:00.009348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:00.009798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:00.010496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:00.010962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:00.011397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:00.139060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:00.148190 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8a349029-e7a3-4787-a706-a7207e329700 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1592 microversion: 2.1 time: 0.156979 Aug 24 03:15:00.148846 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6076/7068] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:14:59 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:02.085751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:15:02.097348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:02.097848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:02.098294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:02.111623 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] Creating event network-changed:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:15:02.117612 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c1fa726a-da53-430e-b4af-3b44fdc486a7 req-793e76aa-c7df-45b9-89be-c02c4758847e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102713 Aug 24 03:15:02.121612 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6077/7069] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:15:03.043905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1392769830"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:15:03.044570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:03.051917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:03.052450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:03.052906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:03.053641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:03.054255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:03.054717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:03.192925 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Adding security group 31d4efbf-7b23-4330-a21a-de8dddf695ec to port 2d1d2a3b-c468-4e53-8fa1-44a1328c3936 Aug 24 03:15:03.503138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5dc91b53-60d3-4c07-b1b6-649bf16963a4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action" status: 202 len: 0 microversion: 2.1 time: 0.465024 Aug 24 03:15:03.503851 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6078/7070] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:15:03 2022] POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:15:03.512383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:03.513126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:03.519812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:03.521444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:03.522282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:03.523021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:03.523500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:03.523951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:03.675536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:03.684054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f4bd449-0fb4-4f73-96f6-b3e73c6b9061 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1757 microversion: 2.1 time: 0.175406 Aug 24 03:15:03.684623 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6079/7071] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:03 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:04.134011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:15:04.144632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:04.145159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:04.145604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:04.156702 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] Creating event network-changed:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:15:04.161574 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9ae4b4d7-9379-45ea-b9c0-480bebc485f0 req-41039526-7ca6-4eb5-a3da-875627d44f05 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031651 Aug 24 03:15:04.162261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6080/7072] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:15:51.918521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=10 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:15:51.919280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=20 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:15:51.923598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:15:51.926475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:51.933474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:51.933980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:51.934433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:51.935139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:51.935610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:51.936053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:52.008904 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46e6317f-0d82-4075-a8d4-93a07c81e68d tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action" status: 202 len: 0 microversion: 2.1 time: 0.092326 Aug 24 03:15:52.009558 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6081/7073] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:15:51 2022] POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:15:52.018047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:52.018770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:52.025002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:52.025558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:52.026019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:52.026725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:52.027244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:52.027696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:52.181031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:52.189336 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a0af9f70-7143-4757-9f0c-2a528b8711c3 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1749 microversion: 2.1 time: 0.175342 Aug 24 03:15:52.196854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6082/7074] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:52 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:53.210031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:53.210708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:53.217502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:53.218004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:53.218461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:53.219169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:53.219640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:53.220082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:53.362217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:53.370451 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df362212-9710-415c-b24b-1c1f7e536ad0 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.164362 Aug 24 03:15:53.371018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6083/7075] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:53 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:54.393268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:54.393900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:54.400698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:54.401223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:54.401687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:54.402456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:54.402866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:54.403310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:54.542146 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:54.550431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-36246ab2-383e-40b5-815c-91fb2f61e948 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.161735 Aug 24 03:15:54.551222 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6084/7076] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:54 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:55.570655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:55.571325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:55.578335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:55.578841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:55.579298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:55.580550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:55.581052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:55.581498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:55.725773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:55.734029 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2c145a4d-0b8f-4962-82a5-2f67dda4ddea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.167342 Aug 24 03:15:55.734606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6085/7077] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:55 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:56.756802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:56.757471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:56.764254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:56.764785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:56.765245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:56.765959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:56.766435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:56.766882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:56.914928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:56.923066 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e7845643-2b8a-4672-aede-cc7990aceff2 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.170420 Aug 24 03:15:56.923635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6086/7078] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:56 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:15:57.944649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:57.945328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:57.952096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:57.952599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:57.953082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:57.953816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:57.954281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:57.954717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:58.101323 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:58.109503 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d27aea3e-b25e-451d-8104-168c67c15fea tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.169255 Aug 24 03:15:58.110071 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6087/7079] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:57 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:15:59.131208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:15:59.131847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:15:59.138669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:59.139174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:59.139629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:59.140335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:15:59.140838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:15:59.141283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:15:59.281270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:15:59.289579 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a6348eed-b0c1-49b6-943e-d21fecb699ca tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.162858 Aug 24 03:15:59.290152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6088/7080] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:15:59 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:16:00.311129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:16:00.311756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:16:00.319155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:00.319656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:00.320110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:00.320847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:00.321320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:00.321762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:00.462477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:16:00.470832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9bac947-7eee-45ff-8819-f77e88f1c73c tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.163661 Aug 24 03:16:00.471406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6089/7081] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:16:00 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:16:01.492538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:16:01.493199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:16:01.499964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:01.500736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:01.501200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:01.502550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:01.503020 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:01.503465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:01.645075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:16:01.654000 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dbfc23d3-68e5-403b-8475-8e524ee2884a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.164819 Aug 24 03:16:01.655251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6090/7082] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:16:01 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:16:02.676448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:16:02.677229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:16:02.684172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:02.684677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:02.685204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:02.685928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:02.686397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:02.686841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:02.830313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:16:02.838771 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-15279350-8863-4170-a91b-9cf5a2b9ff04 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1754 microversion: 2.1 time: 0.166900 Aug 24 03:16:02.839344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6091/7083] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:16:02 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:16:03.859448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:16:03.860095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:16:03.867556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:03.868053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:03.868507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:03.869246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:16:03.869718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:16:03.870163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:16:04.015132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:16:04.023331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-be1ff333-3bba-4931-af80-8a3db5c82649 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1757 microversion: 2.1 time: 0.167874 Aug 24 03:16:04.023904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6092/7084] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:16:03 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:07.338195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:07.338968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:07.343591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1392769830"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:07.344144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:07.352172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:07.352679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:07.353160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:07.353874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:07.354341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:07.354781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:07.481120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.network.security_group_api [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Removing security group 31d4efbf-7b23-4330-a21a-de8dddf695ec from port 2d1d2a3b-c468-4e53-8fa1-44a1328c3936 Aug 24 03:17:07.779391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ab224ad-bfcb-4682-a9d1-0795318d2839 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action" status: 202 len: 0 microversion: 2.1 time: 0.443172 Aug 24 03:17:07.780022 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6093/7085] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:17:07 2022] POST /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:17:07.787215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:07.798803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:07.799295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:07.799747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:07.819177 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] Creating event network-changed:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:17:07.826364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-384a10b4-80c8-4e56-b2cc-0a5aaf28fea7 req-8ff44ab0-c371-429b-9c77-2eafd8b1591e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Aug 24 03:17:07.827312 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6094/7086] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:08.891184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:08.891817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:08.898557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:08.899068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:08.899519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:08.900225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:08.900690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:08.901154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:08.989585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lazy-loading 'services' on Instance uuid edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:17:09.062839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b223d011-c937-4068-8d24-f2b1c0679f3a tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments/b1548a35-c698-4440-9093-d30503abdd5f" status: 202 len: 0 microversion: 2.1 time: 0.177295 Aug 24 03:17:09.063621 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6095/7087] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:17:08 2022] DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments/b1548a35-c698-4440-9093-d30503abdd5f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:17:09.072985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:09.075424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:09.082891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:09.083687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:09.084313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:09.085109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:09.085581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:09.086051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:09.119044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d4a29cdc-79bf-4c1a-a996-6fd01236923b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050439 Aug 24 03:17:09.119628 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6096/7088] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:09 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:09.841141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:09.852346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:09.852959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:09.853487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:09.865874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] Creating event network-changed:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:17:09.871019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-cd9254df-9c0e-4056-97aa-dcd5221c25de req-55b1b4dc-fc93-4606-985d-9151694ae2f9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033702 Aug 24 03:17:09.872118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6097/7089] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:17:10.133672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:10.136147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:10.142820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:10.143351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:10.143797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:10.144681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:10.145194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:10.145926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:10.177951 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c7ee301-6905-41a7-b5a7-af48c98d7488 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049750 Aug 24 03:17:10.178768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6098/7090] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:10 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:11.190047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:11.192901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:11.200176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:11.200682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:11.201196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:11.201922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:11.202393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:11.202838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:11.233935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d055dba8-3ad7-4a1a-a3e9-3630e028279e tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Aug 24 03:17:11.235267 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6099/7091] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:11 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:12.246320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:12.248858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:12.256776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:12.257321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:12.257866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:12.258645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:12.259184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:12.259627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:12.290931 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f1434e68-27e5-4aeb-8284-c1733bc9f5c5 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048618 Aug 24 03:17:12.291499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6100/7092] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:12 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:13.303006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:13.305236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:13.312493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:13.313319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:13.313842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:13.314642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:13.315115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:13.315791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:13.349135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f44df687-521d-41f2-b55a-6c137c81add1 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050059 Aug 24 03:17:13.350069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6101/7093] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:13 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:14.361617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:14.363774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:14.370626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:14.371126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:14.371579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:14.372280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:14.372765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:14.373208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:14.402127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-57c2db74-8150-43c7-87e7-a43e39c7afe8 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044456 Aug 24 03:17:14.402685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6102/7094] 10.222.0.49 () {58 vars in 1302 bytes} [Wed Aug 24 03:17:14 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 03:17:14.413069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:14.413570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:14.419671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:14.420169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:14.420617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:14.421369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:14.421834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:14.422272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:14.496633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] HTTP exception thrown: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 is not attached to volume b1548a35-c698-4440-9093-d30503abdd5f Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Request method failure captured: Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: request: DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments/b1548a35-c698-4440-9093-d30503abdd5f HTTP/1.1 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZZNtAI3CjuZY30Mw6Ot2ZmCUZYYZ_qUH_Pjk7fHP9TESipdAZwz3sxVd6K884TyXv2wyMDIl2Sg3BpvOC0Vru0E9CDzo91F9gxyEqONcjFH3WKUc4G4gKLBFX6m0zJJW5p_FN5UNExaS2WThcgRNYdLV86ziUCWO9xUOG3dk2wtOgg Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0453382431364216a62bb99145b771b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0453382431364216a62bb99145b771b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: acfff7a88a5b478ba032d534ddbf183f Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 is not attached to volume b1548a35-c698-4440-9093-d30503abdd5f Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'server_id': 'edb35fba-92bc-45f4-b6a5-fc6f28ea6e52', 'id': 'b1548a35-c698-4440-9093-d30503abdd5f'} Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b1548a35-c698-4440-9093-d30503abdd5f. Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 is not attached to volume b1548a35-c698-4440-9093-d30503abdd5f Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:17:14.498284 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 is not attached to volume b1548a35-c698-4440-9093-d30503abdd5f Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Returning 404 to user: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 is not attached to volume b1548a35-c698-4440-9093-d30503abdd5f {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-898b056f-4146-4d3a-97a6-63d317bfa35b tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments/b1548a35-c698-4440-9093-d30503abdd5f" status: 404 len: 154 microversion: 2.1 time: 0.090900 Aug 24 03:17:14.502967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6103/7095] 10.222.0.49 () {58 vars in 1416 bytes} [Wed Aug 24 03:17:14 2022] DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52/os-volume_attachments/b1548a35-c698-4440-9093-d30503abdd5f => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:17:17.744221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:17.744834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:17.752240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:17.752771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:17.753230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:17.754457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:17.754935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:17.755413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:17.781562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:17:17.869134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d3eb5d57-c181-4086-9724-63536c8e1e98 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 204 len: 0 microversion: 2.1 time: 0.128488 Aug 24 03:17:17.870058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6104/7096] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:17:17 2022] DELETE /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:17:17.878687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:17.879998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:17.886659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:17.887135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:17.887642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:17.888310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:17.888805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:17.889251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:18.029944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:18.037979 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c9829d6e-93be-43fd-b353-8901638d24b4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1552 microversion: 2.1 time: 0.163640 Aug 24 03:17:18.038549 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6105/7097] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:17 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:19.060209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:19.060918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:19.067811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:19.068309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:19.068779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:19.069486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:19.069950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:19.070384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:19.201664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:19.209465 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3160c553-61b5-4719-95db-93fa8b447430 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1552 microversion: 2.1 time: 0.153162 Aug 24 03:17:19.210039 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6106/7098] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:19 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:20.231363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:20.232037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:20.241459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:20.242325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:20.242449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:20.243149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:20.243627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:20.244077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:20.401260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfff7a88a5b478ba032d534ddbf183f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0453382431364216a62bb99145b771b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:20.411278 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3da1224-2cf2-45c3-abc2-91aff5deefa4 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 200 len: 1552 microversion: 2.1 time: 0.184120 Aug 24 03:17:20.412096 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6107/7099] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:20 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:20.416411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb35fba-92bc-45f4-b6a5-fc6f28ea6e52", "name": "network-vif-deleted", "tag": "2d1d2a3b-c468-4e53-8fa1-44a1328c3936"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:20.431587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:20.432404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:20.432991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:20.447755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] Creating event network-vif-deleted:2d1d2a3b-c468-4e53-8fa1-44a1328c3936 for instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 on n-h1-854121-3 Aug 24 03:17:20.453008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-6dbd2fd2-2cbe-461d-8b41-6bb17d5e5121 req-1cb39ca9-2d01-433b-b35e-36d5f9f87354 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039904 Aug 24 03:17:20.454611 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6108/7100] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:17:21.432627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:21.433392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] [instance: edb35fba-92bc-45f4-b6a5-fc6f28ea6e52] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:21.441469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:21.442095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:21.443063 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:21.443783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:21.444260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:21.444708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:21.460980 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] HTTP exception thrown: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Request method failure captured: Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 HTTP/1.1 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZZNtAI3CjuZY30Mw6Ot2ZmCUZYYZ_qUH_Pjk7fHP9TESipdAZwz3sxVd6K884TyXv2wyMDIl2Sg3BpvOC0Vru0E9CDzo91F9gxyEqONcjFH3WKUc4G4gKLBFX6m0zJJW5p_FN5UNExaS2WThcgRNYdLV86ziUCWO9xUOG3dk2wtOgg Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0453382431364216a62bb99145b771b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0453382431364216a62bb99145b771b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0453382431364216a62bb99145b771b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 0453382431364216a62bb99145b771b3 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestMinimumBasicScenario-343510857 Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: acfff7a88a5b478ba032d534ddbf183f Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestMinimumBasicScenario-343510857-project Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'edb35fba-92bc-45f4-b6a5-fc6f28ea6e52'} Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:17:21.462629 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Returning 404 to user: Instance edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0be50ef-249e-417d-8f5b-d12a4040d5eb tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52" status: 404 len: 111 microversion: 2.1 time: 0.036316 Aug 24 03:17:21.467262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6109/7101] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:21 2022] GET /compute/v2.1/servers/edb35fba-92bc-45f4-b6a5-fc6f28ea6e52 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:17:21.472593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86e56bc6-e23c-4e78-9d50-a4ae756b9a50 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] Calling method '.version_select at 0x7f6b913dd820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:21.491530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86e56bc6-e23c-4e78-9d50-a4ae756b9a50 tempest-TestMinimumBasicScenario-343510857 tempest-TestMinimumBasicScenario-343510857-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1531612990" status: 202 len: 0 microversion: 2.1 time: 0.022412 Aug 24 03:17:21.492018 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6110/7102] 10.222.0.49 () {58 vars in 1272 bytes} [Wed Aug 24 03:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1531612990 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:17:30.612862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75811d5e-3637-4ef8-9c6f-af4454fa9446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: .version_select at 0x7f6b92052a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1348993750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNTuWP6RpFgi/Jq19k0tp5N7jD3tB40NROWZ51LMyFzmWu9HCXWVqucWwNiENotRynnyFtQkZ9fmdpBdH6cHUOEtqM3xvGcklYiqwFXwO1om0APNiQkpXQEIKYsOUgXrA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:30.629425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-75811d5e-3637-4ef8-9c6f-af4454fa9446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:17:30.634593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-75811d5e-3637-4ef8-9c6f-af4454fa9446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:17:30.659055 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75811d5e-3637-4ef8-9c6f-af4454fa9446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.208181 Aug 24 03:17:30.659645 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6111/7103] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:17:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:36.354304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-732421022", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "89c67ec9-bb60-47ed-aa6a-d7bf1eca2293"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1348993750", "security_groups": [{"name": "tempest-secgroup-smoke-1044216285"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:36.363434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:36.503757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] validate_networks() for [('89c67ec9-bb60-47ed-aa6a-d7bf1eca2293', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:17:36.902544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:17:36.903103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:17:36.903605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:17:36.904035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:17:36.904477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:17:36.913900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:36.914404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:36.914938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:36.915637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:36.916116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:36.916565 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:36.934572 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:17:36.940021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:17:36.952779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:17:36.955052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:17:37.003677 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79d59f81-86f0-48ce-a33e-7a4a923eeb9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653951 Aug 24 03:17:37.004656 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6112/7104] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:17:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 03:17:37.015240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-616100f5-6862-4e13-9c5a-53c630c25aa7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:37.015959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-616100f5-6862-4e13-9c5a-53c630c25aa7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:37.076537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-616100f5-6862-4e13-9c5a-53c630c25aa7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:37.087125 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-616100f5-6862-4e13-9c5a-53c630c25aa7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1266 microversion: 2.1 time: 0.075642 Aug 24 03:17:37.095533 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6113/7105] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:37 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:38.107474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:38.108235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:38.110965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:38.116971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:38.117484 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:38.117970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:38.118688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:38.119161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:38.119608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:38.195088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:38.207364 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44610ad3-0cc7-4854-8a33-f3217ede1888 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1318 microversion: 2.1 time: 0.103690 Aug 24 03:17:38.208029 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6114/7106] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:38 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:39.229525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:39.230876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:39.246902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:39.251612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:39.257478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:39.258472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:39.259088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:39.259588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:39.436589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:39.446009 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67d44a4e-ed62-40f1-9f2f-896ce8e10e72 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.220827 Aug 24 03:17:39.447240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6115/7107] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:39 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:17:39.880870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c109df07-24b9-4161-a73b-6301ba94f030", "tag": "35a4435e-436a-4fce-bc92-f0013cd3f1db"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:39.892659 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:39.893514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:39.894075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:39.907118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] Creating event network-changed:35a4435e-436a-4fce-bc92-f0013cd3f1db for instance c109df07-24b9-4161-a73b-6301ba94f030 on n-h2-854121-3 Aug 24 03:17:39.913542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-82835da3-2321-49da-9d24-0c36c3e070c1 req-88e967d6-e1a8-4b5e-a65c-ca07984ef637 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Aug 24 03:17:39.913977 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6116/7108] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:17:40.468661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:40.469503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:40.475831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:40.476268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:40.476739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:40.477468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:40.477938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:40.478379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:40.608763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:40.617090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-86dd27eb-5b76-4c26-90c5-477326cf63bd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.153569 Aug 24 03:17:40.617613 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6117/7109] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:40 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:41.638813 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:41.639495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:41.647216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:41.647727 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:41.648212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:41.648975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:41.649454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:41.649903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:41.785856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:41.793733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fdc9abad-d782-45aa-be8c-ef446a1dde59 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.158902 Aug 24 03:17:41.794311 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6118/7110] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:41 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:42.815464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:42.816094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:42.823067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:42.823569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:42.824022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:42.824757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:42.825234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:42.825677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:42.960845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:42.968643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d79e7118-b1b9-451d-a932-9d3f8e7578c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.157164 Aug 24 03:17:42.969249 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6119/7111] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:42 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:43.988636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:43.989336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:43.996755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:43.997260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:43.997713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:43.998412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:43.998877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:43.999316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:44.390066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:44.398280 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-62db3762-c6aa-4660-9c2e-0a4368b54448 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.413608 Aug 24 03:17:44.398859 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6120/7112] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:43 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:45.418788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:45.419430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:45.426471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:45.426979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:45.428095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:45.428927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:45.429411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:45.429862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:45.559515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:45.567341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ebfa55d7-1dbf-4aa4-a018-e57cec261ce6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.152418 Aug 24 03:17:45.567936 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6121/7113] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:45 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:46.588802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:46.589462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:46.596301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:46.596853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:46.597347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:46.598062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:46.598539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:46.599662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:46.727042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:46.734769 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f3288e50-b5a3-4810-aceb-ab459420d597 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.149931 Aug 24 03:17:46.735344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6122/7114] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:46 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:46.941930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c109df07-24b9-4161-a73b-6301ba94f030", "name": "network-vif-plugged", "status": "completed", "tag": "35a4435e-436a-4fce-bc92-f0013cd3f1db"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:46.947424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:46.953657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:46.954155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:46.954615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:46.966621 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] Creating event network-vif-plugged:35a4435e-436a-4fce-bc92-f0013cd3f1db for instance c109df07-24b9-4161-a73b-6301ba94f030 on n-h2-854121-3 Aug 24 03:17:46.971593 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-97846a1b-62dd-43fa-9492-43342a365c43 req-e448df32-eb82-4b7d-8201-8cc9cf379adb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Aug 24 03:17:46.972186 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6123/7115] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:17:47.754083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:17:47.759355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:47.760086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:47.766617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:47.767119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:47.767574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:47.768275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:47.768770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:47.769217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:47.905764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:47.914214 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aff39b6f-569e-4394-8cf7-727e27f13404 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1392 microversion: 2.1 time: 0.161126 Aug 24 03:17:47.914802 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6124/7116] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:47 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:48.934630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:48.935250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:48.942143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:48.942635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:48.943082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:48.944267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:48.944766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:48.945206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:49.075375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:49.083044 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb497c41-fef5-4bd1-958d-6e1323570fc5 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1564 microversion: 2.1 time: 0.152465 Aug 24 03:17:49.083624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6125/7117] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:48 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:49.103220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:49.103837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:49.109694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:49.110188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:49.110634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:49.111331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:49.111801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:49.112238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:49.244644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:49.252669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc0ebb33-1daa-4edd-864d-59ebb0aca92e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1564 microversion: 2.1 time: 0.153172 Aug 24 03:17:49.253258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6126/7118] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:49 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:50.790138 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:17:50.790824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:17:50.797095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:50.797662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:50.798178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:50.798950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:50.799504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:50.799948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:50.939733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:17:50.948350 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d6ec9395-15c9-4366-b040-dfafaa50bc47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1564 microversion: 2.1 time: 0.162739 Aug 24 03:17:50.949004 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6127/7119] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:17:50 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:17:50.953617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c109df07-24b9-4161-a73b-6301ba94f030", "tag": "35a4435e-436a-4fce-bc92-f0013cd3f1db"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:17:50.962827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:17:50.963432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:17:50.963970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:17:50.976798 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] Creating event network-changed:35a4435e-436a-4fce-bc92-f0013cd3f1db for instance c109df07-24b9-4161-a73b-6301ba94f030 on n-h2-854121-3 Aug 24 03:17:50.981861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7f672455-cd5b-45be-a4b7-fa9001b437b2 req-8adcc796-1936-4e6c-abf4-9032b177c4d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031508 Aug 24 03:17:50.982462 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6128/7120] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:18:28.261188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=29 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.261940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=80 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:18:28.266606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:18:28.268892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:18:28.276267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:28.276792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:28.277248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:28.277949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:18:28.278419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:18:28.278862 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:18:28.346003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5bd8286e-476d-4b90-8cba-f20481f6fdc7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action" status: 200 len: 24566 microversion: 2.1 time: 0.086954 Aug 24 03:18:28.346855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6129/7121] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:18:28 2022] POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action => generated 24566 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:19:07.087541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:07.088320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:07.090864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.091523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:07.097942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:07.098439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:07.098886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:07.099585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:07.100059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:07.100497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:07.166180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cc1bf14e-a7ef-46cf-adb9-fcd0060306cc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action" status: 202 len: 0 microversion: 2.1 time: 0.082198 Aug 24 03:19:07.167026 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6130/7122] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:19:07 2022] POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:19:07.175657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:07.176374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:07.183377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:07.183929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:07.184418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:07.185289 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:07.185770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:07.186227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:07.320582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:07.328521 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-baf623cf-10d5-4ba0-9e5e-d7c72d1b6d91 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1687 microversion: 2.1 time: 0.157061 Aug 24 03:19:07.329118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6131/7123] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:07 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:08.350340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:08.350991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:08.358325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:08.358826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:08.359278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:08.359988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:08.360458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:08.360935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:08.496413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:08.504393 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5885d3f1-5f88-49af-aa99-455e3f21abd2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1667 microversion: 2.1 time: 0.157943 Aug 24 03:19:08.504989 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6132/7124] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:08 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:09.593791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:09.596028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:09.602979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.603488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.603946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.604664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.605166 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.605612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.672910 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4295d9f-d981-47be-a936-04d33d866da7 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action" status: 200 len: 32640 microversion: 2.1 time: 0.082841 Aug 24 03:19:09.673786 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6133/7125] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:19:09 2022] POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action => generated 32640 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:19:09.685684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:09.686321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:09.693285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.693788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.694239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.694947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.695421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.695866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.762093 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eae98f4e-5f2f-49f9-8799-eb4b02165bab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action" status: 202 len: 0 microversion: 2.1 time: 0.080686 Aug 24 03:19:09.762736 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6134/7126] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:19:09 2022] POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:19:09.771685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:09.772394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:09.778778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.779288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.779759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.780952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:09.780952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:09.781377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:09.911147 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:09.919470 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ce452f8-cb8e-446d-b9e5-72da31b1df56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1674 microversion: 2.1 time: 0.152320 Aug 24 03:19:09.920038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6135/7127] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:09 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:10.941443 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:10.942134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:10.949603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:10.950099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:10.950553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:10.951256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:10.951726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:10.952172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:11.084282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:11.092116 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-419a4bc9-9eb5-4686-99ed-6ad3e95ef128 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1682 microversion: 2.1 time: 0.154604 Aug 24 03:19:11.092685 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6136/7128] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:10 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:11.186791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:11.189009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:11.195067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:11.195507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:11.195963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:11.196699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:11.197685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:11.198128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:11.257404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6e3fc32f-84e9-48da-9206-e0b92d082273 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action" status: 200 len: 38218 microversion: 2.1 time: 0.074309 Aug 24 03:19:11.258072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6137/7129] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:19:11 2022] POST /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030/action => generated 38218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:19:12.223933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:12.224643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:12.232518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:12.233141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:12.233702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:12.234496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:12.235219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:12.235895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:12.263746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:19:12.343527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-faf5648a-6f44-49cb-a7a8-20ff86dde16e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 204 len: 0 microversion: 2.1 time: 0.123920 Aug 24 03:19:12.344062 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6138/7130] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:19:12 2022] DELETE /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:19:12.349264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c109df07-24b9-4161-a73b-6301ba94f030", "tag": "35a4435e-436a-4fce-bc92-f0013cd3f1db"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:12.359762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:12.360403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:12.360888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:12.372752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] Creating event network-changed:35a4435e-436a-4fce-bc92-f0013cd3f1db for instance c109df07-24b9-4161-a73b-6301ba94f030 on n-h2-854121-3 Aug 24 03:19:12.377900 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-45467cc4-0b16-4cd4-93b0-1de9668f5c27 req-6798dae9-0ba9-458c-8947-bf8b525f56d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032240 Aug 24 03:19:12.378667 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6139/7131] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:19:12.386848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:12.387824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:12.394278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:12.394822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:12.395288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:12.396007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:12.396480 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:12.396957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:12.543950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:12.551861 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b04bbfab-ecdc-40fe-a09e-437fc8c625b3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1688 microversion: 2.1 time: 0.169558 Aug 24 03:19:12.552440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6140/7132] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:12 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:13.573915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:13.574568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:13.581433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:13.581932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:13.582387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:13.583082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:13.583549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:13.583987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:13.714070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:13.722266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5717ed98-6af8-432a-ab2c-70226b1e7399 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1688 microversion: 2.1 time: 0.152241 Aug 24 03:19:13.722831 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6141/7133] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:13 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:14.744267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:14.744926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:14.751746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:14.752504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:14.752991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:14.753702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:14.754168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:14.754604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:14.824890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:14.832682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d0f5d17-fc78-4b17-aa86-aa4b54156778 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 200 len: 1502 microversion: 2.1 time: 0.092915 Aug 24 03:19:14.846575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6142/7134] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:14 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 1502 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:14.961871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c109df07-24b9-4161-a73b-6301ba94f030", "name": "network-vif-deleted", "tag": "35a4435e-436a-4fce-bc92-f0013cd3f1db"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:14.971312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:14.971806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:14.972251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:14.983652 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] Creating event network-vif-deleted:35a4435e-436a-4fce-bc92-f0013cd3f1db for instance c109df07-24b9-4161-a73b-6301ba94f030 on n-h2-854121-3 Aug 24 03:19:14.989054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-70ff0bbf-92f0-4eb3-b8ad-87b0aca7f349 req-93299762-9d5f-4915-8e8e-8c272a3d6c82 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089976 Aug 24 03:19:14.989657 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6143/7135] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:19:15.855038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:15.855742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: c109df07-24b9-4161-a73b-6301ba94f030] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:15.862816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:15.863313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:15.863759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:15.864456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:15.864952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:15.865427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:15.879431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] HTTP exception thrown: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Request method failure captured: Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 HTTP/1.1 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZhJdJjHAB3oCwRWfR15hONbaBvVWeFWsjkieh-0GHtl7_stzvtghjLUmUsx99s7Usefm9co92oO24XpZPCJO5RyiPj3JmPtgLuqWhHctDQv0_AZkiVd89e9rel6L6wSzP1KfTWvqSvcxUtABazXRw0ZI4cTJmpXDUaIFLkTdKURCOI Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d1aa5e8123664787ae37579283e30314 Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'c109df07-24b9-4161-a73b-6301ba94f030'} Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:19:15.881053 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Returning 404 to user: Instance c109df07-24b9-4161-a73b-6301ba94f030 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-23d47467-aa28-4fd2-8ab2-eba7f202084d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030" status: 404 len: 111 microversion: 2.1 time: 0.032217 Aug 24 03:19:15.886054 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6144/7136] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:15 2022] GET /compute/v2.1/servers/c109df07-24b9-4161-a73b-6301ba94f030 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:19:19.082460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2408419-1b97-4953-82d4-0590e8e59d6b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '.version_select at 0x7f6b9146f280>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:19.106101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2408419-1b97-4953-82d4-0590e8e59d6b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1348993750" status: 202 len: 0 microversion: 2.1 time: 0.027385 Aug 24 03:19:19.107050 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6145/7137] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 03:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1348993750 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:19:19.135233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b0d5d4dd-8ed7-4684-81d4-6c70c60e2716 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: .version_select at 0x7f6b917095e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-429575846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlMMtTH4Yaa1WVbezdHX2Jqz/uUHng19yMuaLRt5zFp+Zs/5e/h+J4x3FJTNiFKMxdExocNBIKWTkt62qUDtVnuTFR/fHb/RmWsKEHCRdzF9SdcV8guN419aHGyn0RUbg=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:19.151951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b0d5d4dd-8ed7-4684-81d4-6c70c60e2716 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:19:19.157546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-b0d5d4dd-8ed7-4684-81d4-6c70c60e2716 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:19:19.181524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b0d5d4dd-8ed7-4684-81d4-6c70c60e2716 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050336 Aug 24 03:19:19.182147 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6146/7138] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:19:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:19:24.728901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-839511066", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "5317b2ee-a573-48a1-987b-1686d06d40a8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-429575846", "security_groups": [{"name": "tempest-secgroup-smoke-349587109"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:24.993932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] validate_networks() for [('5317b2ee-a573-48a1-987b-1686d06d40a8', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:19:25.511497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:19:25.512461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:19:25.513391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:19:25.513825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:19:25.514261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:19:25.523752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:25.524259 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:25.524791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:25.525552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:25.526026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:25.526471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:25.545456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:19:25.551487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:19:25.568400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:19:25.570980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:19:25.630488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67f7c72a-dafd-4d2c-9876-7e39074d0175 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906503 Aug 24 03:19:25.631169 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6147/7139] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:19:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:19:25.642440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24624764-455e-4fde-a517-2655d4f61999 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:25.643389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24624764-455e-4fde-a517-2655d4f61999 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:25.714607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-24624764-455e-4fde-a517-2655d4f61999 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:25.722645 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24624764-455e-4fde-a517-2655d4f61999 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1265 microversion: 2.1 time: 0.084332 Aug 24 03:19:25.723804 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6148/7140] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:25 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:26.745183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:26.745990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:26.753556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:26.754066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:26.754524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:26.755253 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:26.755759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:26.756200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:26.760831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:26.827106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:26.836596 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c58e150e-73c4-4d83-9f86-5ede87909284 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1317 microversion: 2.1 time: 0.096495 Aug 24 03:19:26.837262 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6149/7141] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:26 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:19:27.858359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:27.858967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:27.865780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:27.866292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:27.866758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:27.867615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:27.868183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:27.869136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:28.008004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:28.016375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ab3b70f8-30ad-4de4-8175-1ec76061418e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.162156 Aug 24 03:19:28.016972 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6150/7142] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:27 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:28.283891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397e54dc-dd31-4117-b7b1-b4c73c5fe23c", "tag": "9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:28.295250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:28.295250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:28.295857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:28.306954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] Creating event network-changed:9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e for instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c on n-h1-854121-3 Aug 24 03:19:28.312145 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-84ff4e98-3f16-4261-92d9-e96df0ad3d8f req-454b8ed3-024e-47b0-b304-b0ea09103866 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032080 Aug 24 03:19:28.312793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6151/7143] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:19:29.038936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:29.039648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:29.046043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:29.046547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:29.046999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:29.047706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:29.048175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:29.048617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:29.181890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:29.189545 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-033d9094-0a1d-49dc-bd07-ae4dee7b98f8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.155699 Aug 24 03:19:29.190116 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6152/7144] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:29 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:30.209800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:30.210471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:30.217914 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:30.218417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:30.218873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:30.219581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:30.220056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:30.220502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:30.347497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:30.355467 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e72eaa08-3315-4e82-b03f-baeccb6f1e93 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.149628 Aug 24 03:19:30.356040 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6153/7145] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:30 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:31.376699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:31.377607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:31.384524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:31.385060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:31.385525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:31.386240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:31.386713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:31.387162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:31.526497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:31.534876 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c1d4fd5a-28a6-4a81-a6a4-4bef15790b99 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.162119 Aug 24 03:19:31.535448 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6154/7146] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:31 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:32.555361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:32.556640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:32.563496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:32.564003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:32.564468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:32.565209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:32.565708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:32.566152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:32.698004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:32.705788 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dc825cb-9ce3-42b6-bac8-9c71e2db6a78 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.154405 Aug 24 03:19:32.706357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6155/7147] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:32 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:33.726264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:33.726952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:33.733644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:33.734145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:33.734599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:33.735299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:33.735764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:33.736384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:33.872417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:33.880391 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbc238c4-d9b0-438c-80b0-f8cdd4d00de4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.158120 Aug 24 03:19:33.881437 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6156/7148] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:33 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:33.885868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397e54dc-dd31-4117-b7b1-b4c73c5fe23c", "name": "network-vif-plugged", "status": "completed", "tag": "9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:33.895386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:33.895804 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:33.896372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:33.907650 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] Creating event network-vif-plugged:9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e for instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c on n-h1-854121-3 Aug 24 03:19:33.912671 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c7be10d5-4c23-467a-a30d-a66bddd4b44f req-b8bfa875-690a-4103-a3bf-5213573860ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030122 Aug 24 03:19:33.913339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6157/7149] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:19:34.902617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:34.903432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:34.910072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:34.910574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:34.911018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:34.911713 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:34.912181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:34.912617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:35.043148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:35.050948 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0369d2fa-0b84-4dc8-81c3-c26a68d9b2ce tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1390 microversion: 2.1 time: 0.153933 Aug 24 03:19:35.051516 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6158/7150] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:34 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:36.146311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:36.146986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:36.148951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.149766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:36.156737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:36.157284 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:36.157744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:36.158460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:36.158933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:36.159383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:36.289335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:36.297514 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8fdd4b9-336e-4a75-b64c-0c094eab8a43 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1562 microversion: 2.1 time: 0.155173 Aug 24 03:19:36.298083 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6159/7151] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:36 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:36.317768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:36.318319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:36.324070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:36.324562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:36.325051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:36.325746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:36.326230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:36.326678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:36.461999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:36.469710 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8709c0f-54a5-430d-a214-2959032b54d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1562 microversion: 2.1 time: 0.155712 Aug 24 03:19:36.470281 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6160/7152] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:36 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:38.283753 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:19:38.284393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:19:38.287239 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:19:38.294053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:38.294593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:38.295069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:38.295801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:38.296276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:38.296744 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:38.442462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:19:38.451723 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b56df4e2-6cbf-4df8-a211-997541af211a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1562 microversion: 2.1 time: 0.172230 Aug 24 03:19:38.452380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6161/7153] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:19:38 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:19:38.460222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397e54dc-dd31-4117-b7b1-b4c73c5fe23c", "tag": "9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:19:38.475307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:19:38.475810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:19:38.476755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:19:38.490378 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] Creating event network-changed:9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e for instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c on n-h1-854121-3 Aug 24 03:19:38.495299 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d3e4624e-2574-453f-863c-b4c5e433092b req-39e6d108-d574-4e0d-9c18-faa491c02f95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041716 Aug 24 03:19:38.496167 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6162/7154] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:20:12.801792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.802550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=70 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:12.807554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:12.810840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:12.818105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:12.818613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:12.819067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:12.819776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:12.820251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:12.820696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:12.892318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-49c6d6da-7587-4be1-bace-81d65781b191 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action" status: 200 len: 24577 microversion: 2.1 time: 0.092425 Aug 24 03:20:12.893433 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6163/7155] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:20:12 2022] POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action => generated 24577 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:20:43.292329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:20:43.294673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:43.297237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:43.297913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:20:43.304079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:43.305108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:43.305561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:43.306268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:43.306736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:43.307185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:43.379266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d83110df-3ce3-429a-b813-ec3351a324db tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action" status: 202 len: 0 microversion: 2.1 time: 0.091219 Aug 24 03:20:43.379908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6164/7156] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:20:43 2022] POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:20:43.389315 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:43.390030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:43.396067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:43.396569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:43.397057 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:43.397773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:43.398246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:43.398687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:43.540752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:43.548877 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef068ade-2ba7-40df-984d-2408a438e41f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1673 microversion: 2.1 time: 0.163356 Aug 24 03:20:43.549440 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6165/7157] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:43 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:44.571664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:44.572296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:44.579256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:44.579751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:44.580203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:44.580937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:44.581410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:44.581851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:44.714693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:44.722388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bff7b9b3-5974-47a4-8f5f-3c7825437f30 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.155166 Aug 24 03:20:44.722960 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6166/7158] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:44 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:45.743827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:45.744495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:45.751288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:45.751792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:45.752245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:45.753246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:45.753717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:45.754188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:45.881193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:45.889411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-365c49a5-b744-4884-8a15-f03b4db5b4b4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.149600 Aug 24 03:20:45.889987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6167/7159] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:45 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:46.911393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:46.912050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:46.918959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:46.919465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:46.919920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:46.920623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:46.921123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:46.921566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:47.055489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:47.063204 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0c78b901-bac9-4e1d-95bb-6cf7c0565283 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.155802 Aug 24 03:20:47.063774 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6168/7160] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:46 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:48.084845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:48.085533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:48.093132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:48.093634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:48.094091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:48.094796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:48.095264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:48.095702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:48.222349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:48.230056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0cb16ed7-8ac7-4a11-9e2c-cdaaf64f5a18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.149204 Aug 24 03:20:48.230630 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6169/7161] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:48 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:49.251309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:49.251996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:49.259114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:49.259619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:49.260072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:49.260806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:49.261279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:49.261720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:49.400991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:49.408699 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4aeff9eb-ff2b-4b2b-8e3f-33deda0f820a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.161361 Aug 24 03:20:49.409298 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6170/7162] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:49 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:50.430643 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:50.431271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:50.437704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:50.438204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:50.438663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:50.439364 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:50.439833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:50.440275 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:50.568216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:50.576492 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b3d4c18-82a3-4a0d-85e2-621c8909f548 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.149951 Aug 24 03:20:50.577088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6171/7163] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:50 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:51.599350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:51.600003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:51.607712 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:51.608214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:51.608665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:51.609384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:51.609849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:51.610285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:51.738265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:51.746062 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9cac6e1e-786e-4436-a3bf-3e448670541b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.150584 Aug 24 03:20:51.746643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6172/7164] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:51 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:52.767943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:52.768560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:52.775355 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:52.775852 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:52.776305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:52.777135 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:52.777607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:52.778048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:52.909481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:52.918290 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-95288acb-3bb8-44e9-945f-6b8cc0ac186f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.154349 Aug 24 03:20:52.918884 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6173/7165] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:52 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:53.939589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:53.940261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:53.947186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:53.947679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:53.948282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:53.948830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:53.949482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:53.949991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:54.079625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:54.087882 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aaed3d81-e5bc-419d-a7cf-63c68fdab491 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1678 microversion: 2.1 time: 0.152272 Aug 24 03:20:54.088464 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6174/7166] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:53 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:20:55.109295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:20:55.110005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:20:55.117324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:55.117818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:55.118264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:55.118997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:20:55.119462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:20:55.119900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:20:55.254576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:20:55.263064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28c65246-efe9-421b-820d-aaac0edb279a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1681 microversion: 2.1 time: 0.157797 Aug 24 03:20:55.263643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6175/7167] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:20:55 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:21:29.482403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:29.484600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:29.487104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=24 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:29.487771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:29.493967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:29.494406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:29.494854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:29.495558 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:29.496024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:29.496464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:29.573527 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ea89d77a-2948-4935-89cb-b1a3403289e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action" status: 200 len: 69130 microversion: 2.1 time: 0.095001 Aug 24 03:21:29.574183 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6176/7168] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:21:29 2022] POST /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c/action => generated 69130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:21:53.442119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:53.442773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:53.445279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:53.445948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:21:53.452631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:53.453305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:53.453770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:53.454497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:53.454971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:53.455420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:53.482845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:21:53.560643 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a07e69e0-d819-4322-bb07-e1b6f3dfba7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 204 len: 0 microversion: 2.1 time: 0.122929 Aug 24 03:21:53.561717 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6177/7169] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:21:53 2022] DELETE /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:21:53.632099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397e54dc-dd31-4117-b7b1-b4c73c5fe23c", "tag": "9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:53.642472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:53.642974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:53.643418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:53.654453 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] Creating event network-changed:9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e for instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c on n-h1-854121-3 Aug 24 03:21:53.659461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-187a15d1-f420-4e5f-abfd-a44b705a23a8 req-92509fb8-2e8d-403e-9bee-1ffca224be15 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096479 Aug 24 03:21:53.660084 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6178/7170] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:53.665833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:53.666530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:53.672661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:53.673185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:53.673703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:53.674402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:53.674865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:53.675302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:53.809528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:21:53.817599 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e6d9fd46-6586-4d57-bc0f-a29625e8d250 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1687 microversion: 2.1 time: 0.156251 Aug 24 03:21:53.832060 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6179/7171] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:21:53 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:21:54.840139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:54.840915 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:54.849074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:54.849576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:54.850026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:54.850721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:54.851184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:54.851676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:54.986181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:21:54.993936 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bfc19860-1ec4-45c5-9792-ccc75a049f68 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1687 microversion: 2.1 time: 0.157673 Aug 24 03:21:54.994511 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6180/7172] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:21:54 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:21:55.932979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397e54dc-dd31-4117-b7b1-b4c73c5fe23c", "name": "network-vif-deleted", "tag": "9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:21:55.943995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:55.944483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:55.944949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:55.956352 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] Creating event network-vif-deleted:9c50b923-1d9a-44b4-9b47-d8ac3ad5d72e for instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c on n-h1-854121-3 Aug 24 03:21:55.961424 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-fc39cde8-792e-4866-8e78-f82b6984818f req-ff4d464c-bb14-419e-8b09-122b8996bc5b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 Aug 24 03:21:55.962028 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6181/7173] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:21:56.016844 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:56.017690 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:56.024197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:56.024698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:56.025171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:56.025875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:56.026340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:56.026775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:56.064281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:56.064821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:56.065281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:56.066336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lazy-loading 'fault' on Instance uuid 397e54dc-dd31-4117-b7b1-b4c73c5fe23c {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:21:56.110500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:21:56.118799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c6447015-3dc2-4301-9165-1eaa7b10e023 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 200 len: 1355 microversion: 2.1 time: 0.106202 Aug 24 03:21:56.119353 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6182/7174] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:21:56 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:21:57.140286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:21:57.141012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 397e54dc-dd31-4117-b7b1-b4c73c5fe23c] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:21:57.148341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.148872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.149329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.150036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:21:57.150504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:21:57.150947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:21:57.164959 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] HTTP exception thrown: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Request method failure captured: Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c HTTP/1.1 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZhJdJjHAB3oCwRWfR15hONbaBvVWeFWsjkieh-0GHtl7_stzvtghjLUmUsx99s7Usefm9co92oO24XpZPCJO5RyiPj3JmPtgLuqWhHctDQv0_AZkiVd89e9rel6L6wSzP1KfTWvqSvcxUtABazXRw0ZI4cTJmpXDUaIFLkTdKURCOI Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d1aa5e8123664787ae37579283e30314 Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '397e54dc-dd31-4117-b7b1-b4c73c5fe23c'} Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:21:57.166601 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Returning 404 to user: Instance 397e54dc-dd31-4117-b7b1-b4c73c5fe23c could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c89b4417-cd4e-4af3-95cd-d026878e0d1e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c" status: 404 len: 111 microversion: 2.1 time: 0.031667 Aug 24 03:21:57.171450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6183/7175] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:21:57 2022] GET /compute/v2.1/servers/397e54dc-dd31-4117-b7b1-b4c73c5fe23c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:22:00.354319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-754b0d11-71cf-4b65-a40f-24c02caf9cac tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '.version_select at 0x7f6b91059700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:00.358766 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-754b0d11-71cf-4b65-a40f-24c02caf9cac tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [f453edae-6459-4870-82e9-e93e63086404] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:22:01.368566 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-754b0d11-71cf-4b65-a40f-24c02caf9cac tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [f453edae-6459-4870-82e9-e93e63086404] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49294. Aug 24 03:22:01.387697 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-754b0d11-71cf-4b65-a40f-24c02caf9cac tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-429575846" status: 202 len: 0 microversion: 2.1 time: 1.037257 Aug 24 03:22:01.388290 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6184/7176] 10.222.0.49 () {58 vars in 1281 bytes} [Wed Aug 24 03:22:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-429575846 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:22:01.418123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-06adaac7-803e-4ab4-97a9-e4925c25ffa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: .version_select at 0x7f6b9125ae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-615504672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHmbEPnNiCsZgzUnnqXBkytVd85rve49PoeQ5sBqucj8H0KYAHznRQ4nXcSodAmunigcA8QN0o1zI1YLVidSldMsbWxdxkLddYGeH7IxIjPx0IspbHRpiumIMonx7PUHQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:01.433952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06adaac7-803e-4ab4-97a9-e4925c25ffa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:22:01.439106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-06adaac7-803e-4ab4-97a9-e4925c25ffa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:22:01.463739 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-06adaac7-803e-4ab4-97a9-e4925c25ffa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049390 Aug 24 03:22:01.464345 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6185/7177] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:22:01 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:22:06.830214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-412756486", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "1d9a0bac-2e37-48c9-95b4-70244e6c6f6f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-615504672", "security_groups": [{"name": "tempest-secgroup-smoke-140700396"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:06.959587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] validate_networks() for [('1d9a0bac-2e37-48c9-95b4-70244e6c6f6f', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:22:07.156133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:07.638470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:22:07.638913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:22:07.639400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:22:07.639822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:22:07.640247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:22:07.649515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:07.650010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:07.650459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:07.651196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:07.651664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:07.652104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:07.669702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:22:07.675184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:22:07.687652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:22:07.690090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:22:07.742705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cce19ce6-fa33-47a4-925f-9b9914152d29 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.916402 Aug 24 03:22:07.743553 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6186/7178] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:22:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:22:07.757686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-67bc5e56-0e3c-431f-b999-3ddb4780f87f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:07.758384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-67bc5e56-0e3c-431f-b999-3ddb4780f87f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:07.815316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-67bc5e56-0e3c-431f-b999-3ddb4780f87f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:07.823987 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-67bc5e56-0e3c-431f-b999-3ddb4780f87f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1265 microversion: 2.1 time: 0.073268 Aug 24 03:22:07.824571 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6187/7179] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:07 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:08.846010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:08.846800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:08.855911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:08.856574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:08.857068 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:08.858010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:08.858653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:08.859268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:08.941887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:08.949883 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b3e40960-9ef3-4231-a7d8-d9981612391c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1325 microversion: 2.1 time: 0.108111 Aug 24 03:22:08.950485 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6188/7180] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:08 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1325 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:09.972303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:09.973001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:09.980591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:09.981243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:09.981702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:09.982429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:09.982905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:09.983353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:10.126354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:10.134411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da49fcf8-7917-44d4-bf7f-32104c71956c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.166803 Aug 24 03:22:10.134984 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6189/7181] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:09 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:10.254563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:10.265082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:10.265499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:10.265951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:10.278263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] Creating event network-changed:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h2-854121-3 Aug 24 03:22:10.283137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5e415f02-7072-4f58-a4b1-315f3b2cad13 req-82ac3790-98a8-4eae-8965-d79d97f09c0e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032704 Aug 24 03:22:10.283798 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6190/7182] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:22:11.156800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:11.157545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:11.164331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:11.164871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:11.165324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:11.166029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:11.166499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:11.166939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:11.311294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:11.319578 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b623d126-266a-4c63-8945-1b125979be7a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.167834 Aug 24 03:22:11.320154 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6191/7183] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:11 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:12.340088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:12.340854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:12.347700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:12.348204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:12.348711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:12.349440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:12.349911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:12.350354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:12.489560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:12.497464 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2282c50f-0b16-41b3-a8a2-1d145f475feb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.161294 Aug 24 03:22:12.498057 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6192/7184] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:12 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:13.518548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:13.519268 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:13.526887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:13.527387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:13.527841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:13.528545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:13.529044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:13.529485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:13.659640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:13.667952 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28c200fb-2161-44ad-9b1b-d3e5d7b75936 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.153293 Aug 24 03:22:13.668531 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6193/7185] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:13 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:14.689047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:14.689953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:14.696742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:14.697255 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:14.697701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:14.698407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:14.698874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:14.699310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:14.830316 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:14.839770 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-eefc3650-4aee-413a-a988-2319b8fabc9c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.154597 Aug 24 03:22:14.840371 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6194/7186] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:14 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:15.861059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:15.861703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:15.868602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:15.869141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:15.869629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:15.870342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:15.870816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:15.871262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:16.003192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:16.011939 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0946ef12-d981-4b92-9c68-bd1d99bf90c9 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.154857 Aug 24 03:22:16.012522 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6195/7187] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:15 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:16.301548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "name": "network-vif-plugged", "status": "completed", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:16.312185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:16.312687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:16.313177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:16.325292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] Creating event network-vif-plugged:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h2-854121-3 Aug 24 03:22:16.330224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-18a53d65-c882-4fe7-94ca-60ef2b416d67 req-98beecf7-4ec1-47f4-b4e0-be80fdd8cb11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087439 Aug 24 03:22:16.330825 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6196/7188] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:22:17.034391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:17.035113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:17.041963 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:17.042467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:17.042925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:17.043636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:17.044109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:17.044559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:17.175067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:17.182867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5eae4e76-e442-4f16-9f26-5c0f53bb5b1d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1390 microversion: 2.1 time: 0.153529 Aug 24 03:22:17.183446 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6197/7189] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:17 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:18.203424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:18.204114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:18.206123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.206952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:18.213864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:18.214366 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:18.214820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:18.215522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:18.215992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:18.216436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:18.354018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:18.361779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d2a56bd-6d68-498c-b2be-37ac1ae5b3ab tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1562 microversion: 2.1 time: 0.162287 Aug 24 03:22:18.362350 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6198/7190] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:18 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:18.381925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:18.382543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:18.388235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:18.388760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:18.389217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:18.389919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:18.390384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:18.390823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:18.521019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:18.528768 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1b8fa8e9-483c-4f84-81c6-e9dadbd97621 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1562 microversion: 2.1 time: 0.150662 Aug 24 03:22:18.529332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6199/7191] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:18 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:20.063326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:22:20.063951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:20.070772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:20.071280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:20.071734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:20.072437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:20.072940 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:20.073383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:20.208013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:22:20.215946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c88edf3c-7b5b-4e54-8f01-9cb2395cfbf2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1562 microversion: 2.1 time: 0.156694 Aug 24 03:22:20.216517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6200/7192] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:22:20 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:22:20.221324 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:20.231460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:20.231962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:20.232925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:20.245281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] Creating event network-changed:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h2-854121-3 Aug 24 03:22:20.250551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-08fd4716-5657-4053-b17c-68044ce0fd43 req-25476a26-2c0f-4618-9aec-7acf05b89e3b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032747 Aug 24 03:22:20.251646 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6201/7193] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:22:53.505808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:53.506489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=74 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:22:53.557172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:22:53.559557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:22:53.565794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:53.566301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:53.566745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:53.567447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:22:53.567917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:22:53.568357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:22:53.634717 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a3e4cab-8e4a-4569-842d-ef0070b1ae52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action" status: 200 len: 24572 microversion: 2.1 time: 0.131122 Aug 24 03:22:53.635415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6202/7194] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:22:53 2022] POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action => generated 24572 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:23:24.132636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:24.134970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:24.137689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:24.138354 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:24.145894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:24.146586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:24.147160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:24.147867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:24.148337 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:24.148812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:24.189907 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:24.196695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Old instance type m1.heat2, new instance type m1.heat {{(pid=128567) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 24 03:23:24.203269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:23:24.203711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:23:24.204200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:23:24.204626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:23:24.205083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:23:24.274373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-103acf68-bcdf-4c93-b410-a72116d3f970 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action" status: 202 len: 0 microversion: 2.1 time: 0.146668 Aug 24 03:23:24.275162 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6203/7195] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:23:24 2022] POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:23:24.282783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:24.283411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:24.290758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:24.291265 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:24.291717 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:24.292430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:24.292935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:24.293374 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:24.445599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:24.453597 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7c699ac-f0b2-4dd5-82a5-67f482ed7fa2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1689 microversion: 2.1 time: 0.174402 Aug 24 03:23:24.454365 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6204/7196] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:24 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:25.476084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:25.476881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:25.484053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:25.484613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:25.485092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:25.485802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:25.486264 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:25.486700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:25.624678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:25.633274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d1dd6893-068a-4ff8-bd24-097c20ea9d94 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1689 microversion: 2.1 time: 0.161776 Aug 24 03:23:25.633837 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6205/7197] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:25 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:26.655437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:26.656071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:26.663478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:26.663972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:26.664422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:26.665151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:26.665610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:26.666045 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:26.798396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:26.806586 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd0bab46-b2f8-4c6b-a689-d2bf89c8cc02 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.155095 Aug 24 03:23:26.807178 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6206/7198] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:26 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:27.827835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:27.828481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:27.835873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:27.836372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:27.836864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:27.837568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:27.838036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:27.838475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:27.972522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:27.980305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0893e352-f505-4086-817f-ff208a722bc8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.156360 Aug 24 03:23:27.980900 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6207/7199] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:27 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:29.002083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:29.002755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:29.009931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:29.010466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:29.010923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:29.011636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:29.012117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:29.012564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:29.141430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:29.149659 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5e6e55c9-60be-4856-b226-40b314654c7f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.151564 Aug 24 03:23:29.150240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6208/7200] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:28 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:30.171811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:30.172479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:30.179909 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:30.180410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:30.180897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:30.181609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:30.182080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:30.182522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:30.314432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:30.322283 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-909a2970-45d9-41f1-a213-9d824570d125 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.154703 Aug 24 03:23:30.322866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6209/7201] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:30 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:31.343669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:31.344317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:31.351726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:31.352225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:31.352678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:31.353477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:31.353952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:31.354396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:31.483921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:31.492381 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f217dfd1-639f-4c64-9738-4455698a3831 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.152581 Aug 24 03:23:31.492930 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6210/7202] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:31 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:32.515372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:32.516006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:32.523624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:32.524130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:32.524589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:32.525328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:32.525801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:32.526247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:32.657983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:32.666328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3c0ed280-6c4b-4c70-bc11-5111778cffd8 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.154869 Aug 24 03:23:32.666899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6211/7203] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:32 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:33.687550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:33.688222 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:33.695214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:33.695707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:33.696156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:33.696892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:33.697361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:33.697802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:33.836373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:33.844564 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1f231a5b-9960-4037-ad9c-54e5c3c6941a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.160909 Aug 24 03:23:33.845185 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6212/7204] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:33 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:34.866533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:34.867176 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:34.874363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:34.874869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:34.875328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:34.876047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:34.876517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:34.876998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:35.007486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:35.015235 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a57d302-f7d5-4e04-9b4c-215ad8207601 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.153270 Aug 24 03:23:35.015808 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6213/7205] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:34 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:36.038269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:36.038947 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:36.045835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.046333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.046786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.047492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:36.047971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:36.048409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:36.182707 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:36.190945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-295bf898-3536-44ce-8e69-acb156a62e5e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.157141 Aug 24 03:23:36.191517 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6214/7206] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:36 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:37.212518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:37.213184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:37.220011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:37.220508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:37.220999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:37.221709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:37.222185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:37.222626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:37.352529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:37.360430 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3b02194d-c338-4fb2-8c6f-2a6a1ae8e78d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.151975 Aug 24 03:23:37.361038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6215/7207] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:37 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:38.382794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:38.383537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:38.390462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:38.390959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:38.391411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:38.392114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:38.392584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:38.393618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:38.523787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:38.531600 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b21ef070-fe63-4176-a1eb-6e279cd0a622 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1694 microversion: 2.1 time: 0.152904 Aug 24 03:23:38.532188 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6216/7208] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:38 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:39.123983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "name": "network-vif-unplugged", "status": "completed", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:39.135810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:39.136310 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:39.136788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:39.149444 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Creating event network-vif-unplugged:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h1-854121-3 Aug 24 03:23:39.155098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] Instance 01c118e5-829b-4175-a0e7-a01189daa815 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:23:39.167333 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9a2b9717-6179-4c40-8d2d-5a725514d2e1 req-fbb5f135-ca73-4de0-a328-3047fd37dfba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047484 Aug 24 03:23:39.168236 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6217/7209] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:23:39.554874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:39.555590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:39.563461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:39.563461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:39.563781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:39.564504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:39.565543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:39.565976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:39.587335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:23:39.799462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:39.807488 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29b7f4e0-3471-43af-b1a0-601d89402a66 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1693 microversion: 2.1 time: 0.256931 Aug 24 03:23:39.808285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6218/7210] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:39 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:40.830379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:40.831033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:40.838118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:40.838618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:40.839095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:40.839797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:40.840266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:40.840700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:40.969394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:40.977644 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1956ed68-8269-4452-98dd-97b3073d862a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1691 microversion: 2.1 time: 0.151249 Aug 24 03:23:40.978227 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6219/7211] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:40 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:41.205937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:41.215171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:41.215670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:41.216145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:41.228122 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Creating event network-changed:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h1-854121-3 Aug 24 03:23:41.233543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] Instance 01c118e5-829b-4175-a0e7-a01189daa815 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-3', 'n-h2-854121-3'} {{(pid=128567) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 24 03:23:41.244363 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e596ef95-cfa5-4e84-8b33-208647a9c829 req-e0902ff0-8b39-45f7-bb34-cb7e06d2ef5d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042800 Aug 24 03:23:41.245003 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6220/7212] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:23:42.000221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:42.000957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:42.009172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:42.009685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:42.010134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:42.010874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:42.011420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:42.011849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:42.143650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:42.151674 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29c03410-65d0-493a-bd50-99d0c44d6382 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1691 microversion: 2.1 time: 0.156117 Aug 24 03:23:42.152264 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6221/7213] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:41 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:43.172240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:43.172913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:43.179798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.180301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.180794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.181503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.181979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.182421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.316088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:43.323870 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-503a8707-8310-45af-87b1-7afda5cd3377 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1688 microversion: 2.1 time: 0.155588 Aug 24 03:23:43.324444 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6222/7214] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:43 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:43.344129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:43.344675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:43.351199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.351765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.352229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.353145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.353634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.354108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.416614 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-92bbd15e-61b0-4d3c-9c81-aaebfc0553be tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action" status: 204 len: 0 microversion: 2.1 time: 0.076054 Aug 24 03:23:43.417338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6223/7215] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:23:43 2022] POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:23:43.426011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:43.426832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:43.433256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.433762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.434216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.434930 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.435452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.435946 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.575369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:43.584188 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d9ebd5b-0303-4a38-8e11-4680e382064f tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1688 microversion: 2.1 time: 0.162581 Aug 24 03:23:43.585037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6224/7216] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:43 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:43.607858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:43.608843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:43.615851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.616353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.616828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.617540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:43.618034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:43.618468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:43.763941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:43.772203 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-575033ae-da82-4c8f-ba7b-e85c795272dc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1688 microversion: 2.1 time: 0.168952 Aug 24 03:23:43.772801 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6225/7217] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:43 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:23:44.792870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:23:44.793644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:23:44.800792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:44.801287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:44.801733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:44.802458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:44.802921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:44.803359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:44.942077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:23:44.951403 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9b68b86c-149b-46e2-8652-bfbae7be0945 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1680 microversion: 2.1 time: 0.162405 Aug 24 03:23:44.952450 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6226/7218] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:23:44 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:23:45.066546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "name": "network-vif-plugged", "status": "completed", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:23:45.076103 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:23:45.076613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:23:45.077108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:23:45.089244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] Creating event network-vif-plugged:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h1-854121-3 Aug 24 03:23:45.094123 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4393cc4e-bc26-4d7f-8500-b97c6e2a1d4c req-3935d38d-b3f0-4319-978d-e43f9be9c443 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Aug 24 03:23:45.094724 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6227/7219] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:24:15.160145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=54 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:15.160945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:15.165216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:15.167450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:15.175219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:15.175714 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:15.176160 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:15.176912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:15.177379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:15.177816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:15.249379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5fb9224-4370-42c9-b497-82d71dea8d56 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action" status: 200 len: 24577 microversion: 2.1 time: 0.092197 Aug 24 03:24:15.250033 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6228/7220] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:24:15 2022] POST /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815/action => generated 24577 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:24:32.550097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:32.550709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:32.553522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:32.554344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:32.561462 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:32.561969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:32.562426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:32.563688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:32.564163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:32.564663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:32.592062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:24:32.671315 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2839b006-9fb3-426a-8647-a7db4a1c8760 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 204 len: 0 microversion: 2.1 time: 0.125570 Aug 24 03:24:32.672086 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6229/7221] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:24:32 2022] DELETE /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:24:32.764608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:32.775670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:32.776163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:32.776948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:32.787933 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] Creating event network-changed:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h1-854121-3 Aug 24 03:24:32.793180 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f5ea65cc-8549-4809-9bd9-b83f05542f46 req-bdd3e045-d200-4e31-a2d2-7eb6f529ad0d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119638 Aug 24 03:24:32.793781 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6230/7222] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:32.799276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:32.799988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:32.806105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:32.806604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:32.807061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:32.807778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:32.808247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:32.808689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:33.006588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:33.014834 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1862b38c-c73e-45ab-a6ae-d88a74b1d31c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1686 microversion: 2.1 time: 0.219848 Aug 24 03:24:33.015344 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6231/7223] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:32 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1686 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:24:34.036902 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:34.037551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:34.044831 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:34.045333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:34.045780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:34.046485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:34.046948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:34.047387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:34.208408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:34.216302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3d6382c5-da02-4360-ab53-398c20c1511d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 200 len: 1686 microversion: 2.1 time: 0.183308 Aug 24 03:24:34.216899 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6232/7224] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:34 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:34.807550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c118e5-829b-4175-a0e7-a01189daa815", "name": "network-vif-deleted", "tag": "605f3ecd-9f2a-4298-b2c6-74138689b131"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:34.818128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:34.818615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:34.819076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:34.830684 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] Creating event network-vif-deleted:605f3ecd-9f2a-4298-b2c6-74138689b131 for instance 01c118e5-829b-4175-a0e7-a01189daa815 on n-h1-854121-3 Aug 24 03:24:34.835543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9170dec8-d577-4fb1-a118-ba9e8f0329dc req-3cc1cc24-9725-4631-b6be-aa2695778471 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031620 Aug 24 03:24:34.836166 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6233/7225] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:24:35.241428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:35.242553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 01c118e5-829b-4175-a0e7-a01189daa815] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:35.249018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:35.249519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:35.249975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:35.251187 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:35.251656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:35.252097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:35.265839 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] HTTP exception thrown: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Request method failure captured: Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 HTTP/1.1 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZhJdJjHAB3oCwRWfR15hONbaBvVWeFWsjkieh-0GHtl7_stzvtghjLUmUsx99s7Usefm9co92oO24XpZPCJO5RyiPj3JmPtgLuqWhHctDQv0_AZkiVd89e9rel6L6wSzP1KfTWvqSvcxUtABazXRw0ZI4cTJmpXDUaIFLkTdKURCOI Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d1aa5e8123664787ae37579283e30314 Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '01c118e5-829b-4175-a0e7-a01189daa815'} Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:24:35.268145 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Returning 404 to user: Instance 01c118e5-829b-4175-a0e7-a01189daa815 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ad9b9b41-cb21-4f9f-acdc-d2a14fabef3b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815" status: 404 len: 111 microversion: 2.1 time: 0.033801 Aug 24 03:24:35.273199 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6234/7226] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:35 2022] GET /compute/v2.1/servers/01c118e5-829b-4175-a0e7-a01189daa815 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:24:38.507448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ccec0563-6633-41d9-8042-d51a0424534c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '.version_select at 0x7f6b918695e0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:38.530375 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ccec0563-6633-41d9-8042-d51a0424534c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-615504672" status: 202 len: 0 microversion: 2.1 time: 0.026999 Aug 24 03:24:38.530957 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6235/7227] 10.222.0.49 () {58 vars in 1281 bytes} [Wed Aug 24 03:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-615504672 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:24:38.559574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2012e93f-f774-4b95-8edf-6d102b88d713 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: .version_select at 0x7f6b924821f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1284855782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN0GN1EQi6NbCfkPWUm2ZtjGDtoJc/vQFNFnzHuJo4m3gVDcBjzi7c5OfVaLGc/PKMobEPVPJYCjGtugKKWR9GTEdvr0x29sLTeE80auTQknBo20BxiRXS+5B89JP4DzQ=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:38.576874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2012e93f-f774-4b95-8edf-6d102b88d713 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:24:38.582734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-2012e93f-f774-4b95-8edf-6d102b88d713 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:24:38.606790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2012e93f-f774-4b95-8edf-6d102b88d713 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051352 Aug 24 03:24:38.607398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6236/7228] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:24:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:24:44.010830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1283455671", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "6375eb73-4fb7-4472-8ec4-48d2018a3242"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1284855782", "security_groups": [{"name": "tempest-secgroup-smoke-1881804780"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:44.117881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] validate_networks() for [('6375eb73-4fb7-4472-8ec4-48d2018a3242', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:24:44.609276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:24:44.609422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:24:44.610439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:24:44.611050 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:24:44.611748 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:24:44.634579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:44.635217 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:44.635545 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:44.636291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:44.636792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:44.637249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:44.655467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:24:44.662843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:24:44.680118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:24:44.682905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:24:44.759291 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5f24f93-27b2-468a-989c-9899a16c7182 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.752857 Aug 24 03:24:44.761370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6237/7229] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:24:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:24:44.779506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a5bb2a1d-46a3-4353-aa2a-b44ccc348fdd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:44.782163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a5bb2a1d-46a3-4353-aa2a-b44ccc348fdd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:44.870074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a5bb2a1d-46a3-4353-aa2a-b44ccc348fdd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:44.878200 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a5bb2a1d-46a3-4353-aa2a-b44ccc348fdd tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1267 microversion: 2.1 time: 0.109412 Aug 24 03:24:44.878764 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6238/7230] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:44 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:45.901577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:45.902227 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:45.911197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:45.911698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:45.912149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:45.912884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:45.913350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:45.913783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:45.979396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:45.989777 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a66d9524-ec7f-48c6-a4ac-44454e395236 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1319 microversion: 2.1 time: 0.092104 Aug 24 03:24:45.990370 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6239/7231] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:45 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:47.012765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:47.014540 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:47.025866 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:47.026849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:47.027544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:47.028615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:47.029419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:47.030037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:47.219510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:47.231090 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ef4ac2a2-8d19-4853-88c3-9ed8d16e6733 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.223234 Aug 24 03:24:47.232494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6240/7232] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:47 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:47.493119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37bdaa97-87be-4b24-98fd-3ba4a5ac0af4", "tag": "6849009f-cd74-41c3-a158-e55bb400b839"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:47.504342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:47.505121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:47.505571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:47.517104 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] Creating event network-changed:6849009f-cd74-41c3-a158-e55bb400b839 for instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 on n-h2-854121-3 Aug 24 03:24:47.522286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-26a48b25-a854-4d67-806a-16e54d18e5b5 req-0bdc61bc-df2d-4845-bb26-2839c45dccc2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033033 Aug 24 03:24:47.522904 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6241/7233] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:24:48.255798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:48.256539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:48.262773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:48.263270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:48.263719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:48.264436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:48.264918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:48.265358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:48.395519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:48.403573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ec5c7f1-6cd2-4132-9b33-a7116e467fe4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.153736 Aug 24 03:24:48.404149 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6242/7234] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:48 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:49.425225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:49.425865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:49.432626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:49.433155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:49.433601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:49.434298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:49.434760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:49.435198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:49.568483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:49.576170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-764970bf-4198-427f-971a-0ffcbfab3d0e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.155093 Aug 24 03:24:49.576749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6243/7235] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:49 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:50.597198 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:50.597825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:50.603977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:50.604474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:50.604949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:50.605661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:50.606125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:50.606559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:50.737797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:50.745690 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e81dbcae-1ace-4eb5-a09a-4da58be1b8c3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.152747 Aug 24 03:24:50.746267 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6244/7236] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:50 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:51.766400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:51.767009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:51.773807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:51.774304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:51.774752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:51.775450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:51.775911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:51.776348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:51.904992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:51.912573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8599a2e1-f4dc-41ad-bb94-f24711f0eb47 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.150338 Aug 24 03:24:51.913408 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6245/7237] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:51 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:52.923161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bdaa97-87be-4b24-98fd-3ba4a5ac0af4", "name": "network-vif-plugged", "status": "completed", "tag": "6849009f-cd74-41c3-a158-e55bb400b839"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:52.937012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:52.937959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:52.938408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:52.950025 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] Creating event network-vif-plugged:6849009f-cd74-41c3-a158-e55bb400b839 for instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 on n-h2-854121-3 Aug 24 03:24:52.954938 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-308355e1-5b85-45a2-8dfd-f4d6e02ea9ef req-9406b224-6b7b-4093-ae0f-25b37ee6644f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036137 Aug 24 03:24:52.955698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6246/7238] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:24:52.960533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:52.961252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:52.967282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:52.967779 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:52.968229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:52.969606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:52.970042 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:52.970485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:53.372090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:53.380538 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a19f157-85f4-4d7a-a19e-69b02196b2b1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.423844 Aug 24 03:24:53.381138 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6247/7239] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:52 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:24:54.401344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:54.401998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:54.409375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:54.409880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:54.410336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:54.411071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:54.411546 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:54.411991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:54.545879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:54.554392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-feef9f3d-428e-4036-9d94-51184677d102 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1393 microversion: 2.1 time: 0.156892 Aug 24 03:24:54.555161 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6248/7240] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:54 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:55.576552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:55.577356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:55.579743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:55.580454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:55.587929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:55.588435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:55.588937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:55.589661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:55.590139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:55.590582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:55.728261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:55.736056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3654c6ce-6375-4eea-829f-3f9e604fc9bb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1565 microversion: 2.1 time: 0.163418 Aug 24 03:24:55.736638 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6249/7241] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:55 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:55.755877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:55.756528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:55.762343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:55.762843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:55.763300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:55.764003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:55.764475 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:55.764982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:55.894514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:55.897967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:24:55.902947 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f4d16226-4eef-4396-8ce3-db60d5915eca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1565 microversion: 2.1 time: 0.150837 Aug 24 03:24:55.903523 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6250/7242] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:55 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:57.446778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:24:57.447402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:24:57.455861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:57.456370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:57.456851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:57.457566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:57.458038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:57.458481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:57.595608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:24:57.604766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-89faae08-a394-4069-b781-838469571247 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1565 microversion: 2.1 time: 0.161695 Aug 24 03:24:57.605343 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6251/7243] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:24:57 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:24:57.610693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37bdaa97-87be-4b24-98fd-3ba4a5ac0af4", "tag": "6849009f-cd74-41c3-a158-e55bb400b839"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:24:57.620531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:24:57.621131 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:24:57.621644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:24:57.633963 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] Creating event network-changed:6849009f-cd74-41c3-a158-e55bb400b839 for instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 on n-h2-854121-3 Aug 24 03:24:57.639533 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b33f4647-17ef-40be-9cce-6c65263bbd14 req-3eb06271-8c5e-4d73-b6a7-b3ba863438a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032931 Aug 24 03:24:57.640468 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6252/7244] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:25:30.885344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.886091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.890381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:25:30.893123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:25:30.900686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:25:30.901212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:25:30.901662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:25:30.902365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:25:30.902832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:25:30.903270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:25:30.973534 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-568681b2-7236-431e-8862-938f55ba9f18 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action" status: 200 len: 24574 microversion: 2.1 time: 0.090232 Aug 24 03:25:30.974494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6253/7245] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:25:30 2022] POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:26:01.454827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:01.457485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.458149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.464878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:01.465383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:01.465840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:01.489115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Going to try to stop instance {{(pid=128567) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 03:26:01.533435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-721fd669-3933-45d6-a6c3-30cd31b7c446 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action" status: 202 len: 0 microversion: 2.1 time: 0.083249 Aug 24 03:26:01.534251 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6254/7246] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:26:01 2022] POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:26:01.543116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:01.543827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:01.551150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:01.551666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:01.552220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:01.552965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:01.553437 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:01.553871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:01.688380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:01.696199 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4b55bf05-9334-4efc-b16d-6e1ad7822abc tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.157519 Aug 24 03:26:01.696797 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6255/7247] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:01 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:02.718155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:02.718790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:02.725774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:02.726277 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:02.726730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:02.727441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:02.727911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:02.728504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:02.859164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:02.866832 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-beb86330-5397-47c3-92a3-67de8a52ad80 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.153070 Aug 24 03:26:02.867396 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6256/7248] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:02 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:03.889410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:03.890096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:03.896836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:03.897336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:03.897792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:03.898495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:03.898965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:03.899407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:04.034743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:04.042543 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-caa0ed39-63e6-4dc9-9a59-dd9e8e4888df tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.157107 Aug 24 03:26:04.043122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6257/7249] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:03 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:05.066448 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:05.067088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:05.073950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:05.074452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:05.074904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:05.075609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:05.076080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:05.076522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:05.205412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:05.213101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a9ea0f64-74ba-4c44-b1c9-955cf444a8c0 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.150558 Aug 24 03:26:05.213673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6258/7250] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:05 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:06.234782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:06.235418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:06.242843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:06.243350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:06.243875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:06.244622 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:06.245121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:06.245556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:06.381660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:06.389867 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-99b5e25d-5aea-4858-997d-b6bbeb23b19b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.158890 Aug 24 03:26:06.390467 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6259/7251] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:06 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:07.413175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:07.413840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:07.421429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:07.421927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:07.422372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:07.423073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:07.423537 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:07.423974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:07.551481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:07.559271 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-93d34841-b61f-4ca1-8724-d4cb169938de tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.150010 Aug 24 03:26:07.559839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6260/7252] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:07 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:08.580785 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:08.581438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:08.588291 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:08.588829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:08.589285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:08.590433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:08.590433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:08.590882 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:08.724520 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:08.732871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dd2e002f-c7a6-4305-b390-3a5010a59e74 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.155370 Aug 24 03:26:08.733438 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6261/7253] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:08 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:09.754111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:09.754749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:09.762117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:09.762691 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:09.763194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:09.764431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:09.764939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:09.765381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:09.897194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:09.905775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-233e3b50-c65e-496c-a890-61e52a109199 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.155624 Aug 24 03:26:09.906357 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6262/7254] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:09 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:10.926720 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:10.927359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:10.934140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:10.934645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:10.935095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:10.935843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:10.936313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:10.936786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:11.069242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:11.076895 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-173d9ca2-ea28-4582-ad03-372a37686563 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1693 microversion: 2.1 time: 0.154168 Aug 24 03:26:11.077466 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6263/7255] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:10 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:12.098532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:12.099208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:12.106507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:12.107011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:12.107473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:12.108185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:12.108658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:12.109129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:12.243404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:12.251170 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1746aa9b-66fa-4669-abd7-344b907fafca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1670 microversion: 2.1 time: 0.156603 Aug 24 03:26:12.251749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6264/7256] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:12 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:13.343009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:13.345270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:13.352062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:13.352560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:13.353062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:13.353766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:13.354234 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:13.354672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:13.416307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1de63a12-4c04-43b7-a9f5-5dc1eec88a03 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action" status: 200 len: 36372 microversion: 2.1 time: 0.077527 Aug 24 03:26:13.417000 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6265/7257] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:26:13 2022] POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action => generated 36372 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:26:13.428873 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:13.439586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:13.440091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:13.440548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:13.463711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Going to try to start instance {{(pid=128567) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 03:26:13.505014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-984ea752-162d-49ed-9e1d-3f893d8c8f52 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action" status: 202 len: 0 microversion: 2.1 time: 0.079803 Aug 24 03:26:13.505799 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6266/7258] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:26:13 2022] POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:26:13.514609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:13.515325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:13.522011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:13.522550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:13.523011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:13.523991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:13.524467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:13.524960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:13.667921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:13.676319 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8605f6d6-6d97-4f78-9a4d-f82a7724e57e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1679 microversion: 2.1 time: 0.166029 Aug 24 03:26:13.676926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6267/7259] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:13 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:14.698592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:14.699225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:14.706031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:14.706528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:14.706977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:14.707678 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:14.708139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:14.708575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:14.851456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:14.855031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.860166 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-549898ef-798b-4a44-99e3-b3a2ea361c7c tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1679 microversion: 2.1 time: 0.165471 Aug 24 03:26:14.860754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6268/7260] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:14 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:15.883737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:26:15.884432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:15.891937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:15.892438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:15.892920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:15.893629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:15.894098 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:15.894541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:16.027483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:26:16.035370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bf73d75-1a38-4564-a274-da18adde4bca tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1683 microversion: 2.1 time: 0.156619 Aug 24 03:26:16.035947 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6269/7261] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:26:15 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:48.242074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:26:48.245081 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:26:48.249606 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=32 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.250757 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=6 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.261156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:48.261929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:48.262929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:48.263650 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:26:48.264126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:26:48.264573 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:26:48.334255 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-458ffedd-83b1-47fe-bf98-2f59268d7a71 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action" status: 200 len: 60933 microversion: 2.1 time: 0.096442 Aug 24 03:26:48.334907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6270/7262] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:26:48 2022] POST /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4/action => generated 60933 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:05.625101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:05.625724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:05.628326 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.629168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.636107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:05.636620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:05.637887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:05.638822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:05.639297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:05.639740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:05.666848 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:27:05.744874 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e8451afe-46d0-4082-b432-010c1e28accb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 204 len: 0 microversion: 2.1 time: 0.124168 Aug 24 03:27:05.745481 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6271/7263] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:27:05 2022] DELETE /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:05.802802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37bdaa97-87be-4b24-98fd-3ba4a5ac0af4", "tag": "6849009f-cd74-41c3-a158-e55bb400b839"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:05.813825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:05.814346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:05.814792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:05.825799 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] Creating event network-changed:6849009f-cd74-41c3-a158-e55bb400b839 for instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 on n-h2-854121-3 Aug 24 03:27:05.830706 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c83cd80e-4876-461e-ab85-a850ae55f907 req-05aeec46-bcd1-460d-8324-bdea98deb185 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083169 Aug 24 03:27:05.831387 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6272/7264] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:27:05.837781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:05.838489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:05.845069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:05.845580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:05.846010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:05.846735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:05.847197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:05.847749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:05.983693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:05.991490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c23ac3c8-d3ff-46fe-b0fb-25f129fe1155 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1689 microversion: 2.1 time: 0.157810 Aug 24 03:27:05.992067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6273/7265] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:05 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:07.015460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:07.016089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:07.022982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:07.023486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:07.023935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:07.024645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:07.025143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:07.025581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:07.162770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:07.170688 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-da234376-868b-461f-abc6-f798c04405a4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1689 microversion: 2.1 time: 0.159206 Aug 24 03:27:07.171264 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6274/7266] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:07 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:08.057979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37bdaa97-87be-4b24-98fd-3ba4a5ac0af4", "name": "network-vif-deleted", "tag": "6849009f-cd74-41c3-a158-e55bb400b839"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:08.069647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:08.070161 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:08.070666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:08.083205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] Creating event network-vif-deleted:6849009f-cd74-41c3-a158-e55bb400b839 for instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 on n-h2-854121-3 Aug 24 03:27:08.089309 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-80d44f23-3e30-424a-a303-642482cb898d req-d84d8ab2-3f26-4817-8bdf-2ae26ceba244 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 Aug 24 03:27:08.090855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6275/7267] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:27:08.195019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:08.195736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:08.203122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:08.203624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:08.204072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:08.204809 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:08.205272 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:08.205708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:08.239675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:08.240175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:08.240628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:08.241120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lazy-loading 'fault' on Instance uuid 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:27:08.284948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:08.292661 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-75f30e03-e316-4841-8ec3-2fd967432f7d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 200 len: 1357 microversion: 2.1 time: 0.102664 Aug 24 03:27:08.293775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6276/7268] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:08 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:09.314837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:09.315456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:09.322325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:09.322821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:09.323279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:09.323980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:09.324450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:09.324932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:09.338142 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] HTTP exception thrown: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Request method failure captured: Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 HTTP/1.1 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZhJdJjHAB3oCwRWfR15hONbaBvVWeFWsjkieh-0GHtl7_stzvtghjLUmUsx99s7Usefm9co92oO24XpZPCJO5RyiPj3JmPtgLuqWhHctDQv0_AZkiVd89e9rel6L6wSzP1KfTWvqSvcxUtABazXRw0ZI4cTJmpXDUaIFLkTdKURCOI Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d1aa5e8123664787ae37579283e30314 Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '37bdaa97-87be-4b24-98fd-3ba4a5ac0af4'} Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:27:09.339778 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Returning 404 to user: Instance 37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0d060392-4a2f-47a0-9344-b70ca9f8f663 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4" status: 404 len: 111 microversion: 2.1 time: 0.030359 Aug 24 03:27:09.345075 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6277/7269] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:09 2022] GET /compute/v2.1/servers/37bdaa97-87be-4b24-98fd-3ba4a5ac0af4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:27:12.306614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a91e79de-f636-4f8c-b86a-7d10a2b94948 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '.version_select at 0x7f6b91ed1700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:12.311732 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a91e79de-f636-4f8c-b86a-7d10a2b94948 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [f453edae-6459-4870-82e9-e93e63086404] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:27:13.321048 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-a91e79de-f636-4f8c-b86a-7d10a2b94948 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [f453edae-6459-4870-82e9-e93e63086404] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 49768. Aug 24 03:27:13.342400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a91e79de-f636-4f8c-b86a-7d10a2b94948 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1284855782" status: 202 len: 0 microversion: 2.1 time: 1.039393 Aug 24 03:27:13.342988 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6278/7270] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 03:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1284855782 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:27:13.374835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cd768150-c0f0-45ac-ab73-0775503c6920 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: .version_select at 0x7f6b9148f9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2141197349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlMEfbq49GY/UPmsV3z+fqRUcv33hNqF3QcWgrqR2zirlxpHQz6R1yLxUSwN4UK5gXTEUKHDHfSH9PAMDEvs+jCPyc4mYtstGLeZziheYKbh2CKcRXbgE5DT+4w0jG82Q=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:13.390458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cd768150-c0f0-45ac-ab73-0775503c6920 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:27:13.395600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-cd768150-c0f0-45ac-ab73-0775503c6920 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:27:13.420524 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cd768150-c0f0-45ac-ab73-0775503c6920 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049603 Aug 24 03:27:13.421192 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6279/7271] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:27:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:27:18.895695 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-826049218", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "networks": [{"uuid": "8ce37935-ca97-4e7f-b080-3250a55ee570"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2141197349", "security_groups": [{"name": "tempest-secgroup-smoke-378143893"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:19.059591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] validate_networks() for [('8ce37935-ca97-4e7f-b080-3250a55ee570', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:27:19.330252 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.504191 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:27:19.504647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:27:19.505167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:27:19.505589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:27:19.506276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:27:19.518256 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:19.518758 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:19.519207 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:19.520056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:19.520527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:19.520993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:19.539267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:27:19.545087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Getting quotas for user d1aa5e8123664787ae37579283e30314 and project 5a1b3f43036b420f9c84999f70f3ce14. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:27:19.559463 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:27:19.561860 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:27:19.614152 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-686ab825-21c9-4e0e-81f2-e8896e1623a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.723739 Aug 24 03:27:19.620917 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6280/7272] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:27:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:27:19.626515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-46f9af50-8c58-4e20-9ab6-2097d7673aa6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:19.627139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-46f9af50-8c58-4e20-9ab6-2097d7673aa6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:19.693113 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-46f9af50-8c58-4e20-9ab6-2097d7673aa6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:19.704732 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-46f9af50-8c58-4e20-9ab6-2097d7673aa6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1266 microversion: 2.1 time: 0.082172 Aug 24 03:27:19.706117 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6281/7273] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:19 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:20.726807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:20.727445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:20.735880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:20.736396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:20.736886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:20.737802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:20.738457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:20.738911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:20.812030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:20.821153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a8418c16-65bc-418c-8b62-cd6266234cae tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1318 microversion: 2.1 time: 0.098029 Aug 24 03:27:20.832893 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6282/7274] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:20 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:21.845309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:21.846600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:21.854115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:21.854618 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:21.855107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:21.855822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:21.856285 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:21.856738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:22.044067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:22.053067 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5495df78-faf2-4d70-bfca-267b655495d3 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.211554 Aug 24 03:27:22.054114 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6283/7275] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:21 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:22.811977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be13b39-af11-4f35-838b-33e5a59a4822", "tag": "3def13b0-973d-4e40-a56d-f9fed3bea0e2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:22.823391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:22.824202 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:22.824652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:22.835980 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] Creating event network-changed:3def13b0-973d-4e40-a56d-f9fed3bea0e2 for instance 6be13b39-af11-4f35-838b-33e5a59a4822 on n-h1-854121-3 Aug 24 03:27:22.841367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f90d024b-7420-470b-be24-c455f8e0ad2e req-28ecf95d-2677-4ae9-bc82-2a0d5622d7be service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033589 Aug 24 03:27:22.842546 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6284/7276] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:27:23.075918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:23.076636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:23.082837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:23.083346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:23.083808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:23.084543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:23.085047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:23.085496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:23.225867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:23.234229 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54036f98-aef5-4ca6-b1bf-0c7118eb549a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.163398 Aug 24 03:27:23.235144 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6285/7277] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:23 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:24.255828 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:24.256704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:24.264530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:24.265060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:24.265511 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:24.266214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:24.266689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:24.267126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:24.401842 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:24.409649 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3718491f-ac0b-4dd4-ab69-e868ecc30a40 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.158062 Aug 24 03:27:24.410217 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6286/7278] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:24 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:25.430629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:25.431305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:25.440168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:25.440672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:25.441152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:25.441875 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:25.442347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:25.442791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:25.578302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:25.586431 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c2c77109-2e3f-4259-81b2-747e84c8efeb tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.159765 Aug 24 03:27:25.587067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6287/7279] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:25 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:26.608504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:26.609209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:26.616258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:26.616832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:26.617293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:26.618009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:26.618485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:26.618926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:26.766360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:26.774131 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c052e8e-8572-434f-896f-599306a3400d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.170049 Aug 24 03:27:26.774713 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6288/7280] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:26 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:27.800361 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:27.801053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:27.807879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:27.809009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:27.809457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:27.810154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:27.810619 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:27.811054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:27.944925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:27.952633 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-39fb08e2-3344-4de0-8c24-e89cd0296c19 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.156098 Aug 24 03:27:27.953239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6289/7281] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:27 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:28.973090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:28.973741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:28.981429 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:28.981927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:28.982373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:28.983073 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:28.983536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:28.983970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:29.114716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:29.122946 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d36ff8ac-6bba-4f46-92c1-11ecbdfab4fa tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.153739 Aug 24 03:27:29.123525 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6290/7282] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:28 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:30.068996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.069826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.125626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be13b39-af11-4f35-838b-33e5a59a4822", "name": "network-vif-plugged", "status": "completed", "tag": "3def13b0-973d-4e40-a56d-f9fed3bea0e2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:30.135387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:30.136381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:30.136867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:30.147892 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] Creating event network-vif-plugged:3def13b0-973d-4e40-a56d-f9fed3bea0e2 for instance 6be13b39-af11-4f35-838b-33e5a59a4822 on n-h1-854121-3 Aug 24 03:27:30.153500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-13db59f4-7765-4085-9671-ae8dde9cc502 req-da30a858-f232-4b5d-865e-13157c062d55 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088764 Aug 24 03:27:30.154419 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6291/7283] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:27:30.160309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:30.161046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:30.167003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:30.168022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:30.168477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:30.169211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:30.169682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:30.170126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:30.314152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:30.321919 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-abe2e522-29db-49b3-b667-b7884547dab2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.166129 Aug 24 03:27:30.322490 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6292/7284] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:30 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:31.341812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:31.342401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:31.349212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:31.349703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:31.350150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:31.350853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:31.351317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:31.351751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:31.481274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:31.489177 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4ec3c785-72d7-4989-bcbe-3a7d8c93631a tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1391 microversion: 2.1 time: 0.151366 Aug 24 03:27:31.489744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6293/7285] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:31 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:32.510870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:32.511701 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:32.519110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:32.519611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:32.520064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:32.520814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:32.521282 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:32.521729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:32.657782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:32.666008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-852b4622-1e16-4e45-b1bb-3f1f7d7c1717 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1563 microversion: 2.1 time: 0.159216 Aug 24 03:27:32.666809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6294/7286] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:32 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:32.686192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:32.686811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:32.693165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:32.693681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:32.694141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:32.694901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:32.695375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:32.695827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:32.830876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:32.838591 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d5be849b-9106-4472-9703-5a123b442225 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1563 microversion: 2.1 time: 0.156605 Aug 24 03:27:32.839670 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6295/7287] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:32 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:34.507932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:27:34.508699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:27:34.516182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:34.516694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:34.517302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:34.518021 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:34.518492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:34.518937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:34.656118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:27:34.664056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-739c412c-d470-4be5-9ac7-266c2dd350d2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1563 microversion: 2.1 time: 0.160433 Aug 24 03:27:34.664643 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6296/7288] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:27:34 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:27:34.669750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be13b39-af11-4f35-838b-33e5a59a4822", "tag": "3def13b0-973d-4e40-a56d-f9fed3bea0e2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:27:34.678900 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:27:34.679402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:27:34.679859 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:27:34.694137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] Creating event network-changed:3def13b0-973d-4e40-a56d-f9fed3bea0e2 for instance 6be13b39-af11-4f35-838b-33e5a59a4822 on n-h1-854121-3 Aug 24 03:27:34.699292 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5a37c1ab-a9cf-4a64-a898-30ba229faa31 req-6d161401-2ca7-4310-b269-b6d504465416 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033471 Aug 24 03:27:34.700087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6297/7289] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:07.941476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.942790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=86 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:08.147510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:08.149964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:08.156213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:08.156710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:08.157188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:08.157892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:08.158385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:08.158825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:08.225354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-234ee74c-3f10-4a81-8b4f-32bf19cf594d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action" status: 200 len: 24576 microversion: 2.1 time: 0.286639 Aug 24 03:28:08.225908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6298/7290] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:28:07 2022] POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action => generated 24576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:38.694997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:38.695637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:38.698751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.699435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.705607 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:38.706109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:38.706566 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:38.707278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:38.707751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:38.708200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:38.732071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lazy-loading 'flavor' on Instance uuid 6be13b39-af11-4f35-838b-33e5a59a4822 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:28:38.798134 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43aa1ca2-7172-4fc9-be6b-57a75f86aee4 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action" status: 202 len: 0 microversion: 2.1 time: 0.107381 Aug 24 03:28:38.798879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6299/7291] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:28:38 2022] POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:28:38.807820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:38.808535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:38.814715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:38.815210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:38.815661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:38.816423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:38.816867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:38.817333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:38.949225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:38.956954 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7081b00d-5ef9-4014-b781-82c5e8f30949 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1689 microversion: 2.1 time: 0.153718 Aug 24 03:28:38.957554 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6300/7292] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:38 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:39.980139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:39.980787 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:39.987897 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:39.988398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:39.988956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:39.989692 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:39.990162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:39.990602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:40.123372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:40.131854 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a78d266b-6175-47ec-aa02-10ee9725b5e6 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1689 microversion: 2.1 time: 0.155968 Aug 24 03:28:40.132426 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6301/7293] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:39 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:41.152370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:41.153092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:41.159920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:41.160409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:41.160890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:41.161585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:41.162049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:41.162486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:41.295747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:41.303479 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6a048ecb-56cd-418d-867d-237b1be588e1 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1672 microversion: 2.1 time: 0.154981 Aug 24 03:28:41.304045 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6302/7294] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:41 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:42.395148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:42.397544 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:42.405163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.405664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.406120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.406838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.407308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.407754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.473435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96a6dc47-0532-4da1-b0fa-98ed0f9c76ea tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action" status: 200 len: 35928 microversion: 2.1 time: 0.082003 Aug 24 03:28:42.480793 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6303/7295] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:28:42 2022] POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action => generated 35928 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:28:42.487007 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:42.487704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:42.495970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.496472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.496958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.497680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.498155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.498600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.568551 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a79f1ee-e0b3-48f9-847d-7e0ffacc8f87 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action" status: 202 len: 0 microversion: 2.1 time: 0.085634 Aug 24 03:28:42.572592 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6304/7296] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:28:42 2022] POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:28:42.578212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:42.578924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:42.586214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.586723 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.587694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.588425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:42.588911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:42.589363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:42.728409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:42.736457 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f9e24c5-2db3-439d-a52f-3d05828d96a2 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1678 microversion: 2.1 time: 0.162715 Aug 24 03:28:42.739044 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6305/7297] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:42 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:43.759363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:43.760055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:43.767052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:43.767568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:43.768019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:43.768840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:43.769340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:43.769778 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:43.904455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:43.912242 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc998c36-4621-44df-a08e-68e602a90f05 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1678 microversion: 2.1 time: 0.157655 Aug 24 03:28:43.913056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6306/7298] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:43 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:44.933704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:44.934338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:44.941320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:44.941829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:44.942283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:44.942991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:44.943476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:44.943916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:45.075596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:45.083344 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5213a917-270b-4129-992f-1f13c8325b5d tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1681 microversion: 2.1 time: 0.153586 Aug 24 03:28:45.083918 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6307/7299] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:44 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:45.181792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:45.183993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:45.190038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:45.190533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:45.190980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:45.191683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:45.192154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:45.192591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:45.256460 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a28dff01-4b1d-4d18-8ff9-d16ce0c4d58b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action" status: 200 len: 35928 microversion: 2.1 time: 0.078429 Aug 24 03:28:45.257428 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6308/7300] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:28:45 2022] POST /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822/action => generated 35928 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 03:28:46.569047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:46.569742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:46.577765 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:46.578347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:46.578870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:46.579673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:46.580216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:46.580664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:46.609938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:28:46.692590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4a16ed5-cada-4657-9d1d-d60db66e877b tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 204 len: 0 microversion: 2.1 time: 0.127491 Aug 24 03:28:46.696210 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6309/7301] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:28:46 2022] DELETE /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:28:46.701375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6be13b39-af11-4f35-838b-33e5a59a4822", "tag": "3def13b0-973d-4e40-a56d-f9fed3bea0e2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:46.710525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:46.711004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:46.711452 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:46.723285 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] Creating event network-changed:3def13b0-973d-4e40-a56d-f9fed3bea0e2 for instance 6be13b39-af11-4f35-838b-33e5a59a4822 on n-h1-854121-3 Aug 24 03:28:46.728587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-2e252b96-6fd7-4754-8ab7-8a8e6bb40b9a req-ce90e651-8bc9-4b59-b563-554e6d71e197 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031002 Aug 24 03:28:46.729226 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6310/7302] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:28:46.734171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:46.734986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:46.741767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:46.742274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:46.742728 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:46.744018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:46.744490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:46.744957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:46.878771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:46.886950 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6630b77a-a01b-4a49-9ea2-7e860ecf8576 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1687 microversion: 2.1 time: 0.156598 Aug 24 03:28:46.887526 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6311/7303] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:46 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:28:47.910172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:47.910807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:47.918321 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:47.918829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:47.919286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:47.920002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:47.920471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:47.920956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:47.938985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:48.063107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:48.071510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7583b0c0-5cb4-4e7d-a5ef-cf47854a94ec tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1687 microversion: 2.1 time: 0.164718 Aug 24 03:28:48.072087 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6312/7304] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:47 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:48.934193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6be13b39-af11-4f35-838b-33e5a59a4822", "name": "network-vif-deleted", "tag": "3def13b0-973d-4e40-a56d-f9fed3bea0e2"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:28:48.946754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:48.947258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:48.947729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:48.959615 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] Creating event network-vif-deleted:3def13b0-973d-4e40-a56d-f9fed3bea0e2 for instance 6be13b39-af11-4f35-838b-33e5a59a4822 on n-h1-854121-3 Aug 24 03:28:48.965878 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-397231aa-e297-4f16-a582-99485e9c1e1e req-d0f4acf2-0603-4cfc-a217-f268325b7796 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035286 Aug 24 03:28:48.966708 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6313/7305] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:28:49.094004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:49.094673 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:49.101381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:49.101903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:49.102870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:49.103608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:49.104055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:49.104495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:49.136421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:49.137038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:49.137473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:49.138024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lazy-loading 'fault' on Instance uuid 6be13b39-af11-4f35-838b-33e5a59a4822 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:28:49.184686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa5e8123664787ae37579283e30314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a1b3f43036b420f9c84999f70f3ce14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:28:49.192530 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-824afebd-6500-4c5f-8361-9601167699cf tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 200 len: 1356 microversion: 2.1 time: 0.102938 Aug 24 03:28:49.193134 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6314/7306] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:49 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:28:50.214362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:50.215034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] [instance: 6be13b39-af11-4f35-838b-33e5a59a4822] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:28:50.221287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:50.221792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:50.222247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:50.222960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:28:50.223431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:28:50.223879 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:28:50.238060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] HTTP exception thrown: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Request method failure captured: Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 HTTP/1.1 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZhJdJjHAB3oCwRWfR15hONbaBvVWeFWsjkieh-0GHtl7_stzvtghjLUmUsx99s7Usefm9co92oO24XpZPCJO5RyiPj3JmPtgLuqWhHctDQv0_AZkiVd89e9rel6L6wSzP1KfTWvqSvcxUtABazXRw0ZI4cTJmpXDUaIFLkTdKURCOI Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5a1b3f43036b420f9c84999f70f3ce14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 5a1b3f43036b420f9c84999f70f3ce14 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1710861573 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: d1aa5e8123664787ae37579283e30314 Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1710861573-project Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '6be13b39-af11-4f35-838b-33e5a59a4822'} Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:28:50.239721 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Returning 404 to user: Instance 6be13b39-af11-4f35-838b-33e5a59a4822 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-96ea99a9-9f93-46cf-a608-497be7d5782e tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822" status: 404 len: 111 microversion: 2.1 time: 0.031054 Aug 24 03:28:50.245894 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6315/7307] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:28:50 2022] GET /compute/v2.1/servers/6be13b39-af11-4f35-838b-33e5a59a4822 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:28:53.520825 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44f8e90e-6b3d-449d-95d8-452a55ee1782 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] Calling method '.version_select at 0x7f6b90db2820>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:28:53.546305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44f8e90e-6b3d-449d-95d8-452a55ee1782 tempest-TestNetworkAdvancedServerOps-1710861573 tempest-TestNetworkAdvancedServerOps-1710861573-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2141197349" status: 202 len: 0 microversion: 2.1 time: 0.029265 Aug 24 03:28:53.546891 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6316/7308] 10.222.0.49 () {58 vars in 1284 bytes} [Wed Aug 24 03:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2141197349 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:29:04.187734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=14 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:04.189440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:04.408993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d03f336c-eb73-4c27-b356-390e8dbe3cd2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'create', calling method: .version_select at 0x7f6b91e5c160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1366954703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq+D7Q7/rr+kniW6nxOBC246jZ5NzWMhZkuORasSbxq9y/Erg4ub/mpml/vEPsuYvIzpo3R+eSd6An4vK3sz4KCfB/Bk2LVvoxNnxCjZktN5cTP4N56qpiAIqqQKR8t/Q=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:04.424868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d03f336c-eb73-4c27-b356-390e8dbe3cd2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for project 2379590449194279a8fa072dff150353. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:29:04.430899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-d03f336c-eb73-4c27-b356-390e8dbe3cd2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for user 70ecb493a7ed469294c8397a30a21138 and project 2379590449194279a8fa072dff150353. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:29:04.456945 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d03f336c-eb73-4c27-b356-390e8dbe3cd2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.272556 Aug 24 03:29:04.457702 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6317/7309] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:29:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:05.506975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1357619242", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1366954703", "security_groups": [{"name": "tempest-secgroup-smoke-791227673"}], "networks": [{"uuid": "4075849e-6f3d-4b27-9b86-3e61ea9fa8ef"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:05.613233 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] validate_networks() for [('4075849e-6f3d-4b27-9b86-3e61ea9fa8ef', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:29:05.980357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:29:05.980908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:29:05.982088 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:29:05.982532 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:29:05.982966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:29:05.991847 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:05.992414 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:05.992885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:05.993888 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:05.994408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:05.994911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:06.011945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for project 2379590449194279a8fa072dff150353. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:29:06.017243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for user 70ecb493a7ed469294c8397a30a21138 and project 2379590449194279a8fa072dff150353. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:29:06.030047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:29:06.032318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:29:06.078657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2109132-8a78-4e43-b3df-527f961f21fa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.576540 Aug 24 03:29:06.079319 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6318/7310] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:29:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:29:06.090562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-05486015-b296-4a1f-9c65-fda8ab4d1545 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:06.091183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-05486015-b296-4a1f-9c65-fda8ab4d1545 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:06.145574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-05486015-b296-4a1f-9c65-fda8ab4d1545 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:06.154329 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-05486015-b296-4a1f-9c65-fda8ab4d1545 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1247 microversion: 2.1 time: 0.067875 Aug 24 03:29:06.154913 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6319/7311] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:06 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:07.176605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:07.177302 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:07.185719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:07.186238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:07.187125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:07.188472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:07.188987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:07.189581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:07.295178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:07.304404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5229c5c1-6856-46e1-b348-314f86c71e2d tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1307 microversion: 2.1 time: 0.131374 Aug 24 03:29:07.305983 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6320/7312] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:07 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1307 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:08.326932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:08.327782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:08.335549 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:08.336209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:08.336949 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:08.337883 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:08.338460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:08.338967 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:08.569627 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:08.578512 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9e6be048-f274-4343-a9ba-a6965c8f1bab tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.255381 Aug 24 03:29:08.579415 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6321/7313] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:08 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:08.893730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:08.908922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:08.909658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:08.910107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:08.924060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] Creating event network-changed:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h2-854121-3 Aug 24 03:29:08.931655 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4edfa6d2-6971-45d4-8ae7-96fa13208ca9 req-648836b9-a2f5-4ccd-aedb-ebab0b1df77e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051381 Aug 24 03:29:08.932600 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6322/7314] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:29:09.600059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:09.600697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:09.608401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:09.608956 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:09.609410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:09.610125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:09.610598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:09.611043 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:09.743424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:09.751201 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4617bea7-1ba1-402b-b3d2-613675b349b4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.155520 Aug 24 03:29:09.751775 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6323/7315] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:09 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:10.771538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:10.772177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:10.779213 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:10.779708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:10.780155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:10.780901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:10.781418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:10.781789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:10.917483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:10.925366 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2a1c9757-90e4-4ddb-a849-3d7d61bcfd07 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.157741 Aug 24 03:29:10.925941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6324/7316] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:10 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:11.946784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:11.948211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:11.955071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:11.955578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:11.956226 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:11.957084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:11.957492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:11.958070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:12.102894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:12.110879 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9009c5fb-04fd-4bb3-9aa5-f6ea48ffd7c6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.168087 Aug 24 03:29:12.111491 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6325/7317] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:11 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:13.131482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:13.132428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:13.139802 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:13.140301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:13.140768 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:13.141473 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:13.141939 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:13.142375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:13.276684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:13.284461 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b817e66d-78b6-4cf9-a29c-aa45cd7cddf4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.156882 Aug 24 03:29:13.285058 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6326/7318] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:13 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:14.010003 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "name": "network-vif-plugged", "status": "completed", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:14.019334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:14.019928 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:14.020278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:14.032576 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] Creating event network-vif-plugged:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h2-854121-3 Aug 24 03:29:14.037544 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-8b9a64dd-efd9-47e0-8123-accc1581e8f8 req-c847d32b-d326-4a4e-8850-dd1b6fc87ed3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Aug 24 03:29:14.038145 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6327/7319] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:29:14.307211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:14.307921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:14.314190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:14.314688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:14.315141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:14.315846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:14.316318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:14.316776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:14.450602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:14.458316 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b53ea3b1-a8be-4655-b9f5-d6fd2d12ed69 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.156739 Aug 24 03:29:14.458878 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6328/7320] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:14 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:15.479539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:15.480169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:15.487612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:15.488123 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:15.488575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:15.489319 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:15.489790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:15.490260 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:15.624694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:15.633396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-59ec7acc-27dc-49b7-ad78-c8d1d277e693 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1372 microversion: 2.1 time: 0.158191 Aug 24 03:29:15.633980 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6329/7321] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:15 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:16.655478 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:16.656125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:16.658100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:16.658876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:16.666582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:16.667082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:16.667560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:16.668271 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:16.668764 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:16.669204 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:16.800491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:16.808274 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43dbc412-f24f-4714-8999-5ae68a9f8596 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1555 microversion: 2.1 time: 0.156754 Aug 24 03:29:16.808886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6330/7322] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:16 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:16.828974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:29:16.829599 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:29:16.835410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:16.836409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:16.836941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:16.838016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:16.838106 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:16.838504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:16.967445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:29:16.975117 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c35052b7-f48d-4a9b-87d8-17e26cd0aa0f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1555 microversion: 2.1 time: 0.149773 Aug 24 03:29:16.975691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6331/7323] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:29:16 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:29:18.838817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:29:18.849219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:29:18.849703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:29:18.850896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:29:18.865223 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] Creating event network-changed:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h2-854121-3 Aug 24 03:29:18.871711 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4a2c0517-9ef1-4b57-a093-8926b44cde42 req-5f6fc843-d1a0-40d8-a26c-e624426e088a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 Aug 24 03:29:18.872196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6332/7324] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:31:56.135107 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:31:56.135912 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:31:56.136582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:56.137349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=68 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:31:56.142775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:31:56.144056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:56.151652 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.152149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.152593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.153325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:56.153790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:56.154224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:56.179353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lazy-loading 'flavor' on Instance uuid 64e2f257-575a-43fd-ba7f-3aa83f805219 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:31:56.502591 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [9487f1ea-ca4d-467c-b803-05d95f50f9da] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:31:57.149214 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50168. Aug 24 03:31:57.150033 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50166. Aug 24 03:31:57.510126 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [9487f1ea-ca4d-467c-b803-05d95f50f9da] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50170. Aug 24 03:31:57.513379 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d96b47b7-cbaf-4dea-8806-c4b4c6489d88 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219/action" status: 202 len: 0 microversion: 2.1 time: 1.380666 Aug 24 03:31:57.514244 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6333/7325] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:31:56 2022] POST /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219/action => generated 0 bytes in 1382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:31:57.523097 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:57.523807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:57.531295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.531791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.532261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.533018 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:57.533488 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:57.534421 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:57.667411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:57.675934 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5039f967-63f4-4acd-ba83-55c9ac7b264b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.157367 Aug 24 03:31:57.676476 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6334/7326] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:57 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:58.696960 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:58.697646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:58.704494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.705019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.705469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.706655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:58.707116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:58.707548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:58.840633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:31:58.849040 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-1d6ea183-8979-431b-8968-e74cc7a3dab7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.155981 Aug 24 03:31:58.849619 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6335/7327] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:58 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:31:59.874845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:31:59.875527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:31:59.882300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.882792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.883515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:31:59.884215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:31:59.884676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:31:59.885137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:00.026497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:00.034916 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6dca548a-7784-4fd4-8d51-8ae258f6d9a7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.163359 Aug 24 03:32:00.035499 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6336/7328] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:31:59 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:01.057254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:01.057983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:01.064853 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.065356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.065807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.066510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:01.066982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:01.067465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:01.200203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:01.208656 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-90f7a2b6-e0ff-4ea1-9ec1-c32e1fc1cfca tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.155293 Aug 24 03:32:01.209252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6337/7329] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:01 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:02.229822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:02.230518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:02.240824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.240824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.241194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.242353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:02.242353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:02.242784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:02.380193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:02.388373 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ffd591a1-e125-4ead-a27d-1a93ec266dfa tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.162465 Aug 24 03:32:02.389011 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6338/7330] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:02 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:03.410083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:03.410708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:03.417626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.418158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.418611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.419320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:03.419815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:03.420251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:03.550580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:03.558985 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8d9478f3-35d2-4e1b-95ae-e72bf00e57cd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.153314 Aug 24 03:32:03.559589 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6339/7331] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:03 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:04.580005 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:04.580786 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:04.588312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.588857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.589311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.590038 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:04.590994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:04.590994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:04.740273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:04.748012 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b8694e6e-0674-40be-a1ec-b1530d879841 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.172171 Aug 24 03:32:04.748583 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6340/7332] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:04 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:05.770773 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:05.771450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:05.778307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.778807 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.779266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.779970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:05.780439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:05.780926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:05.912039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:05.919997 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bee95c6c-37f6-4eba-a535-ff1a30e49008 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.153961 Aug 24 03:32:05.920564 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6341/7333] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:05 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:06.941696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:06.942343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:06.949246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.949869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.950320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:06.951025 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:06.951486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:06.951929 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:07.085009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:07.092789 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-65f1a58d-b0b2-4c8c-b9e2-1bf2487c1be5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.154968 Aug 24 03:32:07.093365 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6342/7334] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:06 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:08.113880 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:08.114667 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:08.121465 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.121977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.122434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.123142 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:08.123626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:08.124069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:08.256784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:08.265127 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cf2eb0dc-008e-4664-808d-5e505f4583e1 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.155181 Aug 24 03:32:08.265698 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6343/7335] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:08 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:09.290590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:09.291193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:09.298387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.298878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.299416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.300133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:09.300579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:09.301167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:09.433665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:09.441992 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-311dd745-1546-4352-8e4e-e5653f27fc1f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1701 microversion: 2.1 time: 0.155324 Aug 24 03:32:09.442581 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6344/7336] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:09 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:10.465086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:10.465730 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:10.473188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.473682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.474122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.474864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:10.475308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:10.476016 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:10.611797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:10.619541 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-10ec713b-dba3-4a84-852c-224743ad5054 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1701 microversion: 2.1 time: 0.158695 Aug 24 03:32:10.620109 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6345/7337] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:10 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:11.640620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:11.641345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:11.648396 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.648936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.649387 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.650090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:11.650559 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:11.650993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:11.782027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:11.790245 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37362f9b-f608-46df-a8b4-211d4ec60794 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1701 microversion: 2.1 time: 0.153514 Aug 24 03:32:11.790815 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6346/7338] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:11 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:12.811584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:12.812329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:12.819945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.820508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.820950 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.821670 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.822149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.822633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:12.841141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:12.965822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:12.974822 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd3f689e-1789-43c6-a0bf-feb5a449aca0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1701 microversion: 2.1 time: 0.167174 Aug 24 03:32:12.975421 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6347/7339] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:12 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:12.980587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "name": "network-vif-plugged", "status": "completed", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:12.991403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:12.992125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:12.992578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:13.005339 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] Creating event network-vif-plugged:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h2-854121-3 Aug 24 03:32:13.011178 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-12b47e06-c844-40a9-8736-7f20e9861400 req-84b9e2d7-dfd7-42b1-8cc8-26688e271646 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034403 Aug 24 03:32:13.011848 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6348/7340] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:32:13.998865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:13.999580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:14.005836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.006341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.006791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.007489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:14.007994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:14.008688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:14.139257 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:14.147185 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d49ce214-3b9c-4e8b-bbf5-547f4225ae5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1701 microversion: 2.1 time: 0.153441 Aug 24 03:32:14.147754 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6349/7341] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:13 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:15.168994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:15.169639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:15.176585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.177513 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.177815 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.178611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:15.179117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:15.179525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:15.321186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:15.329263 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e2a02b56-d27c-496c-ba20-a992fa5708f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.164290 Aug 24 03:32:15.329855 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6350/7342] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:15 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:16.352570 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:16.353560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:16.361091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.362474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.362994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.364085 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:16.364672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:16.365254 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:16.538306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:16.547410 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cccc0894-cf7f-4775-b994-0c67a811fb28 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.199010 Aug 24 03:32:16.548609 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6351/7343] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:16 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:17.570299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:17.573139 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:17.586070 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.586677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.587368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.588167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:17.588726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:17.589283 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:17.759455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:17.768153 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5ba0812-efcd-44f7-a501-84df5eac136a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.202306 Aug 24 03:32:17.768939 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6352/7344] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:17 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:18.789756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:18.791224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:18.799454 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.799976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.800562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.801499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:18.801980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:18.802425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:18.956172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:18.964605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ead3c929-3070-4983-abaf-4fbdb11dd9a6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.179167 Aug 24 03:32:18.965920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6353/7345] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:18 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:19.995328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:19.997431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:20.011868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.012562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.013238 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.014434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:20.015145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:20.015589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:20.161214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:20.170171 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b1c9617b-9520-49d3-8415-90c01d046515 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.183532 Aug 24 03:32:20.171908 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6354/7346] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:19 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:21.193724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:21.195199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:21.202348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.202863 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.203458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.204037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:21.204501 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:21.204973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:21.352389 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:21.360475 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6d9d0b3d-6ce7-45e1-9321-a91a110d8a5b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.171377 Aug 24 03:32:21.361342 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6355/7347] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:21 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:22.385854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:22.387446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:22.395918 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.396426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.396925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.397791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:22.398420 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:22.398886 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:22.568263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:22.578112 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-180050d0-61d6-4006-bbbe-cefb6f8d3be6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.196463 Aug 24 03:32:22.579275 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6356/7348] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:22 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:23.186356 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:32:23.186618 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:32:23.270389 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:32:23.270617 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:32:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:32:23.602464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:23.603137 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:23.615416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.615416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.615924 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.617001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:23.617755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:23.618347 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:23.787299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:23.795323 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-19c0c8b5-f484-413c-824e-d5fc913e2931 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.198938 Aug 24 03:32:23.796489 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6357/7349] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:23 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:32:24.819976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:24.820952 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:24.827527 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.828023 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.828474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.829214 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:24.829684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:24.830125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:24.966047 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:24.974060 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-165d8c88-6f65-491f-8f02-e17c1efde390 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1696 microversion: 2.1 time: 0.158810 Aug 24 03:32:24.974635 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6358/7350] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:24 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:25.996126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:25.996841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:26.004149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.004648 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.005124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.005830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.006301 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.006743 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.135869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:26.144556 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d7445a45-b55e-42bd-8e60-7c5e34ac6267 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1678 microversion: 2.1 time: 0.152308 Aug 24 03:32:26.145152 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6359/7351] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:25 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:26.898258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "name": "network-vif-unplugged", "status": "completed", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:26.903125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=55 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:26.909496 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:26.909993 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:26.910506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:26.921980 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] Creating event network-vif-unplugged:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h2-854121-3 Aug 24 03:32:26.928215 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b1003392-14d5-4918-a870-0b3daef55b4e req-e6a56cfb-e713-4b93-8220-01e1e4647f4e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033611 Aug 24 03:32:26.928841 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6360/7352] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:27.167104 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:27.167756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:27.174048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.174528 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.174969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.175663 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:27.176122 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:27.176553 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:27.315329 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:27.323385 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a1511f5f-69bb-4b1d-a3e8-9d351981d15a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1678 microversion: 2.1 time: 0.161473 Aug 24 03:32:27.323940 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6361/7353] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:27 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:28.346851 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.347541 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.354485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.354986 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.355438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.356141 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.356610 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.357077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.487935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.495721 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c277bde-7169-4743-8d94-9f624a935f43 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1621 microversion: 2.1 time: 0.152796 Aug 24 03:32:28.496238 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6362/7354] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1621 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:28.516244 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:28.516884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.522601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.523100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.523551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.524251 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.524737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.525179 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.608646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128567) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:32:28.681149 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-de844121-d673-4baf-80ec-ef72e8e33a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219/action" status: 202 len: 0 microversion: 2.1 time: 0.168058 Aug 24 03:32:28.681777 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6363/7355] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:32:28 2022] POST /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:32:28.690077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:28.690794 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:28.697149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.697657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.698115 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.698838 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:28.699309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:28.699750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:28.719994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:28.841274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:28.850094 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4f9e4180-b616-4a41-a3bb-6295511fd309 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1629 microversion: 2.1 time: 0.164177 Aug 24 03:32:28.851088 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6364/7356] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:28 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1629 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:29.871417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:29.872121 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:29.878999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.879498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.879951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:29.880657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:29.881153 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:29.881593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.020945 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:30.029224 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-df5f46a8-b100-4a31-8992-c1337df003e4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.161574 Aug 24 03:32:30.029987 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6365/7357] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:29 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:30.830818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:30.844752 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:30.846338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:30.846338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:30.858014 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] Creating event network-changed:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h1-854121-3 Aug 24 03:32:30.864307 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e06324a2-352d-437a-9579-0785cff3e037 req-c9e09f54-939a-4659-a9f0-a24931bd8c90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098454 Aug 24 03:32:30.865032 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6366/7358] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:31.052850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:31.053598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:31.059823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.060331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.060985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.061755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:31.062229 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:31.062671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:31.510151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:31.518734 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5871fc82-11f7-4b0a-bb84-826156e0fe8a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.470967 Aug 24 03:32:31.519398 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6367/7359] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:31 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:32.539870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:32.541569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:32.550008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.550596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.551133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.552040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:32.552733 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:32.558193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:32.711493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:32.719993 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b5aa1ab9-0fc9-4e82-9217-a1b148be2a6f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.184053 Aug 24 03:32:32.721241 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6368/7360] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:32 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:33.742568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:33.743218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:33.750368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.750874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.751327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.752052 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:33.752706 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:33.753328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:33.897833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:33.906244 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-66f764e5-8ec8-4857-b335-a5cae5ca9642 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.167455 Aug 24 03:32:33.910079 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6369/7361] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:33 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:34.927747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:34.928675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:34.935294 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.935816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.936273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:34.937041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:34.937732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:34.938185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:35.086101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:35.094535 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5023868-215c-4453-adac-76f08e0abc04 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.170724 Aug 24 03:32:35.095477 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6370/7362] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:34 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:36.116240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:36.117498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:36.125568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.126158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.127464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.128288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:36.128887 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:36.129669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:36.278148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:36.286318 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e1818775-54a9-42d2-8fb4-32c0944ee308 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.173897 Aug 24 03:32:36.286903 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6371/7363] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:36 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:37.307798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:37.308514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:37.316682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.317296 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.317824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.318660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:37.319230 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:37.319740 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:37.481388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:37.490472 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7f5e678d-9ff6-47fc-ad21-8ad5ba3599b7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.186471 Aug 24 03:32:37.491411 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6372/7364] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:37 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:38.514547 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:38.515261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:38.523906 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.524684 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.525245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.526237 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:38.526798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:38.527485 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:38.678129 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:38.686546 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6535c736-dc60-4a27-af77-2c5f36194fce tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.176577 Aug 24 03:32:38.687139 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6373/7365] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:38 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:39.708418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:39.709280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:39.717371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.718019 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.718356 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.719035 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:39.719508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:39.719953 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:39.868224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:39.877780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-91e69468-93e8-4b14-96c8-863338d457e5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.173872 Aug 24 03:32:39.878737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6374/7366] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:39 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:40.899584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:40.900407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:40.907548 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.908051 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.908505 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:40.909270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:40.909726 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:40.910327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:41.048013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:41.055836 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc360d02-bcec-46b5-b592-be130fbc3793 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.160234 Aug 24 03:32:41.056624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6375/7367] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:40 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:42.076616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:42.077279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:42.083998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.084491 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.084980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.085689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:42.086151 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:42.086590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:42.225211 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:42.233642 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f08bbfef-9872-4b22-afdf-2759ae1031f8 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.160895 Aug 24 03:32:42.234338 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6376/7368] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:42 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:43.255456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:43.256119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:43.263148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.263796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.264383 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.264954 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:43.265430 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:43.265870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:43.402557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:43.411362 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-27c5c42f-ad52-4452-8607-dbecd60f87eb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.159822 Aug 24 03:32:43.411932 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6377/7369] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:43 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:44.435550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:44.436655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:44.448818 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.449729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.450732 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.451394 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:44.452206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:44.452662 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:44.584889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:44.592603 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98b56ebb-638e-4aa3-be54-ff1660ec2637 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.162535 Aug 24 03:32:44.593209 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6378/7370] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:44 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:45.613681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:45.614357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:45.621279 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.621771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.622404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.623117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:45.623576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:45.624009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:45.762514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:45.771156 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-efa00d28-52af-4b9c-947e-e1b2b8a03d01 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.161348 Aug 24 03:32:45.771737 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6379/7371] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:45 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:46.792521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:46.793242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:46.801040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.801539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.801987 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.802704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:46.803168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:46.803601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:46.939980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:46.947754 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-04ba3d61-2cb3-4f03-9d2e-4a930109e170 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.159406 Aug 24 03:32:46.948325 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6380/7372] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:46 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:47.969174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:47.969927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:47.977343 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:47.977517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:47.977834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:47.978580 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:47.979055 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:47.979978 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:48.129205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:48.132872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:32:48.138411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cbf42938-9329-4bf8-a4c1-6c286c7ef2b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.173052 Aug 24 03:32:48.139012 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6381/7373] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:47 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:49.159776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:49.160380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:49.167974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.168628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.169274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.169988 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.170459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.170895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.324754 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:49.334085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2831376-e79a-4673-8353-ab3dee5ae483 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.178201 Aug 24 03:32:49.334681 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6382/7374] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:49 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:49.853596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "name": "network-vif-plugged", "status": "completed", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:32:49.864263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:49.864781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:49.865231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:49.877396 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] Creating event network-vif-plugged:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h1-854121-3 Aug 24 03:32:49.882477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-d62be42e-2e8e-4401-8652-c511fa6c0552 req-6ee31dbc-4cca-47e1-b992-74fba2d56dbe service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101860 Aug 24 03:32:49.883090 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6383/7375] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:32:50.357525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:50.358232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:50.364479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.365006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.365455 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.366181 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:50.366647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:50.367082 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:50.497729 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:50.505504 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-995875f1-357c-4837-ae85-8fed21acaf6b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.153219 Aug 24 03:32:50.506082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6384/7376] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:50 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:51.527630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:51.528270 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:51.535431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.535910 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.536358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.537236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:51.537874 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:51.538336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:51.679632 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:51.690341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b4cb6007-7d7b-4090-8e3e-e86fa33c1984 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1687 microversion: 2.1 time: 0.166541 Aug 24 03:32:51.690942 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6385/7377] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:51 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:32:52.711539 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:32:52.712235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:32:52.720919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.721479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.721884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.722602 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:32:52.723089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:32:52.723526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:32:52.862581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:32:52.870617 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d06723c9-547a-4024-b23f-9ff8d8a145ac tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1674 microversion: 2.1 time: 0.162977 Aug 24 03:32:52.871196 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6386/7378] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:32:52 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:33.801865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:33.805178 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=26 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:33.811087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:33.812054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:33.824250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.825258 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.826095 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.827432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:33.828311 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:33.829165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:33.858144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:34:33.957056 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fa79cb85-96f7-4d95-a514-5cfcdd198767 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 204 len: 0 microversion: 2.1 time: 0.157085 Aug 24 03:34:33.964920 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6387/7379] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:34:33 2022] DELETE /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 03:34:34.077375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:34.086843 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.087338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.087782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.099120 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] Creating event network-changed:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h1-854121-3 Aug 24 03:34:34.104345 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5b808927-941d-4c08-9647-cdb640f05714 req-454a3196-8d3e-4f01-80de-e39584d4cd18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144170 Aug 24 03:34:34.104995 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6388/7380] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:34:34.110588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:34.111306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:34.117798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.118427 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.118738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.119456 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:34.119922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:34.120357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:34.271130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:34.282119 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-996515e8-dfbc-4734-8f94-b81c42a2d95b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.175915 Aug 24 03:34:34.293056 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6389/7381] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:34 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:34:35.303742 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:35.304416 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:35.312380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.312913 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.313362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.314077 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:35.314578 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:35.315009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:35.825755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:35.834829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-98a1de8f-b4a2-44ba-b957-502eeb4b32cb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 200 len: 1680 microversion: 2.1 time: 0.534918 Aug 24 03:34:35.835704 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6390/7382] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:35 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 1680 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:36.120562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e2f257-575a-43fd-ba7f-3aa83f805219", "name": "network-vif-deleted", "tag": "e5ab1060-1734-47cb-b6e4-ac45f8a93272"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:36.131024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.131525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.132417 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.146871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] Creating event network-vif-deleted:e5ab1060-1734-47cb-b6e4-ac45f8a93272 for instance 64e2f257-575a-43fd-ba7f-3aa83f805219 on n-h1-854121-3 Aug 24 03:34:36.152405 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-83dba49d-407b-49e2-a0d5-565af37c43f2 req-440607a0-31dc-44db-85d5-0d6c8aa4228a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Aug 24 03:34:36.153010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6391/7383] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:36.858791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:36.859533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 64e2f257-575a-43fd-ba7f-3aa83f805219] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:36.867064 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.867620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.868078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.873823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:36.873823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:36.873823 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:36.883712 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] HTTP exception thrown: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Request method failure captured: Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 HTTP/1.1 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZr7VyHRLaxaVSzbqiZRgRKWEL9Is4SwwlsMnd9eNJBuDCqlaupZfU4c0_nwo0YpwAaV-jWOVAwoGcK5_uC8vL4eSCVTjWpk5wZL36qPt7J9gaavgC9yUz5kxyGduE57LOyqZknWLOdP9_yndd2UNj7AgQWoeP4vlpv-fb3Z0emxknA Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 2379590449194279a8fa072dff150353 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestShelveInstance-296143170 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2379590449194279a8fa072dff150353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2379590449194279a8fa072dff150353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2379590449194279a8fa072dff150353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2379590449194279a8fa072dff150353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestShelveInstance-296143170 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 2379590449194279a8fa072dff150353 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestShelveInstance-296143170 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestShelveInstance-296143170-project Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 70ecb493a7ed469294c8397a30a21138 Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestShelveInstance-296143170-project Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '64e2f257-575a-43fd-ba7f-3aa83f805219'} Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:34:36.885671 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Returning 404 to user: Instance 64e2f257-575a-43fd-ba7f-3aa83f805219 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d9764014-be39-4374-a942-42b304c697f9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219" status: 404 len: 111 microversion: 2.1 time: 0.033206 Aug 24 03:34:36.891069 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6392/7384] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:36 2022] GET /compute/v2.1/servers/64e2f257-575a-43fd-ba7f-3aa83f805219 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:34:37.061561 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fea5eb1a-d77b-4834-946e-45ebb4044da6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '.version_select at 0x7f6b91e71700>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:37.095506 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fea5eb1a-d77b-4834-946e-45ebb4044da6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366954703" status: 202 len: 0 microversion: 2.1 time: 0.037850 Aug 24 03:34:37.096264 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6393/7385] 10.222.0.49 () {58 vars in 1254 bytes} [Wed Aug 24 03:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1366954703 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:34:37.122165 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01ff16d9-01c2-4846-a32e-9bcdc876f6da tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'create', calling method: .version_select at 0x7f6b91e05c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-93953084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEeCqmE+Qhxv19HWa0vE928kiDqvevL1rEyzy7/o3xHiiqna/N2VayeKQFCDBZTbwTwBduYZCj3/cUZWKB4x9dEly35ORw0xbPWKIRkBx6tXyAb4ubuA3VGFMn4ICTKZw=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:37.139718 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-01ff16d9-01c2-4846-a32e-9bcdc876f6da tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for project 2379590449194279a8fa072dff150353. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:37.144942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-01ff16d9-01c2-4846-a32e-9bcdc876f6da tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for user 70ecb493a7ed469294c8397a30a21138 and project 2379590449194279a8fa072dff150353. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:37.168389 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01ff16d9-01c2-4846-a32e-9bcdc876f6da tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.050064 Aug 24 03:34:37.169030 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6394/7386] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:34:37 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:54.654469 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:54.655248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:54.656054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:34:54.660925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-205125404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-93953084", "security_groups": [{"name": "tempest-secgroup-smoke-8597932"}], "networks": [{"uuid": "4075849e-6f3d-4b27-9b86-3e61ea9fa8ef"}], "block_device_mapping_v2": [{"uuid": "7109acfe-db3e-44ae-bd6a-45223fdd6351", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:54.774677 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] validate_networks() for [('4075849e-6f3d-4b27-9b86-3e61ea9fa8ef', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:34:55.156808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:34:55.157243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:34:55.158026 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:34:55.158445 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:34:55.158893 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:34:55.167797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.168288 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.168767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.169509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:55.169975 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:55.170415 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:55.187163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for project 2379590449194279a8fa072dff150353. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:34:55.192407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Getting quotas for user 70ecb493a7ed469294c8397a30a21138 and project 2379590449194279a8fa072dff150353. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:34:55.250590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:34:55.252680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7109acfe-db3e-44ae-bd6a-45223fdd6351',volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:34:55.382105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-401cab4b-036f-4472-aadd-22ffe40502b5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.729918 Aug 24 03:34:55.382749 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6395/7387] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:34:54 2022] POST /compute/v2.1/servers => generated 403 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:34:55.394715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e5ade41e-bbe6-40be-a4c7-1321b31d1c2a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:55.395332 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e5ade41e-bbe6-40be-a4c7-1321b31d1c2a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:55.451273 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-e5ade41e-bbe6-40be-a4c7-1321b31d1c2a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:55.458433 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e5ade41e-bbe6-40be-a4c7-1321b31d1c2a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1086 microversion: 2.1 time: 0.067744 Aug 24 03:34:55.459013 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6396/7388] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:55 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:56.479822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:56.480621 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:56.489136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.489649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.490125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.490849 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:56.491322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:56.491769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:56.578521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:56.586928 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6ccae02f-5041-4709-84ac-da29722a540c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1192 microversion: 2.1 time: 0.111352 Aug 24 03:34:56.587768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6397/7389] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:56 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:57.609423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:57.610922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:57.617340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.618125 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.618790 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.619536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:57.620009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:57.620440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:57.824490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:57.833075 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-aab659dd-3a4b-4192-afb2-c1a4be8ea7c2 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1267 microversion: 2.1 time: 0.228011 Aug 24 03:34:57.833689 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6398/7390] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:57 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:34:58.079348 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:34:58.090127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.092190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.093034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.110404 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] Creating event network-changed:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:34:58.115531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b79ff695-f811-46c0-be87-d8fe40cee9ce req-5f4316ce-a9f7-4a15-9d30-1e35ac7c8e22 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040526 Aug 24 03:34:58.116285 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6399/7391] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:34:58.856681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:34:58.857737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:34:58.864751 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.865267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.865760 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:58.866441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:34:58.867203 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:34:58.867668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:34:59.096737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:34:59.105003 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0768b245-829d-4506-94d4-26890c0f261b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1267 microversion: 2.1 time: 0.254125 Aug 24 03:34:59.105759 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6400/7392] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:34:58 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:00.126696 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:00.127460 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:00.134923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.135447 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.135896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.136661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:00.137149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:00.137612 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:00.296087 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:00.304281 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddc4b842-aa01-4ba5-967f-f341ce9a13cf tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1267 microversion: 2.1 time: 0.182061 Aug 24 03:35:00.304907 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6401/7393] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:00 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:01.325958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:01.326698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:01.333688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.334192 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.334644 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.335365 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:01.335832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:01.336276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:01.473164 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:01.481392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fbabc0ef-fe80-40be-b24b-ac6c25dcad29 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1267 microversion: 2.1 time: 0.159322 Aug 24 03:35:01.482528 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6402/7394] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:01 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:02.516004 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:02.516657 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:02.523498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.524009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.524466 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.525240 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:02.525715 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:02.526184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:02.659675 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:02.667353 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ec6f7bce-9dc2-4ad3-9c7d-48bd66e1e410 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.155890 Aug 24 03:35:02.667933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6403/7395] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:02 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:03.688502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:03.689210 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:03.696297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:03.696840 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:03.697297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:03.698425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:03.698904 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:03.699349 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:03.834999 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:03.843681 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-459a8d8e-c29f-4394-b982-61660f9fb456 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.158939 Aug 24 03:35:03.844253 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6404/7396] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:03 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:04.863827 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:04.864412 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:04.871461 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.871997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.873012 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:04.873737 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:04.874212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:04.874658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:05.018508 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:05.026415 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0b3c5e0c-bdf5-4590-84d3-8affa5594a4c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.166652 Aug 24 03:35:05.027005 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6405/7397] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:04 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:06.047353 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:06.048117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:06.050262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:06.051014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:06.057498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.057996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.058446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.059154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:06.059679 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:06.060145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:06.194409 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:06.203173 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-571ee48d-dce3-4451-8dad-df3ef2e798dd tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.159816 Aug 24 03:35:06.203885 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6406/7398] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:06 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:07.225079 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:07.225731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:07.233398 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.233905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.234385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.235107 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:07.235576 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:07.236022 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:07.368220 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:07.376370 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-697736cf-c4c2-4c68-a1e6-d64532571ef4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.155457 Aug 24 03:35:07.376974 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6407/7399] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:07 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:08.397395 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:08.398110 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:08.405635 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.406144 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.406601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.407322 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:08.407798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:08.408243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:08.554182 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:08.562305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9abdb422-2d23-437e-b088-e573fd61f8bc tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.168830 Aug 24 03:35:08.562886 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6408/7400] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:08 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:09.585308 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:09.585970 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:09.593811 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.594318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.594774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.595493 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:09.595964 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:09.596410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:09.728267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:09.736983 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b72689e5-409f-4739-b91c-0386bee688c7 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.155550 Aug 24 03:35:09.737567 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6409/7401] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:09 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:10.757864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:10.758640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:10.766411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.766901 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.767346 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.768056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:10.768521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:10.768990 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:10.914336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:10.922442 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-852dd76a-88ed-485c-9825-e765388dd33a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.168445 Aug 24 03:35:10.923041 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6410/7402] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:10 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:11.943731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:11.944676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:11.952631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.953169 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.953625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:11.954350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:11.954819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:11.955263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:12.102535 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:12.111021 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-48e73ff2-00f6-4a40-8781-87cdbc3f5a14 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.171363 Aug 24 03:35:12.111606 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6411/7403] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:11 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:13.133201 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:13.133841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:13.141224 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.141734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.144152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.144152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.144152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.144152 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.277639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:13.286133 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb446f91-523d-481f-866e-be22db10825a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.157249 Aug 24 03:35:13.286716 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6412/7404] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:13 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:13.839056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "name": "network-vif-plugged", "status": "completed", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:13.850236 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:13.850741 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:13.851197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:13.864418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] Creating event network-vif-plugged:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:35:13.870233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-732b83ab-22f4-4ef4-909c-d89095cd23b6 req-0aedccd1-7896-46a5-9878-9fea1a12f5b4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035714 Aug 24 03:35:13.870856 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6413/7405] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:35:14.308514 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:14.309263 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:14.315694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.316196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.316665 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.317400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:14.317869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:14.318317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:14.338634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:35:14.465168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:14.473542 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fd4f26ef-acf4-4352-9134-faa9c4c15089 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.170218 Aug 24 03:35:14.474108 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6414/7406] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:14 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:15.499200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:15.499894 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:15.506927 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.507425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.507878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.508871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:15.509078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:15.509776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:15.644587 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:15.652498 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c7768b49-c259-4704-8595-16325c9c77ea tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1255 microversion: 2.1 time: 0.157200 Aug 24 03:35:15.653625 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6415/7407] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:15 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1255 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:16.673306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.673994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.681041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.681542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.681994 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.682698 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.683168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.683605 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.813248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.821017 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5ccfc57d-a363-456c-a6b8-aa1fc6520471 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1439 microversion: 2.1 time: 0.151913 Aug 24 03:35:16.821588 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6416/7408] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1439 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:16.842133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:35:16.842750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:35:16.848608 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.849143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.849591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.850287 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:16.850755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:16.851190 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:16.985972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:35:16.993949 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8ad7a76d-ebb7-446e-ba04-87f8ebbea797 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1439 microversion: 2.1 time: 0.155984 Aug 24 03:35:16.994520 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6417/7409] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:35:16 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1439 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:35:18.668467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:35:18.687441 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:35:18.688307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:35:18.689162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:35:18.715105 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] Creating event network-changed:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:35:18.724175 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-a5aff473-5f51-4803-8512-babc50e97a74 req-3284b13c-3794-40d5-bb86-6f4282d515a7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062555 Aug 24 03:35:18.725079 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6418/7410] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:23.198282 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:37:23.199007 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:37:23.281924 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:37:23.282095 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:37:23.787328 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:37:23.788137 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:37:23.788855 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:23.790225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=22 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:23.794604 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:23.795231 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.802431 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.802955 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.803407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.804127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.804590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.805069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.828959 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lazy-loading 'flavor' on Instance uuid 85514a51-aad9-4fcf-81e9-606a22e893d5 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:37:23.912782 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7811182-319a-4e13-986a-4a43738c348b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5/action" status: 202 len: 0 microversion: 2.1 time: 0.126866 Aug 24 03:37:23.913406 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6419/7411] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:23 2022] POST /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:37:23.923215 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:23.923957 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:23.931845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.932422 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.932936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:23.933671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:23.934150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:23.934603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:24.196767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:24.205445 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0a696948-85e1-455b-9993-f39062458657 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.286795 Aug 24 03:37:24.206120 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6420/7412] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:23 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:25.226626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:25.227912 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:25.236435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.236966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.237378 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.238109 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:25.238585 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:25.239032 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:25.261665 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50762. Aug 24 03:37:25.264597 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 50760. Aug 24 03:37:25.381170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:25.389844 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bb1b4ac4-4a5e-43f7-a271-07423296b29a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.167160 Aug 24 03:37:25.390425 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6421/7413] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:25 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:26.411442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:26.412111 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:26.419536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.420037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.420490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.421242 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:26.421711 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:26.422155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:26.560731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:26.569416 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-53fd9c6d-e5ad-4f9c-8cf7-de2c9763ebe0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.161680 Aug 24 03:37:26.570115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6422/7414] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:26 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:27.590841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:27.591531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:27.598413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.598916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.599405 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.600120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:27.600596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:27.601069 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:27.737155 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:27.745682 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5188345-a0cf-4f94-af9b-4e14a00841bb tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.158777 Aug 24 03:37:27.746266 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6423/7415] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:27 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:28.767199 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:28.767899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:28.775054 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.775552 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.776024 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.776776 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:28.777245 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:28.777682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:28.927404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:28.936755 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7278743e-e471-4f6a-abe1-b34da4483d79 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.173320 Aug 24 03:37:28.937346 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6424/7416] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:28 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:29.958413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:29.959062 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:29.965992 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.966490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.966937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:29.967637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:29.968096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:29.968530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:30.104249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:30.112137 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7a310612-d896-46b8-8699-488cbb418a31 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.157759 Aug 24 03:37:30.112731 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6425/7417] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:29 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:31.134958 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:31.135871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:31.142628 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.143128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.143579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.144313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:31.144806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:31.145243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:31.305735 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:31.313667 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8866d169-955a-4882-8c47-0e5e7997102b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.183487 Aug 24 03:37:31.314234 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6426/7418] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:31 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:32.335588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:32.336295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:32.343597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.343812 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.344247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.344998 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:32.345474 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:32.345921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:32.483467 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:32.491484 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bab3dcb9-fc25-4355-8565-0d915ee8e702 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.159901 Aug 24 03:37:32.492064 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6427/7419] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:32 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:33.513674 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:33.514434 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:33.521891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.522407 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.522864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.523642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:33.524642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:33.525120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:33.687636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:33.702559 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-84948abd-ea12-4295-84e3-b19a61fb1ced tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.192682 Aug 24 03:37:33.703573 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6428/7420] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:33 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:34.727775 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:34.728425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:34.735854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.736369 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.736898 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.737658 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:34.738140 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:34.738594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:34.963938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:34.972221 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fe4d8963-4802-4da0-884a-d90357f9c085 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.250511 Aug 24 03:37:34.976402 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6429/7421] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:34 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:36.002997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:36.003689 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:36.011761 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.012318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.012796 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.013531 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:36.014058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:36.014567 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:36.156481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:36.164566 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f0b486e4-b4e7-454a-b650-257d466b38c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.165743 Aug 24 03:37:36.165202 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6430/7422] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:35 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:37.186391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:37.187384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:37.196668 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.197216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.197687 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.198492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:37.198997 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:37.199483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:37.360031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:37.368300 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-01c65c3c-247b-4767-a7a7-0c580d5f4731 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.186167 Aug 24 03:37:37.368911 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6431/7423] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:37 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:38.391685 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:38.392357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:38.400314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.400856 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.401313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.402037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:38.402509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:38.402948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:38.555845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:38.565288 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ea2ecb7-0b7c-454e-9bdd-5cc009f939f0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.177362 Aug 24 03:37:38.565941 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6432/7424] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:38 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:39.587625 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:39.588693 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.599219 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.600010 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.600746 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.602521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.603307 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.604027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.628846 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:39.857932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:39.870354 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d2db339f-652d-4e18-93c9-4e62854c71c0 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1504 microversion: 2.1 time: 0.286104 Aug 24 03:37:39.871529 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6433/7425] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:39 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:39.909266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:39.910724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:39.920832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.921770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.922367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.923318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:39.923934 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:39.924504 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:39.968577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128567) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 03:37:40.069417 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-011754a0-4dba-4842-831e-eda7bc65f73a tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "POST /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5/action" status: 202 len: 0 microversion: 2.1 time: 0.166188 Aug 24 03:37:40.075574 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6434/7426] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:37:39 2022] POST /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:37:40.081418 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:40.082061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:40.088857 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.089492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.089972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.090724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.091174 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.091755 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.338134 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:40.354085 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3ed282f3-a5c8-467b-ba81-5eb80eaf0273 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1512 microversion: 2.1 time: 0.276289 Aug 24 03:37:40.355509 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6435/7427] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:40 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:40.509470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "name": "network-vif-unplugged", "status": "completed", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:40.525803 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:40.526449 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:40.526977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:40.540116 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.compute.server_external_events [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] Unable to find a host for instance 85514a51-aad9-4fcf-81e9-606a22e893d5. Dropping event network-vif-unplugged {{(pid=128567) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 03:37:40.541162 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-090e3f67-3741-46a5-aeb6-9d9f63ef0f64 req-bd2044cf-41b6-4886-a9b8-4cd3f7fa9cb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036621 Aug 24 03:37:40.542413 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6436/7428] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 03:37:41.388861 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:41.389736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:41.397096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.397601 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.398058 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.398830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:41.399304 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:41.399763 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:41.556318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:41.566293 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-79d8c1f6-5d71-4444-a5d1-012731bee2a9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1514 microversion: 2.1 time: 0.181895 Aug 24 03:37:41.567127 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6437/7429] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:41 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:42.593406 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:42.594093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:42.603933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.604444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.604951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.605686 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:42.606154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:42.606589 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:42.794357 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:42.805455 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-cb3e5d84-a4cc-40fa-8318-dc7ded5c837e tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1514 microversion: 2.1 time: 0.215034 Aug 24 03:37:42.806395 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6438/7430] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:42 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:43.831562 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:43.832613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:43.841451 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.842060 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.842594 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.843413 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:43.843976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:43.844490 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:43.993891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:44.003310 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-6f07954d-b72f-481e-acd5-4dfa13d8ad3f tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1514 microversion: 2.1 time: 0.177200 Aug 24 03:37:44.003910 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6439/7431] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:43 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:45.026788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:45.027423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:45.034903 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.035470 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.035926 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.036642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:45.037379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:45.037822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:45.190083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:45.198490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a7004a45-6992-4182-9895-0ba5906e298c tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1514 microversion: 2.1 time: 0.176290 Aug 24 03:37:45.199082 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6440/7432] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:45 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:46.220965 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:46.229801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:46.229801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.230772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.230772 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.232359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:46.232359 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:46.232661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:46.395829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:46.409777 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-13659d71-8b22-4028-ba0c-008a7fd911f5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.192620 Aug 24 03:37:46.410741 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6441/7433] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:46 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:47.432014 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:47.432810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:47.440143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.440653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.441128 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.441885 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:47.442360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:47.442800 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:47.601208 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:47.610053 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5d795832-0922-4086-8437-73c21c732911 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.182200 Aug 24 03:37:47.610717 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6442/7434] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:47 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:48.631916 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:48.633168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:48.641002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.641515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.641971 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.642699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:48.643171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:48.643613 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:48.807703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:48.816510 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a3386862-c8f1-4a5a-8ce2-2c199bcb5440 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.188485 Aug 24 03:37:48.817136 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6443/7435] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:48 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:49.838942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:49.839694 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:49.846822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.847325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.847774 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:49.848503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:49.849002 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:49.849446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:50.018096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:50.026392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-64cbb635-a0a3-4eae-b689-f36001efb840 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.192050 Aug 24 03:37:50.026990 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6444/7436] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:49 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:51.047892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:51.048538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:51.056425 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.056969 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.057433 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.058171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:51.058641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:51.059089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:51.209808 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:51.222531 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bbc60d34-ad74-4206-9225-36ca78324f72 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.178442 Aug 24 03:37:51.223723 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6445/7437] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:51 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:52.251749 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:52.252439 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:52.261345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.261834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.262278 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.263049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:52.263581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:52.264036 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:52.409788 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:52.418411 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-31a1b435-282d-4d00-bbb9-e41ebec38d7b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.170610 Aug 24 03:37:52.419038 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6446/7438] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:52 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:53.441789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:53.442821 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:53.451780 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.452682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.453525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.454881 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:53.455782 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:53.456603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:53.639626 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:53.652942 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f142993d-2998-4136-960d-b8fe73695d20 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.214864 Aug 24 03:37:53.653879 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6447/7439] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:53 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:54.683372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:54.684094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:54.687344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:54.696446 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.697006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.697400 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.698175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:54.698595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:54.699039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:54.852438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:54.861752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-37db72f9-3ed9-4274-a52e-d4628437a299 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.182961 Aug 24 03:37:54.862364 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6448/7440] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:54 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:55.903436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:55.904335 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:55.911017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.911533 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.912029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:55.912810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:55.913297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:55.914246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:56.078163 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:56.082017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:37:56.089692 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0bab62de-b546-46ab-9735-e32153606a51 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.191180 Aug 24 03:37:56.090441 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6449/7441] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:55 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:57.113399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:57.114624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:57.123845 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.124769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.125579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.126624 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:57.127486 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:57.128274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:57.338569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:57.348226 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a223f001-3536-4637-8dcc-b1ca5c898bd4 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.238827 Aug 24 03:37:57.349049 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6450/7442] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:57 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:37:58.385492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:58.386725 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:58.397784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.399360 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.400350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.401837 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.402682 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.403538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.588564 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:58.598871 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0146ae53-2ab0-4e75-8331-11d6e94f5aa5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.221035 Aug 24 03:37:58.599276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6451/7443] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:58 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:37:58.753974 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "name": "network-vif-plugged", "status": "completed", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:37:58.767582 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:58.768457 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:58.769248 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:58.784064 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] Creating event network-vif-plugged:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:37:58.790388 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-272ddab0-6190-4c88-83ed-398ea7e99b67 req-e3a3e35e-d20f-47c4-9fce-68239432bdc5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093498 Aug 24 03:37:58.790971 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6452/7444] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:37:59.622581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:37:59.623381 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:37:59.629850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.630362 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.630817 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.631556 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:37:59.632027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:37:59.633145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:37:59.769672 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:37:59.777657 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-3447a635-641e-4c51-92ca-cdd448880609 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1570 microversion: 2.1 time: 0.161015 Aug 24 03:37:59.778263 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6453/7445] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:37:59 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:38:00.801411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:38:00.801411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:38:00.808777 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.809292 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.809756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.810471 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:38:00.810948 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:38:00.811401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:38:00.955091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:38:00.962632 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f2fef307-6afd-4408-911a-d13e734efbae tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1557 microversion: 2.1 time: 0.166433 Aug 24 03:38:00.963252 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6454/7446] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:38:00 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:24.107789 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=13 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:24.108806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=26 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:24.113522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.114560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.122896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.122896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.123368 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.124167 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.124656 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.125221 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.154868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:39:24.266766 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-32afae68-49fa-4dce-a27d-0313821c3853 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "DELETE /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 204 len: 0 microversion: 2.1 time: 0.160547 Aug 24 03:39:24.267854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6455/7447] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:39:24 2022] DELETE /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:39:24.428185 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:24.438419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.438922 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.439371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.454829 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] Creating event network-changed:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:39:24.460358 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-5d6babec-7486-4922-b5ea-df10c3d1ec3c req-bee6c936-71ef-4b50-b5fb-e80016813f59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190089 Aug 24 03:39:24.461332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6456/7448] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:24.466459 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:24.467188 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:24.474655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.475175 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.475642 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.476372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:24.476878 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:24.477331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:24.688327 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:24.700443 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bc28e542-0430-4bb1-b6b1-c4a302315a4b tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.237874 Aug 24 03:39:24.701732 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6457/7449] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:24 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:25.729538 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:25.730333 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:25.740977 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.741497 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.742061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.742833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:25.743371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:25.743921 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:25.922044 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:25.930270 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-692d0689-9712-4f47-9bd6-8b44c38e76a3 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1563 microversion: 2.1 time: 0.207067 Aug 24 03:39:25.930866 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6458/7450] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:25 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1563 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:26.953734 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:26.954793 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:26.968305 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.969250 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.970065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:26.971330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:26.972172 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:26.973013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.052783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:27.064400 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-54df0b53-3297-4117-9ec2-55060002f0a5 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1380 microversion: 2.1 time: 0.116143 Aug 24 03:39:27.065043 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6459/7451] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:26 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1380 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:27.085826 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85514a51-aad9-4fcf-81e9-606a22e893d5", "name": "network-vif-deleted", "tag": "b0346139-a5f2-4232-ad20-3e95b436249e"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:27.102246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:27.103243 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:27.103932 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:27.124780 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] Creating event network-vif-deleted:b0346139-a5f2-4232-ad20-3e95b436249e for instance 85514a51-aad9-4fcf-81e9-606a22e893d5 on n-h2-854121-3 Aug 24 03:39:27.135018 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9df82374-aa71-40b4-b4e3-e324a84efe77 req-213f40c8-6448-4b7d-b2ff-69c45e106608 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068006 Aug 24 03:39:27.136061 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6460/7452] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:39:28.088180 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:28.089401 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:28.099067 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.099620 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.100130 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.100908 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:28.101388 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:28.101833 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:28.189498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:28.205975 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fc8c3bb9-f186-4dbb-b595-87b4070f60c9 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1217 microversion: 2.1 time: 0.122389 Aug 24 03:39:28.207289 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6461/7453] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:28 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:29.239745 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:29.240384 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:29.247510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.248017 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.248472 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.249223 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:29.249709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:29.250136 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:29.313524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:29.322418 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-28f24461-a160-4a16-abcc-874b8dfcfe47 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1217 microversion: 2.1 time: 0.087094 Aug 24 03:39:29.322933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6462/7454] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:29 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:30.343814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:30.344507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:30.351654 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.352170 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.352629 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.353391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:30.353870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:30.354317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:30.424312 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:30.433100 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4d2cb06b-96ef-44f8-b497-c437e817cb34 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1217 microversion: 2.1 time: 0.093270 Aug 24 03:39:30.433691 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6463/7455] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:30 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:31.455810 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:31.456876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:31.465056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.465703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.465968 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.467262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.467806 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.468342 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.507814 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:31.508341 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:31.508835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:31.509314 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.objects.instance [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lazy-loading 'fault' on Instance uuid 85514a51-aad9-4fcf-81e9-606a22e893d5 {{(pid=128567) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 03:39:31.559640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ecb493a7ed469294c8397a30a21138', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2379590449194279a8fa072dff150353', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:31.568205 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78ff5925-ed90-4b36-8754-c9b7704bca77 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 200 len: 1222 microversion: 2.1 time: 0.116660 Aug 24 03:39:31.568833 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6464/7456] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:31 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:32.737584 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.738225 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] [instance: 85514a51-aad9-4fcf-81e9-606a22e893d5] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:32.744542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.745084 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.745542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.746261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:32.746731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:32.747177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:32.762019 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] HTTP exception thrown: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Request method failure captured: Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 HTTP/1.1 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZr7VyHRLaxaVSzbqiZRgRKWEL9Is4SwwlsMnd9eNJBuDCqlaupZfU4c0_nwo0YpwAaV-jWOVAwoGcK5_uC8vL4eSCVTjWpk5wZL36qPt7J9gaavgC9yUz5kxyGduE57LOyqZknWLOdP9_yndd2UNj7AgQWoeP4vlpv-fb3Z0emxknA Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: 2379590449194279a8fa072dff150353 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestShelveInstance-296143170 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2379590449194279a8fa072dff150353"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2379590449194279a8fa072dff150353"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2379590449194279a8fa072dff150353"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2379590449194279a8fa072dff150353"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestShelveInstance-296143170 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: 2379590449194279a8fa072dff150353 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestShelveInstance-296143170 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestShelveInstance-296143170-project Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 70ecb493a7ed469294c8397a30a21138 Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestShelveInstance-296143170-project Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': '85514a51-aad9-4fcf-81e9-606a22e893d5'} Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:39:32.763966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Returning 404 to user: Instance 85514a51-aad9-4fcf-81e9-606a22e893d5 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-68bd38e5-97d0-4e45-9987-d2d7cdfe2fb6 tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5" status: 404 len: 111 microversion: 2.1 time: 0.177710 Aug 24 03:39:32.771118 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6465/7457] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:32 2022] GET /compute/v2.1/servers/85514a51-aad9-4fcf-81e9-606a22e893d5 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:39:32.943716 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-def53b24-10cd-4ac3-9051-d148ca7b5bbe tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] Calling method '.version_select at 0x7f6b90438ee0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:32.991815 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-def53b24-10cd-4ac3-9051-d148ca7b5bbe tempest-TestShelveInstance-296143170 tempest-TestShelveInstance-296143170-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-93953084" status: 202 len: 0 microversion: 2.1 time: 0.052309 Aug 24 03:39:32.992501 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6466/7458] 10.222.0.49 () {58 vars in 1248 bytes} [Wed Aug 24 03:39:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-93953084 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 03:39:55.489345 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:55.490397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:55.717512 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9a9a094c-930b-4670-afcf-dd9b29ac983f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Action: 'create', calling method: .version_select at 0x7f6b91e71790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1934003943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+d/j+12MxOR+9/sJuveu6uN5G6cg3p9LYo4J179HOQb9QJPx7Km/cr0YWWp0D0EYxVytWSgI42h2hSN5pVuSa/uHkodxHbYBbWGgFhk5yq+moi14qM5zv2SLpPUy3KlA=="}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:55.739286 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a9a094c-930b-4670-afcf-dd9b29ac983f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:55.745241 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-9a9a094c-930b-4670-afcf-dd9b29ac983f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for user 7b4f4dbc31b44699be9175d1762edcf7 and project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'key_pairs'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:55.777206 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9a9a094c-930b-4670-afcf-dd9b29ac983f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.290610 Aug 24 03:39:55.777994 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6467/7459] 10.222.0.49 () {60 vars in 1159 bytes} [Wed Aug 24 03:39:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:39:56.770370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-927041022", "imageRef": "71c852a4-8aa1-4649-8920-fa03a58666b5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1934003943", "security_groups": [{"name": "tempest-secgroup-smoke-452471107"}], "networks": [{"uuid": "55c0e963-e53e-4408-9a90-a6442f99f20a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:39:56.878154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] validate_networks() for [('55c0e963-e53e-4408-9a90-a6442f99f20a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:39:57.391889 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:39:57.392568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:39:57.392839 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:39:57.393676 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:39:57.394350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:39:57.405683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.406426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.407303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.408379 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:57.408982 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:57.409489 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:57.431432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:39:57.437030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for user 7b4f4dbc31b44699be9175d1762edcf7 and project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:39:57.451375 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:39:57.453835 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='71c852a4-8aa1-4649-8920-fa03a58666b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:39:57.513477 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-16d99d3c-a37f-423d-8e4d-436313066bf4 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747905 Aug 24 03:39:57.520967 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6468/7460] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:39:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:39:57.528373 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-70eefde2-d6d5-42dd-9ab7-77d673b68208 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:57.529300 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-70eefde2-d6d5-42dd-9ab7-77d673b68208 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:57.596344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-70eefde2-d6d5-42dd-9ab7-77d673b68208 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:57.606772 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-70eefde2-d6d5-42dd-9ab7-77d673b68208 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1248 microversion: 2.1 time: 0.082319 Aug 24 03:39:57.607494 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6469/7461] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:57 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:39:58.629942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:58.630609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:58.637336 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.637938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.638428 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.639154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:58.639630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:58.640075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:58.705769 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:58.714302 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-2d6c3a18-454c-4f67-bb90-f3bd44f5fd40 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1300 microversion: 2.1 time: 0.090648 Aug 24 03:39:58.714998 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6470/7462] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:58 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:39:59.736824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:39:59.737525 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:39:59.749339 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.750579 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.751450 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.752816 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:39:59.754299 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:39:59.755193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:39:59.959350 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:39:59.971287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-153ecb01-2d5e-4b98-8082-f521f92a4cda tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.239033 Aug 24 03:39:59.987412 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6471/7463] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:39:59 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:00.616989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:00.628703 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:00.629331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:00.629972 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:00.645286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] Creating event network-changed:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:40:00.652500 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-c24d6768-cd97-43da-8bd5-a236174ea603 req-e5e23605-9624-4932-84ae-f19780285293 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112447 Aug 24 03:40:00.653575 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6472/7464] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:40:01.000801 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:01.001917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:01.009983 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.010510 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.010973 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.012090 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:01.012444 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:01.012935 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:01.164666 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:01.174608 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-938d4490-2446-4641-be5b-0fbabba08cc7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.181939 Aug 24 03:40:01.175239 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6473/7465] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:00 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:02.194867 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:02.195509 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:02.202641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.203295 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.203747 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.204453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:02.204951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:02.205391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:02.336822 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:02.344587 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-29e2f0ec-89aa-4401-97d0-b93141f7c863 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.154212 Aug 24 03:40:02.345261 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6474/7466] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:02 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:03.366117 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:03.366766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:03.373739 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.374306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.374864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.376034 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:03.376506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:03.377438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:03.530507 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:03.541392 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45fc2769-c56a-4cf1-954d-0da047683ff6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.178810 Aug 24 03:40:03.542148 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6475/7467] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:03 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:04.564040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:04.564884 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:04.571688 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.572193 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.573092 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.573403 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:04.575149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:04.575149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:04.709367 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:04.717669 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-47a96df7-8900-4da6-9fe0-e5207480cb02 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.157597 Aug 24 03:40:04.718258 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6476/7468] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:04 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:05.739338 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:05.739991 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:05.746832 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.747334 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.747792 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.748503 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:05.749074 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:05.749551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:05.886700 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:05.894705 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f71c2db3-724e-4207-b964-88fe7d53092a tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.159460 Aug 24 03:40:05.895326 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6477/7469] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:05 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:06.915976 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:06.916616 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:06.923595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.924099 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.924550 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:06.925281 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:06.925756 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:06.926200 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.055536 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:07.063279 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-17e8fe9d-2b06-48f3-a0aa-8c465174e687 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.151299 Aug 24 03:40:07.063854 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6478/7470] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:06 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:07.336697 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "name": "network-vif-plugged", "status": "completed", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:07.349280 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:07.349797 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:07.350836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:07.363353 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] Creating event network-vif-plugged:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:40:07.368790 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-b6b5834e-ed80-4b9d-bfaf-a29262a7111d req-8654febb-a2c6-4abe-8062-8608df0e5490 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035762 Aug 24 03:40:07.369405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6479/7471] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:40:08.085029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:08.085609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:08.087681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:08.088408 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=12 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:08.095899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.096479 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.097524 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.100194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:08.100194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:08.100194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:08.266235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:08.277809 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-4409c90b-03e5-4cf9-abdc-d658f82090a6 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1373 microversion: 2.1 time: 0.196473 Aug 24 03:40:08.277809 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6480/7472] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:08 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:09.310664 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.312120 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.327424 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.328318 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.329249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.330645 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.331586 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.332600 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.492574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:09.502010 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-0f1cbe4c-755d-4196-a458-baaf030ae174 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1557 microversion: 2.1 time: 0.198655 Aug 24 03:40:09.502589 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6481/7473] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1557 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:40:09.541890 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:40:09.543075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:40:09.555262 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.556065 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.556834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.558013 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:09.558771 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:09.559468 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:09.749521 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:40:09.762191 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5b8edb6e-2905-46c2-885c-350f8785386d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1557 microversion: 2.1 time: 0.227529 Aug 24 03:40:09.762797 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6482/7474] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:40:09 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:40:12.079464 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:40:12.090944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:40:12.091436 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:40:12.091891 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:40:12.112138 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] Creating event network-changed:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:40:12.119990 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-043f780f-f084-45b6-91ee-c6db8b28463a req-fc5e5222-1002-4650-b72b-130196a73970 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044123 Aug 24 03:40:12.120926 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6483/7475] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:42:23.209239 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:42:23.209918 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:42:23.292383 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:42:23.292677 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:43:00.446818 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:43:00.447639 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 03:43:00.448328 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:00.449114 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=74 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:00.457736 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1894763557"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:00.460399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:00.470145 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.470653 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.471105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.472119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:00.472590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:00.473056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:00.815722 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c0e41b11-5572-47e6-bd3a-18b5fa676532 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "POST /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae/action" status: 202 len: 0 microversion: 2.1 time: 0.370535 Aug 24 03:43:00.816380 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6484/7476] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:43:00 2022] POST /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 03:43:08.349295 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51242. Aug 24 03:43:08.352602 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51244. Aug 24 03:43:08.430083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "name": "network-vif-plugged", "status": "completed", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:08.441011 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:08.441502 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:08.441943 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:08.452775 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] Creating event network-vif-plugged:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:43:08.458144 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4425cd8d-4641-4fdf-9af7-53f17463254f req-b66b592e-770b-437c-994a-c957c15c8d23 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132773 Aug 24 03:43:08.458728 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6485/7477] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:20.499529 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1295172432", "imageRef": "69ffaab4-ceee-4506-869d-aaeec6aa1efa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1934003943", "security_groups": [{"name": "tempest-secgroup-smoke-452471107"}], "networks": [{"uuid": "55c0e963-e53e-4408-9a90-a6442f99f20a"}]}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:20.508595 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.509426 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:20.619854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.network.neutron [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] validate_networks() for [('55c0e963-e53e-4408-9a90-a6442f99f20a', None, None, None, None, None)] {{(pid=128567) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 03:43:20.996820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Flavor limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 03:43:20.997261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Image limits 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 03:43:20.997783 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Flavor pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 03:43:20.998216 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Image pref 0:0:0 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 03:43:20.998647 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.virt.hardware [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128567) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 03:43:21.007661 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.008159 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.008617 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.009399 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:21.009870 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:21.010313 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:21.027980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 03:43:21.033330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.quota [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Getting quotas for user 7b4f4dbc31b44699be9175d1762edcf7 and project ce3102a9e89c4765bb411c0bff6d6807. Resources: {'instances', 'ram', 'cores'} {{(pid=128567) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 03:43:21.045611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Going to run 1 instances... {{(pid=128567) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 03:43:21.048100 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='69ffaab4-ceee-4506-869d-aaeec6aa1efa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128567) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 03:43:21.096233 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-7afb8657-c585-4d85-be31-bdc07e19f05f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.600816 Aug 24 03:43:21.096839 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6486/7478] 10.222.0.49 () {60 vars in 1147 bytes} [Wed Aug 24 03:43:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 03:43:21.107309 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-bd64b7a9-8e59-4e78-b5da-0600ff7bcaa3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:21.107942 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-bd64b7a9-8e59-4e78-b5da-0600ff7bcaa3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:21.162938 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-bd64b7a9-8e59-4e78-b5da-0600ff7bcaa3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:21.170737 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-bd64b7a9-8e59-4e78-b5da-0600ff7bcaa3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1249 microversion: 2.1 time: 0.067053 Aug 24 03:43:21.171314 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6487/7479] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:21 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:22.191836 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:22.192477 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:22.202791 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.203293 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.203750 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.205351 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:22.205830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:22.206630 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:22.277588 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:22.287328 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-badad455-5654-4064-9ab8-487c9193d46b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1301 microversion: 2.1 time: 0.098705 Aug 24 03:43:22.287933 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6488/7480] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:22 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:23.309854 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:23.310611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:23.317936 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.318568 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.319127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.319944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:23.320526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:23.321089 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:23.537148 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:23.545935 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-44b57778-2640-4749-8f33-9310decb2156 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.240350 Aug 24 03:43:23.546521 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6489/7481] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:23 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:24.403615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "name": "network-vif-unplugged", "status": "completed", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:24.419925 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.421640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.427731 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.441605 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] Creating event network-vif-unplugged:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:43:24.447791 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-056cbc67-b415-4ad7-b0d8-933806b2a6f5 req-0cbf3ec9-acf2-47d9-87b9-e146f72364f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048260 Aug 24 03:43:24.449451 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6490/7482] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:24.568655 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:24.570108 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:24.577127 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.577636 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.578086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.578805 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:24.579274 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:24.579709 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:24.747738 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:24.756911 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-ddbfc414-56c3-4df0-bf5a-8fb094d4f0f1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.192274 Aug 24 03:43:24.757435 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6491/7483] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:24 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:25.778615 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:25.779371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:25.786410 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.786920 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.787372 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.788093 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:25.788571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:25.789049 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:25.941249 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:25.950625 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-78ae677e-e9ba-42bc-9e1c-8e700498a039 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.175963 Aug 24 03:43:25.951375 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6492/7484] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:25 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:26.972091 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:26.973592 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:26.982290 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.983184 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.983710 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:26.984500 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:26.985066 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:26.985597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:27.129917 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:27.139167 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-fef23d9e-0a3d-4357-8287-4f72521af570 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.171011 Aug 24 03:43:27.139943 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6493/7485] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:26 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:43:28.161150 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:28.161919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:28.169919 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.170702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.171235 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.172483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:28.173053 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:28.173569 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:28.334423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:28.343791 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-77deaa02-8097-41a0-86c4-65c557e416c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.187093 Aug 24 03:43:28.344646 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6494/7486] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:28 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:29.366911 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:29.367649 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:29.375937 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.376453 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.376931 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.377671 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:29.378132 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:29.378560 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:29.532156 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:29.541252 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8f7d274a-46d9-4080-9852-f94415c575e8 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.178273 Aug 24 03:43:29.542223 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6495/7487] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:29 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:30.562458 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:30.563154 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:30.569989 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.570481 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.570985 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.571719 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:30.572186 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:30.572623 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:30.704432 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:30.712831 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-f705b8f6-f9a3-4cc1-bf9a-52a31f8607f7 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.154274 Aug 24 03:43:30.713401 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6496/7488] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:30 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:31.734495 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:31.735171 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:31.737168 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=2 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:31.737869 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell0:SELECT=8 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:31.744419 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.745438 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.745899 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.746611 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:31.747086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:31.747530 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:31.883784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:31.894151 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-a4012a4f-77f0-410d-9838-232bc82a8a63 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.163622 Aug 24 03:43:31.894733 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6497/7489] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:31 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:32.797040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:32.813197 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.814247 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.814951 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.827286 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] Creating event network-changed:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:43:32.832447 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-f29769f7-5221-4a5f-941d-755cfa297c3d req-a3225901-4c77-40e9-b56e-d83740aa1102 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040370 Aug 24 03:43:32.833405 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6498/7490] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:43:32.915868 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:32.916499 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:32.922759 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.923266 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.923724 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:32.924440 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:32.924941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:32.925385 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:33.058941 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:33.066713 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-b6e106f8-710c-4fb5-85e8-762d24e83e56 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.155343 Aug 24 03:43:33.067279 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6499/7491] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:32 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:34.088046 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:34.089358 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:34.096006 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.096526 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.097001 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.097702 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:34.098162 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:34.098597 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:34.232028 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:34.240047 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-244125e0-4209-41eb-809a-19c00daa0de0 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.155907 Aug 24 03:43:34.240633 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6500/7492] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:34 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:35.262086 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:35.262996 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:35.270829 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.271330 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.271781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.272487 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:35.273075 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:35.273518 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:35.414371 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:35.422704 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-8bdb54a2-1cef-4565-b77e-7f87ee5fc632 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.165549 Aug 24 03:43:35.423276 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6501/7493] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:35 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:36.443571 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:36.444218 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:36.451872 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.452382 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.452864 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.453590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:36.454059 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:36.454498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:36.588784 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:36.596597 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-c5e07580-cfc7-4ce6-9a6b-2d4404a91d3b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.157017 Aug 24 03:43:36.597332 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6502/7494] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:36 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:37.617317 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:37.618008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:37.625039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.625554 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.626008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.626722 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:37.627194 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:37.627640 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:37.769009 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:37.776972 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d27eff9d-3917-4db6-a9f0-1ff49a69420f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.163723 Aug 24 03:43:37.777768 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6503/7495] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:37 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:38.798306 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:38.798962 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:38.805209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.805708 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.806261 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.807557 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:38.808037 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:38.808482 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:38.946575 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:38.954448 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-5c5a3ece-3b1a-4a2c-9c44-d9e78e6268b5 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.160231 Aug 24 03:43:38.955037 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6504/7496] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:38 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:39.165631 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "name": "network-vif-plugged", "status": "completed", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:39.177076 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.177593 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.178041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.190192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] Creating event network-vif-plugged:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:43:39.195331 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-4ac60fe3-61c7-4b5b-b327-df5c99f81364 req-8dea9c31-35a5-4eab-ba47-6522348d278f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033738 Aug 24 03:43:39.196339 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6505/7497] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:43:39.976519 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:39.977209 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:39.983442 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.983944 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.984404 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.985133 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:39.985609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:39.986056 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:39.990423 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=100 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:40.129798 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:40.138493 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-25daad96-bd28-4152-92da-6547ed68397d tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1374 microversion: 2.1 time: 0.167233 Aug 24 03:43:40.139072 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6506/7498] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:39 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:41.159515 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.160196 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.168061 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.168683 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.169205 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.170105 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.170581 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.171027 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.319634 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.328101 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-087ecbd0-be66-4bf0-a1e4-4c221f779e38 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1559 microversion: 2.1 time: 0.172491 Aug 24 03:43:41.328673 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6507/7499] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:41.347577 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:43:41.348297 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:43:41.355637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.356143 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.356598 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.357344 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:41.357819 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:41.358267 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:41.490660 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:43:41.499192 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d179a3e2-8e22-48de-a978-75130e1c1425 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1559 microversion: 2.1 time: 0.155480 Aug 24 03:43:41.499779 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6508/7500] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:43:41 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:43:43.468705 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:43:43.479149 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:43:43.479646 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:43:43.480102 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:43:43.491573 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] Creating event network-changed:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:43:43.496590 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-7842caf1-15c3-4584-b9a0-26d6a6d2c7dc req-281fc87c-17e9-4885-9807-828abd06fd03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031596 Aug 24 03:43:43.497373 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6509/7501] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:45:43.217436 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:45:43.218138 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:45:43.301126 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:45:43.301789 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:45:57.060455 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 03:45:57.061482 n-d-854121-3 devstack@n-api.service[128567]: ERROR oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 03:45:57.062177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:57.063033 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=18 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:57.133101 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-266937318"}} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:45:57.135841 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:45:57.142177 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.142669 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.143119 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.143820 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:45:57.144303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:45:57.144766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:45:57.337266 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-24df9a37-cf2a-49c4-8443-e37312f416eb tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "POST /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406/action" status: 202 len: 0 microversion: 2.1 time: 0.279129 Aug 24 03:45:57.338010 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6510/7502] 10.222.0.49 () {60 vars in 1278 bytes} [Wed Aug 24 03:45:57 2022] POST /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 24 03:46:03.866574 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "name": "network-vif-plugged", "status": "completed", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:03.880871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:03.881376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:03.881830 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:03.888456 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [864ddcb3-81c9-4d8f-9621-add994505ad3] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51564. Aug 24 03:46:03.893563 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] [df2f6acd-0881-4a92-a55a-21fe5f801fa5] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 51566. Aug 24 03:46:03.896314 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] Creating event network-vif-plugged:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:46:03.902135 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-9c0ecbf9-3dae-4613-bda6-cf153d428b55 req-2ab40f0a-7520-4e54-a69d-d134ac66666d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043275 Aug 24 03:46:03.902744 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6511/7503] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:17.475071 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_api:SELECT=4 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:17.476189 n-d-854121-3 devstack@n-api.service[128567]: DEBUG dbcounter [-] [128567] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128567) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:17.481031 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:17.481637 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:17.490363 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.490877 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.491392 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.492072 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.492551 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.493040 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.521298 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:17.600967 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-d61566fa-e706-426d-8e15-da6fa0c0a4b3 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 204 len: 0 microversion: 2.1 time: 0.127496 Aug 24 03:46:17.601844 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6512/7504] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:17 2022] DELETE /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:46:17.660276 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:17.677048 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.677542 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.677995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.689377 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] Creating event network-changed:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:46:17.694287 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-e1999971-a144-4c07-ac03-946dc00292f9 req-f58baf2d-1f6b-47f4-a425-de95bdcd73de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090926 Aug 24 03:46:17.695076 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6513/7505] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:17.705008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:17.706402 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:17.716506 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.717039 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.717494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.718212 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:17.718681 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:17.719118 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:17.866340 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:17.874703 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-43e46eb9-708a-487e-bdc5-d6e3b0d2cf8f tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1683 microversion: 2.1 time: 0.177822 Aug 24 03:46:17.875280 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6514/7506] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:17 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:18.896896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:18.897603 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:18.904370 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.904923 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.905377 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:18.906078 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:18.906543 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:18.906979 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.047435 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:19.055341 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9dc4cd0a-dc4a-47ac-9950-dcccac2ed360 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1683 microversion: 2.1 time: 0.162365 Aug 24 03:46:19.056122 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6515/7507] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:18 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:19.937523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:19.948766 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:19.949641 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:19.950195 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:19.964327 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] Creating event network-vif-unplugged:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:46:19.969435 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-830dbe30-b33e-4382-ab90-1ccebf4708f8 req-d4ca0a15-32e7-4c86-ac11-1a58d6e42974 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036637 Aug 24 03:46:19.970624 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6516/7508] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:20.077980 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:20.078124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:20.084865 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.085380 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.085834 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.086563 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.087041 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.087483 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.156386 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:20.164733 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-45c4ca1e-c1da-4885-b3e3-7789ed9097ef tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 200 len: 1498 microversion: 2.1 time: 0.091803 Aug 24 03:46:20.165307 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6517/7509] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:20 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 1498 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:20.232183 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58526a3-9f18-4884-a9f4-a2617721e406", "name": "network-vif-deleted", "tag": "4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:20.242269 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:20.242762 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:20.243206 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:20.254490 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] Creating event network-vif-deleted:4c2bf3a4-2dd4-40bc-8967-4ddeb8f76b31 for instance d58526a3-9f18-4884-a9f4-a2617721e406 on n-h1-854121-3 Aug 24 03:46:20.260380 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-55640bd3-deb5-4a5d-9a29-888194a16f8b req-d5c12e80-67d1-4a9a-b625-aa08b7be2509 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093648 Aug 24 03:46:20.261240 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6518/7510] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:21.191824 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:21.193476 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: d58526a3-9f18-4884-a9f4-a2617721e406] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:21.200699 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.201232 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.201680 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.202391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:21.202892 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:21.203331 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:21.216419 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] HTTP exception thrown: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Request method failure captured: Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 HTTP/1.1 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZ2Fe14DLUSZeksUcbCyaBc1Z-8M8-qbHnZ6PSvx3HEkiLpNcmiVBbARVTu05N1RpI_ydvdupg0oD9RAqeHVtaTgj9O085gMCyeL72QG97lD1BNcsTJBrA49lwlFB2kAcg-2QbhYlcrkXhEHLdOzDZKWGPIEUkhTuiXwZ5mnwylrq68 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ce3102a9e89c4765bb411c0bff6d6807 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ce3102a9e89c4765bb411c0bff6d6807 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestSnapshotPattern-1653012085-project Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7b4f4dbc31b44699be9175d1762edcf7 Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestSnapshotPattern-1653012085-project Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'd58526a3-9f18-4884-a9f4-a2617721e406'} Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:21.218083 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Returning 404 to user: Instance d58526a3-9f18-4884-a9f4-a2617721e406 could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-e4740449-8388-408b-9494-a2b3234b496b tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406" status: 404 len: 111 microversion: 2.1 time: 0.036054 Aug 24 03:46:21.223303 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6519/7511] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:21 2022] GET /compute/v2.1/servers/d58526a3-9f18-4884-a9f4-a2617721e406 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 03:46:22.601858 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:22.602494 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:22.610158 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.610767 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.611303 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.612124 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.612704 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.613246 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.639609 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Going to try to terminate instance {{(pid=128567) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 03:46:22.735008 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9ffae633-42c8-4111-956c-b66983273150 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "DELETE /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 204 len: 0 microversion: 2.1 time: 0.136996 Aug 24 03:46:22.736048 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6520/7512] 10.222.0.49 () {58 vars in 1239 bytes} [Wed Aug 24 03:46:22 2022] DELETE /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 03:46:22.741591 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:22.753094 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.753590 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.754030 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.769305 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] Creating event network-changed:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:46:22.774505 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-0778c79a-b49c-492d-8a8e-e8758956abf5 req-f90c80d5-ce8b-4070-89e1-c94c7a703bbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036922 Aug 24 03:46:22.775115 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6521/7513] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 03:46:22.781781 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:22.782523 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:22.789376 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.789871 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.790320 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.791029 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:22.791498 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:22.791933 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:22.932799 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:22.941456 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-dce79be8-7c4c-4ac8-8a4a-6dda0da6ca24 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1681 microversion: 2.1 time: 0.163943 Aug 24 03:46:22.942067 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6522/7514] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:22 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 03:46:23.963393 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:23.964008 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:23.971126 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.971639 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.972096 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:23.972850 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:23.973325 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:23.973770 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.107596 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.policy [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4f4dbc31b44699be9175d1762edcf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3102a9e89c4765bb411c0bff6d6807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128567) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 03:46:24.116367 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-9830be7b-d737-4d9d-a97d-1dd26e9e3953 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 200 len: 1563 microversion: 2.1 time: 0.157001 Aug 24 03:46:24.116981 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6523/7515] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:23 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 03:46:24.789522 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae", "name": "network-vif-deleted", "tag": "147fa508-d035-455e-bcc1-166b3311196d"}]} {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 03:46:24.803905 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:24.804411 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:24.804896 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:24.816752 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.compute.server_external_events [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] Creating event network-vif-deleted:147fa508-d035-455e-bcc1-166b3311196d for instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae on n-h2-854121-3 Aug 24 03:46:24.822038 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [req-82dd5872-2553-44c6-b035-ab12736e4252 req-33bfdc58-1827-4400-9702-bde97dbc28ec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036819 Aug 24 03:46:24.822696 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6524/7516] 10.222.0.49 () {64 vars in 1317 bytes} [Wed Aug 24 03:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 03:46:25.140995 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.141633 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.compute.api [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] [instance: b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae] Fetching instance by UUID {{(pid=128567) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 03:46:25.147895 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.148391 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.148876 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.149614 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Acquiring lock "71301810-8efc-454b-bb1e-01e7f37efce0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 03:46:25.150080 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 03:46:25.150517 n-d-854121-3 devstack@n-api.service[128567]: DEBUG oslo_concurrency.lockutils [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Lock "71301810-8efc-454b-bb1e-01e7f37efce0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128567) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 03:46:25.164779 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.wsgi [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] HTTP exception thrown: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Request method failure captured: Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: request: GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae HTTP/1.1 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Accept: application/json Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Accept-Encoding: identity Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Connection: close Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Content-Length: 0 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Content-Type: application/json Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Host: 10.222.0.49 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: Openstack-System-Scope: None Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: User-Agent: python-urllib3/1.26.11 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Auth-Token: gAAAAABjBZ2Fe14DLUSZeksUcbCyaBc1Z-8M8-qbHnZ6PSvx3HEkiLpNcmiVBbARVTu05N1RpI_ydvdupg0oD9RAqeHVtaTgj9O085gMCyeL72QG97lD1BNcsTJBrA49lwlFB2kAcg-2QbhYlcrkXhEHLdOzDZKWGPIEUkhTuiXwZ5mnwylrq68 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Id: None Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Domain-Name: None Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Identity-Status: Confirmed Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Is-Admin-Project: True Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Id: default Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Domain-Name: Default Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Id: ce3102a9e89c4765bb411c0bff6d6807 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Project-Name: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Role: reader,member Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Roles: reader,member Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_ce3102a9e89c4765bb411c0bff6d6807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Id: ce3102a9e89c4765bb411c0bff6d6807 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-Tenant-Name: tempest-TestSnapshotPattern-1653012085 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-User: tempest-TestSnapshotPattern-1653012085-project Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Id: default Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-User-Domain-Name: Default Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-User-Id: 7b4f4dbc31b44699be9175d1762edcf7 Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: X-User-Name: tempest-TestSnapshotPattern-1653012085-project Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: method: > Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: exception: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: action_args: {'id': 'b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae'} Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 03:46:25.166492 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: ERROR nova.api.openstack.wsgi Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Returning 404 to user: Instance b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae could not be found. {{(pid=128567) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-51d5ecc0-3f08-4026-852d-608d5aa903ce tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae" status: 404 len: 111 microversion: 2.1 time: 0.032220 Aug 24 03:46:25.170966 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6525/7517] 10.222.0.49 () {58 vars in 1236 bytes} [Wed Aug 24 03:46:25 2022] GET /compute/v2.1/servers/b1b95ddd-bdcb-4729-850d-e7fe3e7b5bae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 03:46:25.337397 n-d-854121-3 devstack@n-api.service[128567]: DEBUG nova.api.openstack.wsgi [None req-87e8099e-5834-4e55-aed7-b9d3ffd704c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] Calling method '.version_select at 0x7f6b912253a0>' {{(pid=128567) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 03:46:25.366589 n-d-854121-3 devstack@n-api.service[128567]: INFO nova.api.openstack.requestlog [None req-87e8099e-5834-4e55-aed7-b9d3ffd704c1 tempest-TestSnapshotPattern-1653012085 tempest-TestSnapshotPattern-1653012085-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1934003943" status: 202 len: 0 microversion: 2.1 time: 0.033085 Aug 24 03:46:25.370631 n-d-854121-3 devstack@n-api.service[128567]: [pid: 128567|app: 0|req: 6526/7518] 10.222.0.49 () {58 vars in 1257 bytes} [Wed Aug 24 03:46:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1934003943 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 03:49:03.226359 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:03.227102 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:03.309595 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:03.309901 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:49:15.347844 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:49:15.348652 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:49:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:23.240947 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:23.241494 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:23.324150 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:23.324361 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:52:35.355935 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:52:35.356509 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:52:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:55:43.250190 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:55:43.250788 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 03:55:43.332089 n-d-854121-3 devstack@n-api.service[128567]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 03:55:43.332488 n-d-854121-3 devstack@n-api.service[128567]: Wed Aug 24 03:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!